2024-05-10T04:34:19.496 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T04:34:19.496 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/cap-flush} --owner scheduled_pdonnell@teuthology --name pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567 --verbose -- /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/orig.config.yaml 2024-05-10T04:34:19.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T04:34:19.631 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567 branch: wip-pdonnell-testing-20240509.171335-reef-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/cap-flush} email: pdonnell@redhat.com first_in_suite: false job_id: '7700567' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240509.171335-reef-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds.a sha1: 50174015a7e79f951b988949abe236791f52d4da ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 50174015a7e79f951b988949abe236791f52d4da kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240509.171335-reef-debug sha1: 50174015a7e79f951b988949abe236791f52d4da owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4933 sha1: 50174015a7e79f951b988949abe236791f52d4da sleep_before_teardown: 0 subset: 420/512 suite: fs suite_branch: wip-pdonnell-testing-20240509.171335-reef-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50174015a7e79f951b988949abe236791f52d4da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5zI8f/Vmqt9ckC5nib5M/1cLyNpw2cqzhvKg8lUYKA4QThkX+Ysxrdxo2L24xWSzgLmtxVZVBXZPG6gWT3kNs= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKL0pYv3+TY33uNxOtK5ETDayGrI2phIDOVKQ/QblVEgaDWT22RBe1itRNIptcdDM7XIp3H48NhLF40POwkpBpw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_cap_flush teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_02:33:39 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T04:34:19.631 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa; will attempt to use it 2024-05-10T04:34:19.632 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks 2024-05-10T04:34:19.632 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T04:34:19.634 INFO:teuthology.task.internal:Checking packages... 2024-05-10T04:34:19.665 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '50174015a7e79f951b988949abe236791f52d4da' 2024-05-10T04:34:19.665 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T04:34:19.665 INFO:teuthology.packaging:ref: None 2024-05-10T04:34:19.665 INFO:teuthology.packaging:tag: None 2024-05-10T04:34:19.665 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T04:34:19.665 INFO:teuthology.packaging:sha1: 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:34:19.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T04:34:19.894 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1330.g50174015 2024-05-10T04:34:19.896 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T04:34:19.903 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T04:34:19.903 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T04:34:19.917 INFO:teuthology.task.internal:Saving configuration 2024-05-10T04:34:19.934 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T04:34:19.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T04:34:19.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 04:29:11.814370', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5zI8f/Vmqt9ckC5nib5M/1cLyNpw2cqzhvKg8lUYKA4QThkX+Ysxrdxo2L24xWSzgLmtxVZVBXZPG6gWT3kNs='} 2024-05-10T04:34:19.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 04:29:11.816145', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKL0pYv3+TY33uNxOtK5ETDayGrI2phIDOVKQ/QblVEgaDWT22RBe1itRNIptcdDM7XIp3H48NhLF40POwkpBpw='} 2024-05-10T04:34:19.993 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T04:34:19.999 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-10T04:34:19.999 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-10T04:34:19.999 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T04:34:20.075 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a3679f0d0>, signals=[15]) 2024-05-10T04:34:20.076 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T04:34:20.083 INFO:teuthology.task.internal:Opening connections... 2024-05-10T04:34:20.083 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:34:20.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:34:20.160 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:34:20.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:34:20.235 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T04:34:20.242 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-05-10T04:34:20.265 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-05-10T04:34:20.265 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 8" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-05-10T04:34:20.326 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-05-10T04:34:20.327 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T04:34:20.327 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T04:34:20.327 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T04:34:20.327 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-05-10T04:34:20.345 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-05-10T04:34:20.368 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-05-10T04:34:20.368 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-05-10T04:34:20.429 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T04:34:20.430 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T04:34:20.431 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-05-10T04:34:20.453 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T04:34:20.463 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T04:34:20.471 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T04:34:20.471 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-05-10T04:34:20.474 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-05-10T04:34:20.494 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T04:34:20.500 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T04:34:20.500 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-05-10T04:34:20.536 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-05-10T04:34:20.573 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T04:34:20.627 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T04:34:20.644 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-10T04:34:20.644 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-05-10T04:34:20.644 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-10T04:34:20.645 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T04:34:20.645 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T04:34:20.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:34:20.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2024-05-10T04:34:20.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:34:20.669 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2024-05-10T04:34:20.829 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:34:20.829 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-10T04:34:20.829 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-05-10T04:34:20.850 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-489.el8.x86_64 2024-05-10T04:34:20.851 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:34:20.851 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-10T04:34:20.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum upgrade -y linux-firmware 2024-05-10T04:34:20.912 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:34:20.912 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-10T04:34:20.913 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-05-10T04:34:20.934 INFO:teuthology.orchestra.run.smithi129.stdout:4.18.0-489.el8.x86_64 2024-05-10T04:34:20.934 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:34:20.934 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-10T04:34:20.935 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum upgrade -y linux-firmware 2024-05-10T04:34:28.985 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - AppStream 5.0 MB/s | 28 MB 00:05 2024-05-10T04:34:30.900 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - AppStream 3.7 MB/s | 28 MB 00:07 2024-05-10T04:34:36.335 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - BaseOS 4.4 MB/s | 10 MB 00:02 2024-05-10T04:34:38.278 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - Extras 51 kB/s | 18 kB 00:00 2024-05-10T04:34:38.392 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - BaseOS 4.1 MB/s | 10 MB 00:02 2024-05-10T04:34:38.611 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - Extras common packages 34 kB/s | 7.7 kB 00:00 2024-05-10T04:34:38.830 INFO:teuthology.orchestra.run.smithi129.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-05-10T04:34:40.375 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2024-05-10T04:34:40.734 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - Extras common packages 31 kB/s | 7.7 kB 00:00 2024-05-10T04:34:40.969 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-05-10T04:34:41.957 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 4.5 MB/s | 14 MB 00:03 2024-05-10T04:34:42.744 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 14 MB 00:01 2024-05-10T04:34:45.447 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 512 kB/s | 24 kB 00:00 2024-05-10T04:34:46.252 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 531 kB/s | 24 kB 00:00 2024-05-10T04:34:48.700 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-05-10T04:34:48.700 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-05-10T04:34:48.700 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-05-10T04:34:48.701 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-05-10T04:34:48.701 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-05-10T04:34:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 baseos 355 M 2024-05-10T04:34:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:34:48.701 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-05-10T04:34:48.701 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-05-10T04:34:48.701 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 1 Package 2024-05-10T04:34:48.701 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:34:48.702 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 355 M 2024-05-10T04:34:48.702 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-05-10T04:34:49.444 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-10T04:34:49.444 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-10T04:34:49.444 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-05-10T04:34:49.445 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-10T04:34:49.445 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-05-10T04:34:49.445 INFO:teuthology.orchestra.run.smithi082.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 baseos 355 M 2024-05-10T04:34:49.445 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:34:49.445 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-10T04:34:49.445 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-10T04:34:49.445 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 1 Package 2024-05-10T04:34:49.445 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:34:49.446 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 355 M 2024-05-10T04:34:49.446 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-05-10T04:34:57.853 INFO:teuthology.orchestra.run.smithi082.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 43 MB/s | 355 MB 00:08 2024-05-10T04:34:57.853 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:34:57.853 INFO:teuthology.orchestra.run.smithi082.stdout:Total 42 MB/s | 355 MB 00:08 2024-05-10T04:34:59.949 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-05-10T04:35:00.019 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-05-10T04:35:00.019 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-05-10T04:35:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-05-10T04:35:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-05-10T04:35:02.237 INFO:teuthology.orchestra.run.smithi129.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 26 MB/s | 355 MB 00:13 2024-05-10T04:35:02.238 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:35:02.238 INFO:teuthology.orchestra.run.smithi129.stdout:Total 26 MB/s | 355 MB 00:13 2024-05-10T04:35:04.337 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-05-10T04:35:04.397 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-05-10T04:35:04.397 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-05-10T04:35:06.561 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-05-10T04:35:06.592 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-05-10T04:35:24.950 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-05-10T04:35:25.331 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-05-10T04:35:25.553 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:35:25.793 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:35:25.793 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-05-10T04:35:26.264 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:35:26.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:35:26.265 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-05-10T04:35:26.265 INFO:teuthology.orchestra.run.smithi082.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-05-10T04:35:26.265 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:35:26.265 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-10T04:35:26.462 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-10T04:35:26.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:35:26.682 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ 2024-05-10T04:35:26.683 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ --input-file=- 2024-05-10T04:35:26.685 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2024-05-10T04:35:29.319 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-05-10T04:35:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-05-10T04:35:29.879 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:35:30.126 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:35:30.126 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-05-10T04:35:30.582 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:35:30.582 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:35:30.582 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-05-10T04:35:30.582 INFO:teuthology.orchestra.run.smithi129.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-05-10T04:35:30.582 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:35:30.582 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-05-10T04:35:30.779 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-10T04:35:30.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:35:30.924 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ 2024-05-10T04:35:30.924 DEBUG:teuthology.orchestra.run.smithi129:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ --input-file=- 2024-05-10T04:35:30.927 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi129.front.sepia.ceph.com to complete... 2024-05-10T04:35:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10 04:35:43 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [425099368/425099368] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-10T04:35:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2024-05-10 04:35:43-- 2024-05-10T04:35:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 17s 2024-05-10T04:35:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 405M in 16s (24.9 MB/s) 2024-05-10T04:35:43.340 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-10T04:35:43.340 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-10T04:35:45.148 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying... ######################################## 2024-05-10T04:35:45.192 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing... ######################################## 2024-05-10T04:35:45.301 INFO:teuthology.orchestra.run.smithi082.stdout:Updating / installing... 2024-05-10T04:35:55.421 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10 04:35:55 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [425099368/425099368] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-10T04:35:55.422 INFO:teuthology.orchestra.run.smithi129.stderr:FINISHED --2024-05-10 04:35:55-- 2024-05-10T04:35:55.422 INFO:teuthology.orchestra.run.smithi129.stderr:Total wall clock time: 24s 2024-05-10T04:35:55.422 INFO:teuthology.orchestra.run.smithi129.stderr:Downloaded: 1 files, 405M in 24s (16.9 MB/s) 2024-05-10T04:35:55.425 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-10T04:35:55.426 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-10T04:35:57.252 INFO:teuthology.orchestra.run.smithi129.stdout:Verifying... ######################################## 2024-05-10T04:35:57.296 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing... ######################################## 2024-05-10T04:35:57.406 INFO:teuthology.orchestra.run.smithi129.stdout:Updating / installing... 2024-05-10T04:36:27.955 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-10T04:36:32.146 INFO:teuthology.orchestra.run.smithi082.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-05-10T04:36:39.977 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-10T04:36:41.414 INFO:teuthology.orchestra.run.smithi129.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-05-10T04:36:52.324 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-10T04:36:52.325 DEBUG:teuthology.orchestra.run.smithi082:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-10T04:36:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-10T04:36:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-10T04:36:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-10T04:36:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-10T04:36:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-10T04:36:52.385 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-10T04:36:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-10T04:36:52.387 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-10T04:36:52.388 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-10T04:36:52.389 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-10T04:36:52.390 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-10T04:36:52.391 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-10T04:36:52.392 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-10T04:36:52.393 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-10T04:36:52.394 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-10T04:36:52.395 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-10T04:36:52.396 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-10T04:36:52.397 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-10T04:36:52.398 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-10T04:36:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-10T04:36:52.400 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-10T04:36:52.401 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-10T04:36:52.402 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-10T04:36:52.403 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-10T04:36:52.404 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-10T04:36:52.405 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-10T04:36:52.406 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-10T04:36:52.407 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-10T04:36:52.408 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-10T04:36:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-10T04:36:52.410 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-10T04:36:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-10T04:36:52.412 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-10T04:36:52.413 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-10T04:36:52.414 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-10T04:36:52.415 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-10T04:36:52.416 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-10T04:36:52.417 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-10T04:36:52.418 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-10T04:36:52.419 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-10T04:36:52.420 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-10T04:36:52.421 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-10T04:36:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-10T04:36:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-10T04:36:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-10T04:36:52.425 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-10T04:36:52.426 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-10T04:36:52.427 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-10T04:36:52.428 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-10T04:36:52.429 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-10T04:36:52.430 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-10T04:36:52.431 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-10T04:36:52.432 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-10T04:36:52.433 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-10T04:36:52.434 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-10T04:36:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-10T04:36:52.436 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-10T04:36:52.437 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-10T04:36:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-10T04:36:52.439 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-10T04:36:52.440 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-10T04:36:52.441 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-10T04:36:52.442 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-10T04:36:52.443 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-10T04:36:52.444 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-10T04:36:52.445 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-10T04:36:52.446 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-10T04:36:52.447 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-10T04:36:52.448 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-10T04:36:52.449 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-10T04:36:52.450 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-10T04:36:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-10T04:36:52.452 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-10T04:36:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-10T04:36:52.454 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-10T04:36:52.455 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-10T04:36:52.456 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-10T04:36:52.457 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-10T04:36:52.458 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-10T04:36:52.459 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-10T04:36:52.460 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-10T04:36:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-10T04:36:52.462 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-10T04:36:52.463 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-10T04:36:52.464 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-10T04:36:52.465 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-10T04:36:52.466 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-10T04:36:52.467 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-10T04:36:52.468 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-10T04:36:52.469 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-10T04:36:52.470 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-10T04:36:52.471 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-10T04:36:52.472 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-10T04:36:52.473 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-10T04:36:52.474 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-10T04:36:52.475 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-10T04:36:52.476 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-10T04:36:52.477 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-10T04:36:52.478 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-10T04:36:52.479 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-10T04:36:52.480 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-10T04:36:52.481 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-10T04:36:52.482 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-10T04:36:52.483 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-10T04:36:52.484 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-10T04:36:52.485 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-10T04:36:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-10T04:36:52.487 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-10T04:36:52.488 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-10T04:36:52.489 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-10T04:36:52.490 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-10T04:36:52.491 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-10T04:36:52.492 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-10T04:36:52.493 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-10T04:36:52.494 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-10T04:36:52.495 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-10T04:36:52.496 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-10T04:36:52.497 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-10T04:36:52.498 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-10T04:36:52.499 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-10T04:36:52.500 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-10T04:36:52.501 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-10T04:36:52.502 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-10T04:36:52.503 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-10T04:36:52.504 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-10T04:36:52.505 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-10T04:36:52.506 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-10T04:36:52.507 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-10T04:36:52.508 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-10T04:36:52.509 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-10T04:36:52.510 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-10T04:36:52.511 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-10T04:36:52.512 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-10T04:36:52.513 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-10T04:36:52.514 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-10T04:36:52.515 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-10T04:36:52.516 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-10T04:36:52.517 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-10T04:36:52.518 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-10T04:36:52.519 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-10T04:36:52.520 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-10T04:36:52.521 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-10T04:36:52.522 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-10T04:36:52.523 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-10T04:36:52.524 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-10T04:36:52.525 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-10T04:36:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-10T04:36:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-10T04:36:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-10T04:36:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-10T04:36:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-10T04:36:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-10T04:36:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:36:52.530 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-10T04:36:52.530 DEBUG:teuthology.orchestra.run.smithi082:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-10T04:36:52.555 INFO:teuthology.orchestra.run.smithi082.stdout:postinstall scriptlet (using /bin/sh): 2024-05-10T04:36:52.555 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:36:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:36:52.555 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-10T04:36:52.555 INFO:teuthology.orchestra.run.smithi082.stdout:for file in vmlinuz System.map config; do 2024-05-10T04:36:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-10T04:36:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: fi 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:done 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:36:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-10T04:36:52.557 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-10T04:36:52.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-05-10T04:36:52.632 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-05-10T04:36:52.632 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-05-10T04:36:52.632 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.02 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 129.el8 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Group : System Environment/Base 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 9265586 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : kbuilder.bsys.centos.org 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Relocations : (not relocatable) 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : CentOS BuildSystem 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-05-10T04:36:52.633 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:36:52.634 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T04:36:52.635 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T04:36:52.635 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 6.9.0-rc3-g806ec36b2112 2024-05-10T04:36:52.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T04:36:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-05-10T04:36:59.349 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-05-10T04:36:59.350 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-05-10T04:36:59.373 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.0xCEswaSbg 2024-05-10T04:36:59.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0xCEswaSbg 2024-05-10T04:36:59.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.0xCEswaSbg 2024-05-10T04:36:59.591 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.0xCEswaSbg is 6KB 2024-05-10T04:36:59.640 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.0xCEswaSbg 2024-05-10T04:36:59.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T04:36:59.730 INFO:teuthology.orchestra.run.smithi082.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-05-10T04:36:59.730 INFO:teuthology.orchestra.run.smithi082.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-05-10T04:36:59.731 INFO:teuthology.orchestra.run.smithi082.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-05-10T04:36:59.731 INFO:teuthology.orchestra.run.smithi082.stdout:a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112.conf 2024-05-10T04:36:59.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112 2024-05-10T04:36:59.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-05-10T04:37:01.671 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-10T04:37:01.671 DEBUG:teuthology.orchestra.run.smithi129:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-10T04:37:01.733 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-10T04:37:01.734 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-10T04:37:01.735 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-10T04:37:01.736 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-10T04:37:01.737 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-10T04:37:01.738 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-10T04:37:01.738 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-10T04:37:01.738 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-10T04:37:01.738 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-10T04:37:01.738 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-10T04:37:01.738 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-10T04:37:01.738 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-10T04:37:01.739 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-10T04:37:01.740 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-10T04:37:01.741 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-10T04:37:01.742 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-10T04:37:01.743 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-10T04:37:01.744 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-10T04:37:01.745 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-10T04:37:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-10T04:37:01.747 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-10T04:37:01.748 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-10T04:37:01.749 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-10T04:37:01.750 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-10T04:37:01.751 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-10T04:37:01.752 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-10T04:37:01.753 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-10T04:37:01.754 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-10T04:37:01.755 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-10T04:37:01.756 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-10T04:37:01.757 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-10T04:37:01.758 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-10T04:37:01.759 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-10T04:37:01.760 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-10T04:37:01.761 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-10T04:37:01.762 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-10T04:37:01.763 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-10T04:37:01.765 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-10T04:37:01.766 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-10T04:37:01.767 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-10T04:37:01.768 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-10T04:37:01.769 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-10T04:37:01.770 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-10T04:37:01.771 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-10T04:37:01.772 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-10T04:37:01.773 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-10T04:37:01.774 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-10T04:37:01.775 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-10T04:37:01.776 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-10T04:37:01.777 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-10T04:37:01.778 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-10T04:37:01.779 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-10T04:37:01.780 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-10T04:37:01.781 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-10T04:37:01.781 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-10T04:37:01.781 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-10T04:37:01.781 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-10T04:37:01.781 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-10T04:37:01.781 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-10T04:37:01.781 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-10T04:37:01.781 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-10T04:37:01.782 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-10T04:37:01.783 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-10T04:37:01.784 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-10T04:37:01.785 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-10T04:37:01.786 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-10T04:37:01.787 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-10T04:37:01.788 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-10T04:37:01.789 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-10T04:37:01.790 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-10T04:37:01.791 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-10T04:37:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-10T04:37:01.793 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-10T04:37:01.794 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-10T04:37:01.795 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-10T04:37:01.796 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-10T04:37:01.797 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-10T04:37:01.798 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-10T04:37:01.799 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-10T04:37:01.800 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-10T04:37:01.801 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-10T04:37:01.802 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-10T04:37:01.803 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-10T04:37:01.804 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-10T04:37:01.805 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-10T04:37:01.806 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-10T04:37:01.807 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-10T04:37:01.808 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-10T04:37:01.809 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-10T04:37:01.810 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-10T04:37:01.811 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-10T04:37:01.812 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-10T04:37:01.813 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-10T04:37:01.814 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-10T04:37:01.815 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-10T04:37:01.816 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-10T04:37:01.817 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-10T04:37:01.818 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-10T04:37:01.819 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-10T04:37:01.820 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-10T04:37:01.821 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-10T04:37:01.822 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-10T04:37:01.823 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-10T04:37:01.824 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-10T04:37:01.825 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-10T04:37:01.826 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-10T04:37:01.827 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-10T04:37:01.828 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-10T04:37:01.829 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-10T04:37:01.830 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-10T04:37:01.831 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-10T04:37:01.831 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-10T04:37:01.831 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-10T04:37:01.831 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-10T04:37:01.831 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-10T04:37:01.831 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-10T04:37:01.831 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-10T04:37:01.831 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-10T04:37:01.832 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-10T04:37:01.833 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-10T04:37:01.834 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-10T04:37:01.835 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-10T04:37:01.836 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-10T04:37:01.837 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-10T04:37:01.838 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-10T04:37:01.839 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-10T04:37:01.840 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-10T04:37:01.841 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-10T04:37:01.842 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-10T04:37:01.843 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-10T04:37:01.844 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-10T04:37:01.845 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-10T04:37:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-10T04:37:01.847 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-10T04:37:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-10T04:37:01.849 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-10T04:37:01.850 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-10T04:37:01.851 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-10T04:37:01.852 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-10T04:37:01.853 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-10T04:37:01.854 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-10T04:37:01.855 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-10T04:37:01.856 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-10T04:37:01.857 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-10T04:37:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-10T04:37:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-10T04:37:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-10T04:37:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-10T04:37:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-10T04:37:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-10T04:37:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-10T04:37:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-10T04:37:01.859 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-10T04:37:01.860 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-10T04:37:01.861 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-10T04:37:01.862 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-10T04:37:01.863 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-10T04:37:01.864 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-10T04:37:01.865 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-10T04:37:01.866 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-10T04:37:01.867 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-10T04:37:01.868 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-10T04:37:01.869 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-10T04:37:01.870 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-10T04:37:01.871 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-10T04:37:01.872 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-10T04:37:01.873 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-10T04:37:01.874 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-10T04:37:01.875 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-10T04:37:01.876 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-10T04:37:01.877 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-10T04:37:01.878 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-10T04:37:01.879 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-10T04:37:01.880 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-10T04:37:01.881 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-10T04:37:01.882 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-10T04:37:01.883 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-10T04:37:01.884 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-10T04:37:01.885 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-10T04:37:01.886 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-10T04:37:01.887 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-10T04:37:01.888 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-10T04:37:01.889 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-10T04:37:01.890 INFO:teuthology.orchestra.run.smithi129.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:37:01.893 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-10T04:37:01.894 DEBUG:teuthology.orchestra.run.smithi129:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout:postinstall scriptlet (using /bin/sh): 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout:fi 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout:for file in vmlinuz System.map config; do 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout: fi 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout:done 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-10T04:37:01.921 INFO:teuthology.orchestra.run.smithi129.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout:fi 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout:fi 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-10T04:37:01.922 INFO:teuthology.orchestra.run.smithi129.stdout:fi 2024-05-10T04:37:01.923 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -qi grub2-tools 2024-05-10T04:37:02.009 INFO:teuthology.orchestra.run.smithi129.stdout:Name : grub2-tools 2024-05-10T04:37:02.009 INFO:teuthology.orchestra.run.smithi129.stdout:Epoch : 1 2024-05-10T04:37:02.009 INFO:teuthology.orchestra.run.smithi129.stdout:Version : 2.02 2024-05-10T04:37:02.009 INFO:teuthology.orchestra.run.smithi129.stdout:Release : 129.el8 2024-05-10T04:37:02.009 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: x86_64 2024-05-10T04:37:02.009 INFO:teuthology.orchestra.run.smithi129.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Group : System Environment/Base 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Size : 9265586 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:License : GPLv3+ 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Build Host : kbuilder.bsys.centos.org 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Relocations : (not relocatable) 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Packager : CentOS BuildSystem 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:Vendor : CentOS 2024-05-10T04:37:02.010 INFO:teuthology.orchestra.run.smithi129.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout:Summary : Support tools for GRUB. 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout:Description : 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout:hardware devices. 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:37:02.011 INFO:teuthology.orchestra.run.smithi129.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T04:37:02.012 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T04:37:02.012 INFO:teuthology.task.kernel:Updating grub on smithi129 to boot 6.9.0-rc3-g806ec36b2112 2024-05-10T04:37:02.012 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T04:37:08.262 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2024-05-10T04:37:10.087 INFO:teuthology.orchestra.run.smithi129.stderr:done 2024-05-10T04:37:10.090 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-05-10T04:37:10.154 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.Ibav8GkjHo 2024-05-10T04:37:10.154 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ibav8GkjHo 2024-05-10T04:37:10.234 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.Ibav8GkjHo 2024-05-10T04:37:10.394 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.Ibav8GkjHo is 6KB 2024-05-10T04:37:10.442 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.Ibav8GkjHo 2024-05-10T04:37:10.459 DEBUG:teuthology.orchestra.run.smithi129:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T04:37:10.537 INFO:teuthology.orchestra.run.smithi129.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-05-10T04:37:10.538 INFO:teuthology.orchestra.run.smithi129.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-05-10T04:37:10.538 INFO:teuthology.orchestra.run.smithi129.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-05-10T04:37:10.538 INFO:teuthology.orchestra.run.smithi129.stdout:a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112.conf 2024-05-10T04:37:10.539 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112 2024-05-10T04:37:10.730 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2024-05-10T04:37:29.924 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-10T04:37:29.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T04:37:29.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:37:40.742 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-10T04:37:40.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-05-10T04:37:40.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:37:48.449 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-05-10T04:37:57.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T04:37:57.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:37:59.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-05-10T04:38:00.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-05-10T04:38:08.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-05-10T04:38:08.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:38:11.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-05-10T04:38:12.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T04:38:12.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:38:23.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-05-10T04:38:23.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:38:30.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-05-10T04:38:41.694 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-05-10T04:38:45.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T04:38:45.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:38:46.343 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-10T04:38:46.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T04:38:46.954 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-05-10T04:38:46.954 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-05-10T04:38:46.997 INFO:teuthology.orchestra.run.smithi082.stdout:6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:46.997 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:46.997 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T04:38:46.997 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T04:38:47.998 DEBUG:teuthology.parallel:result is None 2024-05-10T04:38:56.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-05-10T04:38:56.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:38:57.108 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-05-10T04:38:57.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-05-10T04:38:57.571 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-05-10T04:38:57.572 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-05-10T04:38:57.617 INFO:teuthology.orchestra.run.smithi129.stdout:6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:57.617 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:57.617 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T04:38:57.617 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T04:38:58.618 DEBUG:teuthology.parallel:result is None 2024-05-10T04:38:58.619 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T04:38:58.630 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T04:38:58.630 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T04:38:58.635 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T04:38:58.682 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T04:38:58.689 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T04:38:58.699 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T04:38:58.700 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T04:38:58.704 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T04:38:58.761 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T04:38:58.768 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T04:38:58.768 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T04:38:58.772 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T04:38:58.888 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:38:58.921 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:38:58.921 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:38:58.951 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:38:58.955 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T04:38:58.962 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T04:38:58.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T04:38:58.966 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T04:38:59.036 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T04:38:59.045 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T04:38:59.045 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T04:38:59.049 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T04:38:59.093 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:38:59.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:38:59.277 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:38:59.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:38:59.415 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:38:59.415 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T04:38:59.481 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:38:59.552 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:38:59.628 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:38:59.701 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:38:59.767 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:38:59.768 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T04:38:59.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-05-10T04:38:59.838 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-05-10T04:38:59.944 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:39:00.009 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:39:00.302 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T04:39:00.312 INFO:teuthology.task.internal:Starting timer... 2024-05-10T04:39:00.312 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T04:39:00.321 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T04:39:00.330 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-05-10T04:39:00.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-05-10T04:39:00.435 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-05-10T04:39:00.440 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2024-05-10T04:39:00.595 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2024-05-10T04:39:00.599 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T04:39:00.599 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-05-10T04:39:00.649 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-05-10T04:39:00.649 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2024-05-10T04:39:00.700 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2024-05-10T04:39:00.700 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi129.front.sepia.ceph.com': 'permissive'} 2024-05-10T04:39:00.701 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:39:00.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:39:00.773 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:39:00.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:39:00.841 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T04:39:00.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-05-10T04:39:00.909 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2024-05-10T04:39:00.977 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T04:39:00.987 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-10T04:39:00.992 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-10T04:39:01.132 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T04:39:01.170 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T04:39:01.171 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi129.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T04:46:26.616 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com')] 2024-05-10T04:46:26.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T04:46:26.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:46:26.714 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-10T04:46:26.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-10T04:46:26.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-05-10T04:46:26.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:46:26.930 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-05-10T04:46:27.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-05-10T04:46:27.049 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T04:46:27.061 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T04:46:27.061 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T04:46:27.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:46:27.067 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T04:46:27.067 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:46:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T04:46:27.162 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T04:46:27.165 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T04:46:27.193 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T04:46:27.261 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-05-10T04:46:27.282 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2024-05-10T04:46:27.287 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-05-10T04:46:27.308 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2024-05-10T04:46:27.318 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T04:46:27.339 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T04:46:27.348 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T04:46:27.370 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T04:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2024-05-10T04:46:27.442 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:46:27.442 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-10T04:46:27.442 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:46:27.442 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:46:27.442 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:46:27.442 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:46:27.453 INFO:teuthology.orchestra.run.smithi129.stderr:bash: ntpq: command not found 2024-05-10T04:46:27.461 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:46:27.461 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-05-10T04:46:27.461 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:46:27.461 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:46:27.461 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:46:27.461 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:46:27.462 INFO:teuthology.run_tasks:Running task install... 2024-05-10T04:46:27.470 DEBUG:teuthology.task.install:project ceph 2024-05-10T04:46:27.470 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}} 2024-05-10T04:46:27.473 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'} 2024-05-10T04:46:27.473 INFO:teuthology.task.install:Using flavor: default 2024-05-10T04:46:27.478 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T04:46:27.479 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-10T04:46:27.479 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T04:46:27.479 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:46:27.481 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T04:46:27.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:46:27.624 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T04:46:27.625 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T04:46:27.631 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T04:46:27.632 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T04:46:27.792 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T04:46:27.793 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:46:27.793 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T04:46:27.800 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T04:46:27.800 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:46:27.800 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T04:46:27.860 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T04:46:27.861 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T04:46:27.868 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T04:46:27.868 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T04:46:27.969 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T04:46:27.976 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T04:46:28.061 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T04:46:28.068 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T04:46:28.127 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-05-10T04:46:28.130 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-05-10T04:46:28.133 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2024-05-10T04:46:28.136 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2024-05-10T04:46:28.472 INFO:teuthology.orchestra.run.smithi082.stdout:76 files removed 2024-05-10T04:46:28.482 INFO:teuthology.orchestra.run.smithi129.stdout:76 files removed 2024-05-10T04:46:28.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T04:46:28.518 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T04:46:29.388 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 252 kB/s | 80 kB 00:00 2024-05-10T04:46:29.430 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 216 kB/s | 80 kB 00:00 2024-05-10T04:46:29.689 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-05-10T04:46:29.738 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 42 kB/s | 11 kB 00:00 2024-05-10T04:46:29.998 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 5.3 kB/s | 1.5 kB 00:00 2024-05-10T04:46:30.106 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2024-05-10T04:46:32.048 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - AppStream 15 MB/s | 28 MB 00:01 2024-05-10T04:46:32.157 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - AppStream 13 MB/s | 28 MB 00:02 2024-05-10T04:46:39.816 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - BaseOS 4.5 MB/s | 10 MB 00:02 2024-05-10T04:46:39.822 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - BaseOS 4.3 MB/s | 10 MB 00:02 2024-05-10T04:46:41.875 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2024-05-10T04:46:41.906 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2024-05-10T04:46:42.340 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 7.7 kB 00:00 2024-05-10T04:46:42.409 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 7.7 kB 00:00 2024-05-10T04:46:43.801 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - PowerTools 3.6 MB/s | 5.0 MB 00:01 2024-05-10T04:46:43.836 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - PowerTools 3.7 MB/s | 5.0 MB 00:01 2024-05-10T04:46:44.918 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-05-10T04:46:44.945 INFO:teuthology.orchestra.run.smithi129.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-05-10T04:46:45.740 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 19 MB/s | 14 MB 00:00 2024-05-10T04:46:46.069 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 13 MB/s | 14 MB 00:01 2024-05-10T04:46:49.888 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 523 kB/s | 24 kB 00:00 2024-05-10T04:46:50.186 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 417 kB/s | 24 kB 00:00 2024-05-10T04:46:53.649 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:46:53.650 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:46:53.659 INFO:teuthology.orchestra.run.smithi129.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-05-10T04:46:53.660 INFO:teuthology.orchestra.run.smithi129.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-05-10T04:46:53.661 INFO:teuthology.orchestra.run.smithi129.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-05-10T04:46:53.662 INFO:teuthology.orchestra.run.smithi129.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T04:46:53.663 INFO:teuthology.orchestra.run.smithi129.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T04:46:53.665 INFO:teuthology.orchestra.run.smithi129.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T04:46:53.666 INFO:teuthology.orchestra.run.smithi129.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T04:46:53.749 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-05-10T04:46:53.774 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2024-05-10T04:46:53.774 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-05-10T04:46:53.774 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2024-05-10T04:46:53.774 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-05-10T04:46:53.775 INFO:teuthology.orchestra.run.smithi129.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-05-10T04:46:53.775 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T04:46:53.775 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T04:46:53.775 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T04:46:53.775 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T04:46:53.775 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T04:46:53.776 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T04:46:53.776 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T04:46:53.776 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T04:46:53.776 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T04:46:53.776 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T04:46:53.776 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T04:46:53.777 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T04:46:53.777 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T04:46:53.777 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T04:46:53.777 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T04:46:53.777 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-05-10T04:46:53.777 INFO:teuthology.orchestra.run.smithi129.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-05-10T04:46:53.778 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-05-10T04:46:53.778 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T04:46:53.778 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T04:46:53.778 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:46:53.778 INFO:teuthology.orchestra.run.smithi129.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-05-10T04:46:53.779 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-05-10T04:46:53.779 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-05-10T04:46:53.779 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2024-05-10T04:46:53.779 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2024-05-10T04:46:53.779 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2024-05-10T04:46:53.779 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T04:46:53.779 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T04:46:53.779 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T04:46:53.780 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T04:46:53.780 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T04:46:53.780 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T04:46:53.780 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T04:46:53.780 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-05-10T04:46:53.780 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-05-10T04:46:53.780 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-05-10T04:46:53.781 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-05-10T04:46:53.781 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-05-10T04:46:53.781 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-05-10T04:46:53.781 INFO:teuthology.orchestra.run.smithi129.stdout: acl x86_64 2.2.53-3.el8 baseos 83 k 2024-05-10T04:46:53.781 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-05-10T04:46:53.781 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-05-10T04:46:53.781 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-05-10T04:46:53.781 INFO:teuthology.orchestra.run.smithi129.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-05-10T04:46:53.782 INFO:teuthology.orchestra.run.smithi129.stdout: libacl x86_64 2.2.53-3.el8 baseos 35 k 2024-05-10T04:46:53.782 INFO:teuthology.orchestra.run.smithi129.stdout: libacl-devel x86_64 2.2.53-3.el8 baseos 85 k 2024-05-10T04:46:53.782 INFO:teuthology.orchestra.run.smithi129.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-05-10T04:46:53.782 INFO:teuthology.orchestra.run.smithi129.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-05-10T04:46:53.782 INFO:teuthology.orchestra.run.smithi129.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-05-10T04:46:53.782 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:46:53.782 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:46:53.782 INFO:teuthology.orchestra.run.smithi129.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-05-10T04:46:53.783 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-05-10T04:46:53.783 INFO:teuthology.orchestra.run.smithi129.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-05-10T04:46:53.783 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-05-10T04:46:53.783 INFO:teuthology.orchestra.run.smithi129.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-05-10T04:46:53.783 INFO:teuthology.orchestra.run.smithi129.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-05-10T04:46:53.783 INFO:teuthology.orchestra.run.smithi129.stdout: xfsdump x86_64 3.1.8-7.el8 baseos 334 k 2024-05-10T04:46:53.783 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T04:46:53.784 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T04:46:53.785 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-05-10T04:46:53.786 INFO:teuthology.orchestra.run.smithi129.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T04:46:53.787 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-05-10T04:46:53.788 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T04:46:53.789 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T04:46:53.790 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2024-05-10T04:46:53.791 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout:Enabling module streams: 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql 10 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================================ 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout:Install 129 Packages 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 24 Packages 2024-05-10T04:46:53.792 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:46:53.793 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 227 M 2024-05-10T04:46:53.793 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-05-10T04:46:53.923 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:46:53.923 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:46:53.933 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-05-10T04:46:53.934 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-05-10T04:46:53.934 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-05-10T04:46:53.935 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T04:46:53.937 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T04:46:53.939 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T04:46:53.940 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T04:46:54.021 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-10T04:46:54.045 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-05-10T04:46:54.045 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T04:46:54.046 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:46:54.047 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-05-10T04:46:54.048 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: acl x86_64 2.2.53-3.el8 baseos 83 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: libacl x86_64 2.2.53-3.el8 baseos 35 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-devel x86_64 2.2.53-3.el8 baseos 85 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-05-10T04:46:54.049 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump x86_64 3.1.8-7.el8 baseos 334 k 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-05-10T04:46:54.050 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:46:54.051 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T04:46:54.052 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T04:46:54.053 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-05-10T04:46:54.054 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T04:46:54.055 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T04:46:54.056 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling module streams: 2024-05-10T04:46:54.057 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql 10 2024-05-10T04:46:54.058 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:46:54.058 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-10T04:46:54.058 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-05-10T04:46:54.058 INFO:teuthology.orchestra.run.smithi082.stdout:Install 129 Packages 2024-05-10T04:46:54.058 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 24 Packages 2024-05-10T04:46:54.058 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:46:54.058 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 227 M 2024-05-10T04:46:54.059 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-05-10T04:46:54.815 INFO:teuthology.orchestra.run.smithi129.stdout:(1/153): ceph-18.2.2-1330.g50174015.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2024-05-10T04:46:54.945 INFO:teuthology.orchestra.run.smithi082.stdout:(1/153): ceph-18.2.2-1330.g50174015.el8.x86_64. 54 kB/s | 6.4 kB 00:00 2024-05-10T04:46:55.056 INFO:teuthology.orchestra.run.smithi129.stdout:(2/153): ceph-fuse-18.2.2-1330.g50174015.el8.x8 3.4 MB/s | 829 kB 00:00 2024-05-10T04:46:55.110 INFO:teuthology.orchestra.run.smithi129.stdout:(3/153): ceph-immutable-object-cache-18.2.2-133 3.1 MB/s | 157 kB 00:00 2024-05-10T04:46:55.170 INFO:teuthology.orchestra.run.smithi082.stdout:(2/153): ceph-fuse-18.2.2-1330.g50174015.el8.x8 3.6 MB/s | 829 kB 00:00 2024-05-10T04:46:55.254 INFO:teuthology.orchestra.run.smithi082.stdout:(3/153): ceph-immutable-object-cache-18.2.2-133 1.8 MB/s | 157 kB 00:00 2024-05-10T04:46:55.507 INFO:teuthology.orchestra.run.smithi129.stdout:(4/153): ceph-mds-18.2.2-1330.g50174015.el8.x86 5.4 MB/s | 2.2 MB 00:00 2024-05-10T04:46:55.771 INFO:teuthology.orchestra.run.smithi082.stdout:(4/153): ceph-mds-18.2.2-1330.g50174015.el8.x86 4.2 MB/s | 2.2 MB 00:00 2024-05-10T04:46:55.816 INFO:teuthology.orchestra.run.smithi129.stdout:(5/153): ceph-mgr-18.2.2-1330.g50174015.el8.x86 4.9 MB/s | 1.5 MB 00:00 2024-05-10T04:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout:(5/153): ceph-base-18.2.2-1330.g50174015.el8.x8 4.9 MB/s | 5.7 MB 00:01 2024-05-10T04:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout:(6/153): ceph-mgr-18.2.2-1330.g50174015.el8.x86 4.1 MB/s | 1.5 MB 00:00 2024-05-10T04:46:56.583 INFO:teuthology.orchestra.run.smithi129.stdout:(6/153): ceph-base-18.2.2-1330.g50174015.el8.x8 3.0 MB/s | 5.7 MB 00:01 2024-05-10T04:46:56.833 INFO:teuthology.orchestra.run.smithi129.stdout:(7/153): ceph-mon-18.2.2-1330.g50174015.el8.x86 5.0 MB/s | 5.1 MB 00:01 2024-05-10T04:46:56.839 INFO:teuthology.orchestra.run.smithi082.stdout:(7/153): ceph-mon-18.2.2-1330.g50174015.el8.x86 6.0 MB/s | 5.1 MB 00:00 2024-05-10T04:46:59.289 INFO:teuthology.orchestra.run.smithi082.stdout:(8/153): ceph-common-18.2.2-1330.g50174015.el8. 5.2 MB/s | 23 MB 00:04 2024-05-10T04:46:59.505 INFO:teuthology.orchestra.run.smithi082.stdout:(9/153): ceph-osd-18.2.2-1330.g50174015.el8.x86 5.6 MB/s | 19 MB 00:03 2024-05-10T04:46:59.522 INFO:teuthology.orchestra.run.smithi082.stdout:(10/153): ceph-selinux-18.2.2-1330.g50174015.el 104 kB/s | 24 kB 00:00 2024-05-10T04:46:59.747 INFO:teuthology.orchestra.run.smithi082.stdout:(11/153): ceph-radosgw-18.2.2-1330.g50174015.el 5.0 MB/s | 14 MB 00:02 2024-05-10T04:46:59.764 INFO:teuthology.orchestra.run.smithi082.stdout:(12/153): cephfs-mirror-18.2.2-1330.g50174015.e 1.0 MB/s | 246 kB 00:00 2024-05-10T04:46:59.831 INFO:teuthology.orchestra.run.smithi082.stdout:(13/153): libcephfs-devel-18.2.2-1330.g50174015 371 kB/s | 31 kB 00:00 2024-05-10T04:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:(14/153): libcephsqlite-18.2.2-1330.g50174015.e 1.6 MB/s | 139 kB 00:00 2024-05-10T04:46:59.948 INFO:teuthology.orchestra.run.smithi082.stdout:(15/153): libcephfs2-18.2.2-1330.g50174015.el8. 4.0 MB/s | 756 kB 00:00 2024-05-10T04:46:59.965 INFO:teuthology.orchestra.run.smithi082.stdout:(16/153): librados-devel-18.2.2-1330.g50174015. 2.7 MB/s | 139 kB 00:00 2024-05-10T04:47:00.008 INFO:teuthology.orchestra.run.smithi129.stdout:(8/153): ceph-radosgw-18.2.2-1330.g50174015.el8 4.6 MB/s | 14 MB 00:03 2024-05-10T04:47:00.066 INFO:teuthology.orchestra.run.smithi082.stdout:(17/153): libradosstriper1-18.2.2-1330.g5017401 3.9 MB/s | 461 kB 00:00 2024-05-10T04:47:00.100 INFO:teuthology.orchestra.run.smithi129.stdout:(9/153): ceph-selinux-18.2.2-1330.g50174015.el8 267 kB/s | 24 kB 00:00 2024-05-10T04:47:00.141 INFO:teuthology.orchestra.run.smithi082.stdout:(18/153): python3-ceph-argparse-18.2.2-1330.g50 596 kB/s | 45 kB 00:00 2024-05-10T04:47:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:(19/153): python3-ceph-common-18.2.2-1330.g5017 1.3 MB/s | 129 kB 00:00 2024-05-10T04:47:00.333 INFO:teuthology.orchestra.run.smithi082.stdout:(20/153): python3-cephfs-18.2.2-1330.g50174015. 2.1 MB/s | 197 kB 00:00 2024-05-10T04:47:00.467 INFO:teuthology.orchestra.run.smithi082.stdout:(21/153): python3-rados-18.2.2-1330.g50174015.e 2.7 MB/s | 371 kB 00:00 2024-05-10T04:47:00.473 INFO:teuthology.orchestra.run.smithi129.stdout:(10/153): ceph-osd-18.2.2-1330.g50174015.el8.x8 4.8 MB/s | 19 MB 00:03 2024-05-10T04:47:00.592 INFO:teuthology.orchestra.run.smithi082.stdout:(22/153): python3-rbd-18.2.2-1330.g50174015.el8 2.9 MB/s | 364 kB 00:00 2024-05-10T04:47:00.659 INFO:teuthology.orchestra.run.smithi082.stdout:(23/153): python3-rgw-18.2.2-1330.g50174015.el8 1.6 MB/s | 107 kB 00:00 2024-05-10T04:47:00.717 INFO:teuthology.orchestra.run.smithi129.stdout:(11/153): ceph-common-18.2.2-1330.g50174015.el8 3.8 MB/s | 23 MB 00:06 2024-05-10T04:47:00.726 INFO:teuthology.orchestra.run.smithi082.stdout:(24/153): rbd-fuse-18.2.2-1330.g50174015.el8.x8 1.3 MB/s | 91 kB 00:00 2024-05-10T04:47:00.751 INFO:teuthology.orchestra.run.smithi129.stdout:(12/153): cephfs-mirror-18.2.2-1330.g50174015.e 889 kB/s | 246 kB 00:00 2024-05-10T04:47:00.784 INFO:teuthology.orchestra.run.smithi129.stdout:(13/153): libcephfs-devel-18.2.2-1330.g50174015 464 kB/s | 31 kB 00:00 2024-05-10T04:47:00.826 INFO:teuthology.orchestra.run.smithi082.stdout:(25/153): librgw2-18.2.2-1330.g50174015.el8.x86 8.4 MB/s | 7.2 MB 00:00 2024-05-10T04:47:00.860 INFO:teuthology.orchestra.run.smithi129.stdout:(14/153): libcephsqlite-18.2.2-1330.g50174015.e 1.8 MB/s | 139 kB 00:00 2024-05-10T04:47:00.910 INFO:teuthology.orchestra.run.smithi082.stdout:(26/153): rbd-nbd-18.2.2-1330.g50174015.el8.x86 2.1 MB/s | 179 kB 00:00 2024-05-10T04:47:00.951 INFO:teuthology.orchestra.run.smithi129.stdout:(15/153): libcephfs2-18.2.2-1330.g50174015.el8. 3.7 MB/s | 756 kB 00:00 2024-05-10T04:47:00.977 INFO:teuthology.orchestra.run.smithi129.stdout:(16/153): librados-devel-18.2.2-1330.g50174015. 1.2 MB/s | 139 kB 00:00 2024-05-10T04:47:00.977 INFO:teuthology.orchestra.run.smithi082.stdout:(27/153): ceph-grafana-dashboards-18.2.2-1330.g 364 kB/s | 24 kB 00:00 2024-05-10T04:47:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:(28/153): ceph-mgr-cephadm-18.2.2-1330.g5017401 1.4 MB/s | 138 kB 00:00 2024-05-10T04:47:01.111 INFO:teuthology.orchestra.run.smithi129.stdout:(17/153): libradosstriper1-18.2.2-1330.g5017401 2.8 MB/s | 461 kB 00:00 2024-05-10T04:47:01.219 INFO:teuthology.orchestra.run.smithi129.stdout:(18/153): python3-ceph-argparse-18.2.2-1330.g50 413 kB/s | 45 kB 00:00 2024-05-10T04:47:01.336 INFO:teuthology.orchestra.run.smithi129.stdout:(19/153): python3-ceph-common-18.2.2-1330.g5017 1.1 MB/s | 129 kB 00:00 2024-05-10T04:47:01.344 INFO:teuthology.orchestra.run.smithi082.stdout:(29/153): rbd-mirror-18.2.2-1330.g50174015.el8. 5.4 MB/s | 3.3 MB 00:00 2024-05-10T04:47:01.420 INFO:teuthology.orchestra.run.smithi129.stdout:(20/153): python3-cephfs-18.2.2-1330.g50174015. 2.3 MB/s | 197 kB 00:00 2024-05-10T04:47:01.545 INFO:teuthology.orchestra.run.smithi129.stdout:(21/153): python3-rados-18.2.2-1330.g50174015.e 2.9 MB/s | 371 kB 00:00 2024-05-10T04:47:01.646 INFO:teuthology.orchestra.run.smithi129.stdout:(22/153): python3-rbd-18.2.2-1330.g50174015.el8 3.6 MB/s | 364 kB 00:00 2024-05-10T04:47:01.653 INFO:teuthology.orchestra.run.smithi082.stdout:(30/153): ceph-mgr-dashboard-18.2.2-1330.g50174 6.1 MB/s | 3.5 MB 00:00 2024-05-10T04:47:01.744 INFO:teuthology.orchestra.run.smithi082.stdout:(31/153): ceph-mgr-modules-core-18.2.2-1330.g50 2.6 MB/s | 246 kB 00:00 2024-05-10T04:47:01.746 INFO:teuthology.orchestra.run.smithi129.stdout:(23/153): python3-rgw-18.2.2-1330.g50174015.el8 1.0 MB/s | 107 kB 00:00 2024-05-10T04:47:01.828 INFO:teuthology.orchestra.run.smithi082.stdout:(32/153): ceph-mgr-rook-18.2.2-1330.g50174015.e 590 kB/s | 49 kB 00:00 2024-05-10T04:47:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:(24/153): rbd-fuse-18.2.2-1330.g50174015.el8.x8 916 kB/s | 91 kB 00:00 2024-05-10T04:47:01.904 INFO:teuthology.orchestra.run.smithi082.stdout:(33/153): ceph-prometheus-alerts-18.2.2-1330.g5 217 kB/s | 16 kB 00:00 2024-05-10T04:47:01.979 INFO:teuthology.orchestra.run.smithi082.stdout:(34/153): ceph-volume-18.2.2-1330.g50174015.el8 3.4 MB/s | 263 kB 00:00 2024-05-10T04:47:02.071 INFO:teuthology.orchestra.run.smithi082.stdout:(35/153): cephadm-18.2.2-1330.g50174015.el8.noa 1.8 MB/s | 173 kB 00:00 2024-05-10T04:47:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:(36/153): cephfs-top-18.2.2-1330.g50174015.el8. 218 kB/s | 18 kB 00:00 2024-05-10T04:47:02.655 INFO:teuthology.orchestra.run.smithi129.stdout:(25/153): rbd-mirror-18.2.2-1330.g50174015.el8. 4.1 MB/s | 3.3 MB 00:00 2024-05-10T04:47:02.713 INFO:teuthology.orchestra.run.smithi082.stdout:(37/153): ceph-mgr-diskprediction-local-18.2.2- 5.4 MB/s | 7.4 MB 00:01 2024-05-10T04:47:02.755 INFO:teuthology.orchestra.run.smithi129.stdout:(26/153): librgw2-18.2.2-1330.g50174015.el8.x86 4.1 MB/s | 7.2 MB 00:01 2024-05-10T04:47:02.780 INFO:teuthology.orchestra.run.smithi129.stdout:(27/153): rbd-nbd-18.2.2-1330.g50174015.el8.x86 1.4 MB/s | 179 kB 00:00 2024-05-10T04:47:02.872 INFO:teuthology.orchestra.run.smithi129.stdout:(28/153): ceph-grafana-dashboards-18.2.2-1330.g 208 kB/s | 24 kB 00:00 2024-05-10T04:47:02.898 INFO:teuthology.orchestra.run.smithi129.stdout:(29/153): ceph-mgr-cephadm-18.2.2-1330.g5017401 1.2 MB/s | 138 kB 00:00 2024-05-10T04:47:03.147 INFO:teuthology.orchestra.run.smithi082.stdout:(38/153): automake-1.16.1-8.el8.noarch.rpm 746 kB/s | 740 kB 00:00 2024-05-10T04:47:03.373 INFO:teuthology.orchestra.run.smithi082.stdout:(39/153): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2024-05-10T04:47:03.506 INFO:teuthology.orchestra.run.smithi082.stdout:(40/153): jq-1.6-8.el8.x86_64.rpm 1.5 MB/s | 203 kB 00:00 2024-05-10T04:47:03.598 INFO:teuthology.orchestra.run.smithi082.stdout:(41/153): bison-3.0.4-10.el8.x86_64.rpm 779 kB/s | 688 kB 00:00 2024-05-10T04:47:03.623 INFO:teuthology.orchestra.run.smithi082.stdout:(42/153): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2024-05-10T04:47:03.731 INFO:teuthology.orchestra.run.smithi129.stdout:(30/153): ceph-mgr-dashboard-18.2.2-1330.g50174 4.1 MB/s | 3.5 MB 00:00 2024-05-10T04:47:03.774 INFO:teuthology.orchestra.run.smithi082.stdout:(43/153): librdkafka-1.6.1-1.el8.x86_64.rpm 3.8 MB/s | 677 kB 00:00 2024-05-10T04:47:03.815 INFO:teuthology.orchestra.run.smithi082.stdout:(44/153): libtool-2.4.6-25.el8.x86_64.rpm 3.6 MB/s | 709 kB 00:00 2024-05-10T04:47:03.833 INFO:teuthology.orchestra.run.smithi129.stdout:(31/153): ceph-mgr-modules-core-18.2.2-1330.g50 2.4 MB/s | 246 kB 00:00 2024-05-10T04:47:03.899 INFO:teuthology.orchestra.run.smithi082.stdout:(45/153): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2024-05-10T04:47:03.923 INFO:teuthology.orchestra.run.smithi129.stdout:(32/153): ceph-mgr-rook-18.2.2-1330.g50174015.e 548 kB/s | 49 kB 00:00 2024-05-10T04:47:03.941 INFO:teuthology.orchestra.run.smithi082.stdout:(46/153): oniguruma-6.8.2-3.el8.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-10T04:47:04.057 INFO:teuthology.orchestra.run.smithi129.stdout:(33/153): ceph-prometheus-alerts-18.2.2-1330.g5 122 kB/s | 16 kB 00:00 2024-05-10T04:47:04.132 INFO:teuthology.orchestra.run.smithi129.stdout:(34/153): ceph-volume-18.2.2-1330.g50174015.el8 3.4 MB/s | 263 kB 00:00 2024-05-10T04:47:04.208 INFO:teuthology.orchestra.run.smithi129.stdout:(35/153): cephadm-18.2.2-1330.g50174015.el8.noa 2.2 MB/s | 173 kB 00:00 2024-05-10T04:47:04.291 INFO:teuthology.orchestra.run.smithi129.stdout:(36/153): cephfs-top-18.2.2-1330.g50174015.el8. 218 kB/s | 18 kB 00:00 2024-05-10T04:47:04.408 INFO:teuthology.orchestra.run.smithi129.stdout:(37/153): ceph-mgr-diskprediction-local-18.2.2- 4.9 MB/s | 7.4 MB 00:01 2024-05-10T04:47:04.733 INFO:teuthology.orchestra.run.smithi082.stdout:(47/153): ceph-test-18.2.2-1330.g50174015.el8.x 9.4 MB/s | 49 MB 00:05 2024-05-10T04:47:04.800 INFO:teuthology.orchestra.run.smithi082.stdout:(48/153): openblas-0.3.15-4.el8.x86_64.rpm 5.2 MB/s | 4.7 MB 00:00 2024-05-10T04:47:04.884 INFO:teuthology.orchestra.run.smithi082.stdout:(49/153): openblas-threads-0.3.15-4.el8.x86_64. 5.2 MB/s | 4.9 MB 00:00 2024-05-10T04:47:04.926 INFO:teuthology.orchestra.run.smithi082.stdout:(50/153): postgresql-contrib-10.23-2.module_el8 7.0 MB/s | 901 kB 00:00 2024-05-10T04:47:05.034 INFO:teuthology.orchestra.run.smithi129.stdout:(38/153): automake-1.16.1-8.el8.noarch.rpm 997 kB/s | 740 kB 00:00 2024-05-10T04:47:05.117 INFO:teuthology.orchestra.run.smithi129.stdout:(39/153): bison-3.0.4-10.el8.x86_64.rpm 972 kB/s | 688 kB 00:00 2024-05-10T04:47:05.142 INFO:teuthology.orchestra.run.smithi082.stdout:(51/153): postgresql-server-10.23-2.module_el8+ 20 MB/s | 5.1 MB 00:00 2024-05-10T04:47:05.159 INFO:teuthology.orchestra.run.smithi129.stdout:(40/153): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2024-05-10T04:47:05.218 INFO:teuthology.orchestra.run.smithi082.stdout:(52/153): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2024-05-10T04:47:05.234 INFO:teuthology.orchestra.run.smithi129.stdout:(41/153): jq-1.6-8.el8.x86_64.rpm 1.7 MB/s | 203 kB 00:00 2024-05-10T04:47:05.260 INFO:teuthology.orchestra.run.smithi082.stdout:(53/153): python3-jinja2-2.10.1-4.el8.noarch.rp 4.8 MB/s | 578 kB 00:00 2024-05-10T04:47:05.277 INFO:teuthology.orchestra.run.smithi129.stdout:(42/153): libpq-13.5-1.el8.x86_64.rpm 1.6 MB/s | 198 kB 00:00 2024-05-10T04:47:05.327 INFO:teuthology.orchestra.run.smithi082.stdout:(54/153): python3-jsonpatch-1.21-2.el8.noarch.r 244 kB/s | 27 kB 00:00 2024-05-10T04:47:05.369 INFO:teuthology.orchestra.run.smithi082.stdout:(55/153): python3-jsonpointer-1.10-11.el8.noarc 183 kB/s | 20 kB 00:00 2024-05-10T04:47:05.410 INFO:teuthology.orchestra.run.smithi129.stdout:(43/153): librdkafka-1.6.1-1.el8.x86_64.rpm 3.8 MB/s | 677 kB 00:00 2024-05-10T04:47:05.435 INFO:teuthology.orchestra.run.smithi082.stdout:(56/153): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2024-05-10T04:47:05.444 INFO:teuthology.orchestra.run.smithi129.stdout:(44/153): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2024-05-10T04:47:05.477 INFO:teuthology.orchestra.run.smithi082.stdout:(57/153): python3-markupsafe-0.23-19.el8.x86_64 358 kB/s | 39 kB 00:00 2024-05-10T04:47:05.536 INFO:teuthology.orchestra.run.smithi129.stdout:(45/153): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2024-05-10T04:47:05.570 INFO:teuthology.orchestra.run.smithi129.stdout:(46/153): oniguruma-6.8.2-3.el8.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-10T04:47:05.611 INFO:teuthology.orchestra.run.smithi082.stdout:(58/153): python3-numpy-1.14.3-10.el8.x86_64.rp 21 MB/s | 3.7 MB 00:00 2024-05-10T04:47:05.645 INFO:teuthology.orchestra.run.smithi082.stdout:(59/153): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.3 MB/s | 225 kB 00:00 2024-05-10T04:47:05.679 INFO:teuthology.orchestra.run.smithi082.stdout:(60/153): postgresql-10.23-2.module_el8+572+929 1.7 MB/s | 1.6 MB 00:00 2024-05-10T04:47:05.712 INFO:teuthology.orchestra.run.smithi082.stdout:(61/153): python3-prettytable-0.7.2-14.el8.noar 436 kB/s | 44 kB 00:00 2024-05-10T04:47:05.754 INFO:teuthology.orchestra.run.smithi082.stdout:(62/153): python3-pyOpenSSL-19.0.0-1.el8.noarch 949 kB/s | 103 kB 00:00 2024-05-10T04:47:05.780 INFO:teuthology.orchestra.run.smithi082.stdout:(63/153): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2024-05-10T04:47:05.822 INFO:teuthology.orchestra.run.smithi082.stdout:(64/153): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2024-05-10T04:47:05.855 INFO:teuthology.orchestra.run.smithi082.stdout:(65/153): python3-pytz-2017.2-11.el8.noarch.rpm 567 kB/s | 57 kB 00:00 2024-05-10T04:47:05.930 INFO:teuthology.orchestra.run.smithi082.stdout:(66/153): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2024-05-10T04:47:05.935 INFO:teuthology.orchestra.run.smithi129.stdout:(47/153): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2024-05-10T04:47:05.964 INFO:teuthology.orchestra.run.smithi082.stdout:(67/153): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-05-10T04:47:06.012 INFO:teuthology.orchestra.run.smithi129.stdout:(48/153): openblas-threads-0.3.15-4.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2024-05-10T04:47:06.039 INFO:teuthology.orchestra.run.smithi082.stdout:(68/153): uuid-1.6.2-43.el8.x86_64.rpm 589 kB/s | 64 kB 00:00 2024-05-10T04:47:06.073 INFO:teuthology.orchestra.run.smithi082.stdout:(69/153): xmlstarlet-1.6.1-20.el8.x86_64.rpm 651 kB/s | 71 kB 00:00 2024-05-10T04:47:06.079 INFO:teuthology.orchestra.run.smithi129.stdout:(49/153): postgresql-10.23-2.module_el8+572+929 11 MB/s | 1.6 MB 00:00 2024-05-10T04:47:06.138 INFO:teuthology.orchestra.run.smithi129.stdout:(50/153): postgresql-contrib-10.23-2.module_el8 7.0 MB/s | 901 kB 00:00 2024-05-10T04:47:06.140 INFO:teuthology.orchestra.run.smithi082.stdout:(70/153): elfutils-libelf-devel-0.190-2.el8.x86 621 kB/s | 62 kB 00:00 2024-05-10T04:47:06.182 INFO:teuthology.orchestra.run.smithi082.stdout:(71/153): fuse-2.9.7-19.el8.x86_64.rpm 766 kB/s | 83 kB 00:00 2024-05-10T04:47:06.207 INFO:teuthology.orchestra.run.smithi082.stdout:(72/153): keyutils-libs-devel-1.5.10-9.el8.x86_ 719 kB/s | 48 kB 00:00 2024-05-10T04:47:06.258 INFO:teuthology.orchestra.run.smithi082.stdout:(73/153): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2024-05-10T04:47:06.316 INFO:teuthology.orchestra.run.smithi082.stdout:(74/153): libcom_err-devel-1.45.6-5.el8.x86_64. 668 kB/s | 39 kB 00:00 2024-05-10T04:47:06.475 INFO:teuthology.orchestra.run.smithi082.stdout:(75/153): python3-scipy-1.0.0-21.module_el8+762 20 MB/s | 14 MB 00:00 2024-05-10T04:47:06.508 INFO:teuthology.orchestra.run.smithi082.stdout:(76/153): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.7 MB/s | 561 kB 00:00 2024-05-10T04:47:06.551 INFO:teuthology.orchestra.run.smithi082.stdout:(77/153): librabbitmq-0.9.0-5.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-10T04:47:06.584 INFO:teuthology.orchestra.run.smithi082.stdout:(78/153): libgfortran-8.5.0-22.el8.x86_64.rpm 2.4 MB/s | 645 kB 00:00 2024-05-10T04:47:06.618 INFO:teuthology.orchestra.run.smithi082.stdout:(79/153): libquadmath-8.5.0-22.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2024-05-10T04:47:06.643 INFO:teuthology.orchestra.run.smithi082.stdout:(80/153): libselinux-devel-2.9-8.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2024-05-10T04:47:06.668 INFO:teuthology.orchestra.run.smithi082.stdout:(81/153): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-05-10T04:47:06.693 INFO:teuthology.orchestra.run.smithi082.stdout:(82/153): libverto-devel-0.3.2-2.el8.x86_64.rpm 362 kB/s | 18 kB 00:00 2024-05-10T04:47:06.713 INFO:teuthology.orchestra.run.smithi129.stdout:(51/153): ceph-test-18.2.2-1330.g50174015.el8.x 7.4 MB/s | 49 MB 00:06 2024-05-10T04:47:06.744 INFO:teuthology.orchestra.run.smithi082.stdout:(83/153): libzstd-devel-1.4.4-1.el8.x86_64.rpm 583 kB/s | 44 kB 00:00 2024-05-10T04:47:06.769 INFO:teuthology.orchestra.run.smithi082.stdout:(84/153): libuuid-devel-2.32.1-46.el8.x86_64.rp 664 kB/s | 100 kB 00:00 2024-05-10T04:47:06.822 INFO:teuthology.orchestra.run.smithi129.stdout:(52/153): postgresql-server-10.23-2.module_el8+ 6.9 MB/s | 5.1 MB 00:00 2024-05-10T04:47:06.844 INFO:teuthology.orchestra.run.smithi082.stdout:(85/153): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2024-05-10T04:47:06.897 INFO:teuthology.orchestra.run.smithi129.stdout:(53/153): python3-babel-2.5.1-7.el8.noarch.rpm 6.3 MB/s | 4.8 MB 00:00 2024-05-10T04:47:06.912 INFO:teuthology.orchestra.run.smithi082.stdout:(86/153): pcre2-devel-10.32-3.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2024-05-10T04:47:06.930 INFO:teuthology.orchestra.run.smithi129.stdout:(54/153): python3-jsonpatch-1.21-2.el8.noarch.r 245 kB/s | 27 kB 00:00 2024-05-10T04:47:06.955 INFO:teuthology.orchestra.run.smithi082.stdout:(87/153): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2024-05-10T04:47:06.978 INFO:teuthology.orchestra.run.smithi082.stdout:(88/153): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.7 MB/s | 249 kB 00:00 2024-05-10T04:47:07.014 INFO:teuthology.orchestra.run.smithi129.stdout:(55/153): python3-jsonpointer-1.10-11.el8.noarc 170 kB/s | 20 kB 00:00 2024-05-10T04:47:07.029 INFO:teuthology.orchestra.run.smithi082.stdout:(89/153): python3-jwt-1.6.1-2.el8.noarch.rpm 850 kB/s | 43 kB 00:00 2024-05-10T04:47:07.039 INFO:teuthology.orchestra.run.smithi129.stdout:(56/153): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2024-05-10T04:47:07.062 INFO:teuthology.orchestra.run.smithi082.stdout:(90/153): python3-cryptography-3.2.1-7.el8.x86_ 5.8 MB/s | 641 kB 00:00 2024-05-10T04:47:07.121 INFO:teuthology.orchestra.run.smithi082.stdout:(91/153): openssl-devel-1.1.1k-12.el8.x86_64.rp 7.5 MB/s | 3.2 MB 00:00 2024-05-10T04:47:07.123 INFO:teuthology.orchestra.run.smithi129.stdout:(57/153): python3-markupsafe-0.23-19.el8.x86_64 359 kB/s | 39 kB 00:00 2024-05-10T04:47:07.146 INFO:teuthology.orchestra.run.smithi082.stdout:(92/153): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2024-05-10T04:47:07.172 INFO:teuthology.orchestra.run.smithi082.stdout:(93/153): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-05-10T04:47:07.197 INFO:teuthology.orchestra.run.smithi082.stdout:(94/153): python3-requests-oauthlib-1.0.0-1.el8 565 kB/s | 43 kB 00:00 2024-05-10T04:47:07.222 INFO:teuthology.orchestra.run.smithi082.stdout:(95/153): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 985 kB/s | 74 kB 00:00 2024-05-10T04:47:07.240 INFO:teuthology.orchestra.run.smithi129.stdout:(58/153): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.9 MB/s | 225 kB 00:00 2024-05-10T04:47:07.247 INFO:teuthology.orchestra.run.smithi082.stdout:(96/153): zlib-devel-1.2.11-21.el8.x86_64.rpm 770 kB/s | 58 kB 00:00 2024-05-10T04:47:07.306 INFO:teuthology.orchestra.run.smithi082.stdout:(97/153): python3-packaging-16.8-9.el8.noarch.r 443 kB/s | 48 kB 00:00 2024-05-10T04:47:07.340 INFO:teuthology.orchestra.run.smithi082.stdout:(98/153): liboath-2.6.2-3.el8.x86_64.rpm 641 kB/s | 59 kB 00:00 2024-05-10T04:47:07.349 INFO:teuthology.orchestra.run.smithi129.stdout:(59/153): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2024-05-10T04:47:07.374 INFO:teuthology.orchestra.run.smithi129.stdout:(60/153): python3-prettytable-0.7.2-14.el8.noar 328 kB/s | 44 kB 00:00 2024-05-10T04:47:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:(99/153): libunwind-1.3.1-3.el8.x86_64.rpm 599 kB/s | 75 kB 00:00 2024-05-10T04:47:07.432 INFO:teuthology.orchestra.run.smithi129.stdout:(61/153): python3-jinja2-2.10.1-4.el8.noarch.rp 804 kB/s | 578 kB 00:00 2024-05-10T04:47:07.457 INFO:teuthology.orchestra.run.smithi082.stdout:(100/153): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2024-05-10T04:47:07.458 INFO:teuthology.orchestra.run.smithi129.stdout:(62/153): python3-pyOpenSSL-19.0.0-1.el8.noarch 952 kB/s | 103 kB 00:00 2024-05-10T04:47:07.482 INFO:teuthology.orchestra.run.smithi082.stdout:(101/153): python3-bcrypt-3.1.6-2.el8.1.x86_64. 870 kB/s | 44 kB 00:00 2024-05-10T04:47:07.483 INFO:teuthology.orchestra.run.smithi129.stdout:(63/153): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2024-05-10T04:47:07.508 INFO:teuthology.orchestra.run.smithi082.stdout:(102/153): python3-asyncssh-2.7.0-2.el8.noarch. 2.8 MB/s | 476 kB 00:00 2024-05-10T04:47:07.533 INFO:teuthology.orchestra.run.smithi082.stdout:(103/153): python3-cachetools-3.1.1-4.el8.noarc 656 kB/s | 33 kB 00:00 2024-05-10T04:47:07.550 INFO:teuthology.orchestra.run.smithi082.stdout:(104/153): python3-certifi-2018.10.15-7.el8.noa 392 kB/s | 16 kB 00:00 2024-05-10T04:47:07.550 INFO:teuthology.orchestra.run.smithi129.stdout:(64/153): python3-pyasn1-modules-0.3.7-6.el8.no 940 kB/s | 110 kB 00:00 2024-05-10T04:47:07.575 INFO:teuthology.orchestra.run.smithi082.stdout:(105/153): python3-beautifulsoup4-4.6.3-2.el8.1 1.5 MB/s | 185 kB 00:00 2024-05-10T04:47:07.575 INFO:teuthology.orchestra.run.smithi129.stdout:(65/153): python3-pytz-2017.2-11.el8.noarch.rpm 488 kB/s | 57 kB 00:00 2024-05-10T04:47:07.617 INFO:teuthology.orchestra.run.smithi082.stdout:(106/153): python3-cheroot-8.5.2-1.el8.noarch.r 2.0 MB/s | 173 kB 00:00 2024-05-10T04:47:07.642 INFO:teuthology.orchestra.run.smithi082.stdout:(107/153): python3-google-auth-1.1.1-10.el8.noa 1.2 MB/s | 81 kB 00:00 2024-05-10T04:47:07.668 INFO:teuthology.orchestra.run.smithi082.stdout:(108/153): python3-jaraco-6.2-6.el8.noarch.rpm 220 kB/s | 11 kB 00:00 2024-05-10T04:47:07.693 INFO:teuthology.orchestra.run.smithi082.stdout:(109/153): python3-jaraco-functools-2.0-4.el8.n 351 kB/s | 18 kB 00:00 2024-05-10T04:47:07.701 INFO:teuthology.orchestra.run.smithi129.stdout:(66/153): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2024-05-10T04:47:07.718 INFO:teuthology.orchestra.run.smithi082.stdout:(110/153): python3-cherrypy-18.4.0-1.el8.noarch 2.2 MB/s | 384 kB 00:00 2024-05-10T04:47:07.726 INFO:teuthology.orchestra.run.smithi129.stdout:(67/153): python3-werkzeug-0.12.2-4.el8.noarch. 2.5 MB/s | 457 kB 00:00 2024-05-10T04:47:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:(111/153): python3-logutils-0.3.5-11.el8.noarch 971 kB/s | 49 kB 00:00 2024-05-10T04:47:07.769 INFO:teuthology.orchestra.run.smithi082.stdout:(112/153): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2024-05-10T04:47:07.794 INFO:teuthology.orchestra.run.smithi082.stdout:(113/153): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2024-05-10T04:47:07.810 INFO:teuthology.orchestra.run.smithi129.stdout:(68/153): uuid-1.6.2-43.el8.x86_64.rpm 590 kB/s | 64 kB 00:00 2024-05-10T04:47:07.835 INFO:teuthology.orchestra.run.smithi129.stdout:(69/153): xmlstarlet-1.6.1-20.el8.x86_64.rpm 649 kB/s | 71 kB 00:00 2024-05-10T04:47:07.836 INFO:teuthology.orchestra.run.smithi082.stdout:(114/153): python3-portend-2.6-1.el8.noarch.rpm 376 kB/s | 16 kB 00:00 2024-05-10T04:47:07.879 INFO:teuthology.orchestra.run.smithi082.stdout:(115/153): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2024-05-10T04:47:07.894 INFO:teuthology.orchestra.run.smithi129.stdout:(70/153): elfutils-libelf-devel-0.190-2.el8.x86 744 kB/s | 62 kB 00:00 2024-05-10T04:47:07.903 INFO:teuthology.orchestra.run.smithi082.stdout:(116/153): python3-repoze-lru-0.7-6.el8.noarch. 502 kB/s | 34 kB 00:00 2024-05-10T04:47:07.936 INFO:teuthology.orchestra.run.smithi129.stdout:(71/153): fuse-2.9.7-19.el8.x86_64.rpm 832 kB/s | 83 kB 00:00 2024-05-10T04:47:07.953 INFO:teuthology.orchestra.run.smithi129.stdout:(72/153): keyutils-libs-devel-1.5.10-9.el8.x86_ 827 kB/s | 48 kB 00:00 2024-05-10T04:47:07.962 INFO:teuthology.orchestra.run.smithi082.stdout:(117/153): python3-kubernetes-11.0.0-6.el8.noar 4.0 MB/s | 1.2 MB 00:00 2024-05-10T04:47:07.988 INFO:teuthology.orchestra.run.smithi082.stdout:(118/153): python3-rsa-4.9-2.el8.noarch.rpm 767 kB/s | 64 kB 00:00 2024-05-10T04:47:08.013 INFO:teuthology.orchestra.run.smithi082.stdout:(119/153): python3-routes-2.4.1-12.el8.noarch.r 1.4 MB/s | 196 kB 00:00 2024-05-10T04:47:08.038 INFO:teuthology.orchestra.run.smithi082.stdout:(120/153): python3-singledispatch-3.4.0.3-18.el 477 kB/s | 24 kB 00:00 2024-05-10T04:47:08.064 INFO:teuthology.orchestra.run.smithi082.stdout:(121/153): python3-tempora-1.14.1-5.el8.noarch. 580 kB/s | 29 kB 00:00 2024-05-10T04:47:08.089 INFO:teuthology.orchestra.run.smithi082.stdout:(122/153): python3-simplegeneric-0.8.1-17.el8.n 148 kB/s | 19 kB 00:00 2024-05-10T04:47:08.114 INFO:teuthology.orchestra.run.smithi082.stdout:(123/153): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2024-05-10T04:47:08.145 INFO:teuthology.orchestra.run.smithi129.stdout:(73/153): python3-scipy-1.0.0-21.module_el8+762 21 MB/s | 14 MB 00:00 2024-05-10T04:47:08.156 INFO:teuthology.orchestra.run.smithi082.stdout:(124/153): python3-websocket-client-0.56.0-5.el 1.5 MB/s | 61 kB 00:00 2024-05-10T04:47:08.162 INFO:teuthology.orchestra.run.smithi129.stdout:(74/153): libaio-devel-0.3.112-1.el8.x86_64.rpm 89 kB/s | 19 kB 00:00 2024-05-10T04:47:08.183 INFO:teuthology.orchestra.run.smithi082.stdout:(125/153): python3-waitress-1.4.3-1.el8.noarch. 2.1 MB/s | 255 kB 00:00 2024-05-10T04:47:08.206 INFO:teuthology.orchestra.run.smithi082.stdout:(126/153): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2024-05-10T04:47:08.220 INFO:teuthology.orchestra.run.smithi129.stdout:(75/153): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.9 MB/s | 561 kB 00:00 2024-05-10T04:47:08.232 INFO:teuthology.orchestra.run.smithi082.stdout:(127/153): python3-zc-lockfile-2.0-2.el8.noarch 457 kB/s | 23 kB 00:00 2024-05-10T04:47:08.237 INFO:teuthology.orchestra.run.smithi129.stdout:(76/153): libcom_err-devel-1.45.6-5.el8.x86_64. 424 kB/s | 39 kB 00:00 2024-05-10T04:47:08.257 INFO:teuthology.orchestra.run.smithi082.stdout:(128/153): python3-webob-1.8.5-1.el8.1.noarch.r 1.7 MB/s | 251 kB 00:00 2024-05-10T04:47:08.271 INFO:teuthology.orchestra.run.smithi129.stdout:(77/153): libquadmath-8.5.0-22.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2024-05-10T04:47:08.288 INFO:teuthology.orchestra.run.smithi129.stdout:(78/153): librabbitmq-0.9.0-5.el8.x86_64.rpm 938 kB/s | 47 kB 00:00 2024-05-10T04:47:08.321 INFO:teuthology.orchestra.run.smithi129.stdout:(79/153): libgfortran-8.5.0-22.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2024-05-10T04:47:08.347 INFO:teuthology.orchestra.run.smithi129.stdout:(80/153): libselinux-devel-2.9-8.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2024-05-10T04:47:08.372 INFO:teuthology.orchestra.run.smithi129.stdout:(81/153): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-05-10T04:47:08.397 INFO:teuthology.orchestra.run.smithi129.stdout:(82/153): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.3 MB/s | 100 kB 00:00 2024-05-10T04:47:08.422 INFO:teuthology.orchestra.run.smithi129.stdout:(83/153): libverto-devel-0.3.2-2.el8.x86_64.rpm 239 kB/s | 18 kB 00:00 2024-05-10T04:47:08.447 INFO:teuthology.orchestra.run.smithi129.stdout:(84/153): libzstd-devel-1.4.4-1.el8.x86_64.rpm 582 kB/s | 44 kB 00:00 2024-05-10T04:47:08.489 INFO:teuthology.orchestra.run.smithi129.stdout:(85/153): pcre2-utf16-10.32-3.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2024-05-10T04:47:08.540 INFO:teuthology.orchestra.run.smithi129.stdout:(86/153): pcre2-devel-10.32-3.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2024-05-10T04:47:08.582 INFO:teuthology.orchestra.run.smithi129.stdout:(87/153): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2024-05-10T04:47:08.607 INFO:teuthology.orchestra.run.smithi129.stdout:(88/153): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.6 MB/s | 249 kB 00:00 2024-05-10T04:47:08.649 INFO:teuthology.orchestra.run.smithi129.stdout:(89/153): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2024-05-10T04:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout:(129/153): thrift-0.13.0-2.el8.x86_64.rpm 3.8 MB/s | 1.7 MB 00:00 2024-05-10T04:47:08.683 INFO:teuthology.orchestra.run.smithi129.stdout:(90/153): python3-cryptography-3.2.1-7.el8.x86_ 6.2 MB/s | 641 kB 00:00 2024-05-10T04:47:08.708 INFO:teuthology.orchestra.run.smithi129.stdout:(91/153): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2024-05-10T04:47:08.733 INFO:teuthology.orchestra.run.smithi082.stdout:(130/153): librados2-18.2.2-1330.g50174015.el8. 7.1 MB/s | 3.5 MB 00:00 2024-05-10T04:47:08.775 INFO:teuthology.orchestra.run.smithi129.stdout:(92/153): openssl-devel-1.1.1k-12.el8.x86_64.rp 8.4 MB/s | 3.2 MB 00:00 2024-05-10T04:47:08.800 INFO:teuthology.orchestra.run.smithi082.stdout:(131/153): librbd1-18.2.2-1330.g50174015.el8.x8 6.5 MB/s | 3.5 MB 00:00 2024-05-10T04:47:08.800 INFO:teuthology.orchestra.run.smithi129.stdout:(93/153): python3-requests-oauthlib-1.0.0-1.el8 464 kB/s | 43 kB 00:00 2024-05-10T04:47:08.825 INFO:teuthology.orchestra.run.smithi129.stdout:(94/153): python3-pycparser-2.14-14.el8.noarch. 767 kB/s | 109 kB 00:00 2024-05-10T04:47:08.851 INFO:teuthology.orchestra.run.smithi129.stdout:(95/153): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 988 kB/s | 74 kB 00:00 2024-05-10T04:47:08.876 INFO:teuthology.orchestra.run.smithi129.stdout:(96/153): zlib-devel-1.2.11-21.el8.x86_64.rpm 770 kB/s | 58 kB 00:00 2024-05-10T04:47:08.909 INFO:teuthology.orchestra.run.smithi082.stdout:(132/153): NetworkManager-team-1.40.16-15.el8.x 1.5 MB/s | 161 kB 00:00 2024-05-10T04:47:08.935 INFO:teuthology.orchestra.run.smithi129.stdout:(97/153): python3-packaging-16.8-9.el8.noarch.r 442 kB/s | 48 kB 00:00 2024-05-10T04:47:08.976 INFO:teuthology.orchestra.run.smithi082.stdout:(133/153): NetworkManager-tui-1.40.16-15.el8.x8 5.2 MB/s | 356 kB 00:00 2024-05-10T04:47:08.985 INFO:teuthology.orchestra.run.smithi129.stdout:(98/153): liboath-2.6.2-3.el8.x86_64.rpm 539 kB/s | 59 kB 00:00 2024-05-10T04:47:09.050 INFO:teuthology.orchestra.run.smithi082.stdout:(134/153): NetworkManager-libnm-1.40.16-15.el8. 6.0 MB/s | 1.9 MB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(99/153): libunwind-1.3.1-3.el8.x86_64.rpm 527 kB/s | 75 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(100/153): gperftools-libs-2.7-9.el8.x86_64.rpm 600 kB/s | 306 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(101/153): python3-bcrypt-3.1.6-2.el8.1.x86_64. 131 kB/s | 44 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(102/153): python3-asyncssh-2.7.0-2.el8.noarch. 1.0 MB/s | 476 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(103/153): python3-beautifulsoup4-4.6.3-2.el8.1 1.7 MB/s | 185 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(104/153): python3-cachetools-3.1.1-4.el8.noarc 395 kB/s | 33 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(105/153): python3-certifi-2018.10.15-7.el8.noa 195 kB/s | 16 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(106/153): python3-cheroot-8.5.2-1.el8.noarch.r 1.7 MB/s | 173 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(107/153): python3-google-auth-1.1.1-10.el8.noa 1.1 MB/s | 81 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(108/153): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2024-05-10T04:47:09.652 INFO:teuthology.orchestra.run.smithi129.stdout:(109/153): python3-cherrypy-18.4.0-1.el8.noarch 2.5 MB/s | 384 kB 00:00 2024-05-10T04:47:09.653 INFO:teuthology.orchestra.run.smithi082.stdout:(135/153): acl-2.2.53-3.el8.x86_64.rpm 825 kB/s | 83 kB 00:00 2024-05-10T04:47:09.653 INFO:teuthology.orchestra.run.smithi082.stdout:(136/153): NetworkManager-1.40.16-15.el8.x86_64 4.9 MB/s | 2.3 MB 00:00 2024-05-10T04:47:09.653 INFO:teuthology.orchestra.run.smithi082.stdout:(137/153): elfutils-debuginfod-client-0.190-2.e 706 kB/s | 77 kB 00:00 2024-05-10T04:47:09.653 INFO:teuthology.orchestra.run.smithi082.stdout:(138/153): elfutils-libelf-0.190-2.el8.x86_64.r 2.1 MB/s | 233 kB 00:00 2024-05-10T04:47:09.653 INFO:teuthology.orchestra.run.smithi082.stdout:(139/153): elfutils-libs-0.190-2.el8.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-10T04:47:09.653 INFO:teuthology.orchestra.run.smithi082.stdout:(140/153): iproute-6.2.0-5.el8.x86_64.rpm 5.0 MB/s | 854 kB 00:00 2024-05-10T04:47:09.653 INFO:teuthology.orchestra.run.smithi082.stdout:(141/153): libacl-2.2.53-3.el8.x86_64.rpm 219 kB/s | 35 kB 00:00 2024-05-10T04:47:09.653 INFO:teuthology.orchestra.run.smithi082.stdout:(142/153): libacl-devel-2.2.53-3.el8.x86_64.rpm 597 kB/s | 85 kB 00:00 2024-05-10T04:47:09.654 INFO:teuthology.orchestra.run.smithi082.stdout:(143/153): libblkid-2.32.1-46.el8.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-10T04:47:09.654 INFO:teuthology.orchestra.run.smithi082.stdout:(144/153): libfdisk-2.32.1-46.el8.x86_64.rpm 3.3 MB/s | 254 kB 00:00 2024-05-10T04:47:09.654 INFO:teuthology.orchestra.run.smithi082.stdout:(145/153): libsmartcols-2.32.1-46.el8.x86_64.rp 3.0 MB/s | 180 kB 00:00 2024-05-10T04:47:09.654 INFO:teuthology.orchestra.run.smithi082.stdout:(146/153): libmount-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 237 kB 00:00 2024-05-10T04:47:09.654 INFO:teuthology.orchestra.run.smithi082.stdout:(147/153): libuuid-2.32.1-46.el8.x86_64.rpm 1.3 MB/s | 99 kB 00:00 2024-05-10T04:47:09.654 INFO:teuthology.orchestra.run.smithi082.stdout:(148/153): openssl-1.1.1k-12.el8.x86_64.rpm 6.2 MB/s | 738 kB 00:00 2024-05-10T04:47:09.654 INFO:teuthology.orchestra.run.smithi082.stdout:(149/153): util-linux-user-2.32.1-46.el8.x86_64 2.4 MB/s | 103 kB 00:00 2024-05-10T04:47:09.663 INFO:teuthology.orchestra.run.smithi082.stdout:(150/153): xfsdump-3.1.8-7.el8.x86_64.rpm 5.6 MB/s | 334 kB 00:00 2024-05-10T04:47:09.672 INFO:teuthology.orchestra.run.smithi129.stdout:(110/153): python3-jaraco-functools-2.0-4.el8.n 233 kB/s | 18 kB 00:00 2024-05-10T04:47:09.705 INFO:teuthology.orchestra.run.smithi082.stdout:(151/153): openssl-libs-1.1.1k-12.el8.x86_64.rp 6.3 MB/s | 1.5 MB 00:00 2024-05-10T04:47:09.731 INFO:teuthology.orchestra.run.smithi129.stdout:(111/153): python3-logutils-0.3.5-11.el8.noarch 582 kB/s | 49 kB 00:00 2024-05-10T04:47:09.756 INFO:teuthology.orchestra.run.smithi129.stdout:(112/153): python3-more-itertools-7.2.0-3.el8.n 703 kB/s | 59 kB 00:00 2024-05-10T04:47:09.772 INFO:teuthology.orchestra.run.smithi082.stdout:(152/153): xfsprogs-5.0.0-12.el8.x86_64.rpm 10 MB/s | 1.1 MB 00:00 2024-05-10T04:47:09.818 INFO:teuthology.orchestra.run.smithi129.stdout:(113/153): python3-kubernetes-11.0.0-6.el8.noar 6.0 MB/s | 1.2 MB 00:00 2024-05-10T04:47:09.830 INFO:teuthology.orchestra.run.smithi082.stdout:(153/153): util-linux-2.32.1-46.el8.x86_64.rpm 7.8 MB/s | 2.6 MB 00:00 2024-05-10T04:47:09.833 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:47:09.833 INFO:teuthology.orchestra.run.smithi082.stdout:Total 14 MB/s | 227 MB 00:15 2024-05-10T04:47:09.848 INFO:teuthology.orchestra.run.smithi129.stdout:(114/153): python3-natsort-7.1.1-2.el8.noarch.r 516 kB/s | 60 kB 00:00 2024-05-10T04:47:09.874 INFO:teuthology.orchestra.run.smithi129.stdout:(115/153): python3-portend-2.6-1.el8.noarch.rpm 281 kB/s | 16 kB 00:00 2024-05-10T04:47:09.899 INFO:teuthology.orchestra.run.smithi129.stdout:(116/153): python3-repoze-lru-0.7-6.el8.noarch. 670 kB/s | 34 kB 00:00 2024-05-10T04:47:09.941 INFO:teuthology.orchestra.run.smithi129.stdout:(117/153): python3-routes-2.4.1-12.el8.noarch.r 2.9 MB/s | 196 kB 00:00 2024-05-10T04:47:09.966 INFO:teuthology.orchestra.run.smithi129.stdout:(118/153): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2024-05-10T04:47:09.992 INFO:teuthology.orchestra.run.smithi129.stdout:(119/153): python3-simplegeneric-0.8.1-17.el8.n 374 kB/s | 19 kB 00:00 2024-05-10T04:47:10.017 INFO:teuthology.orchestra.run.smithi129.stdout:(120/153): python3-rsa-4.9-2.el8.noarch.rpm 547 kB/s | 64 kB 00:00 2024-05-10T04:47:10.042 INFO:teuthology.orchestra.run.smithi129.stdout:(121/153): python3-singledispatch-3.4.0.3-18.el 318 kB/s | 24 kB 00:00 2024-05-10T04:47:10.068 INFO:teuthology.orchestra.run.smithi129.stdout:(122/153): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2024-05-10T04:47:10.109 INFO:teuthology.orchestra.run.smithi129.stdout:(123/153): python3-trustme-0.6.0-4.el8.noarch.r 414 kB/s | 27 kB 00:00 2024-05-10T04:47:10.135 INFO:teuthology.orchestra.run.smithi129.stdout:(124/153): python3-webob-1.8.5-1.el8.1.noarch.r 3.7 MB/s | 251 kB 00:00 2024-05-10T04:47:10.160 INFO:teuthology.orchestra.run.smithi129.stdout:(125/153): python3-waitress-1.4.3-1.el8.noarch. 2.1 MB/s | 255 kB 00:00 2024-05-10T04:47:10.186 INFO:teuthology.orchestra.run.smithi129.stdout:(126/153): python3-websocket-client-0.56.0-5.el 808 kB/s | 61 kB 00:00 2024-05-10T04:47:10.210 INFO:teuthology.orchestra.run.smithi129.stdout:(127/153): python3-zc-lockfile-2.0-2.el8.noarch 457 kB/s | 23 kB 00:00 2024-05-10T04:47:10.269 INFO:teuthology.orchestra.run.smithi129.stdout:(128/153): python3-webtest-2.0.33-1.el8.noarch. 636 kB/s | 85 kB 00:00 2024-05-10T04:47:10.561 INFO:teuthology.orchestra.run.smithi129.stdout:(129/153): librados2-18.2.2-1330.g50174015.el8. 10 MB/s | 3.5 MB 00:00 2024-05-10T04:47:10.820 INFO:teuthology.orchestra.run.smithi129.stdout:(130/153): NetworkManager-1.40.16-15.el8.x86_64 8.9 MB/s | 2.3 MB 00:00 2024-05-10T04:47:10.870 INFO:teuthology.orchestra.run.smithi129.stdout:(131/153): thrift-0.13.0-2.el8.x86_64.rpm 2.5 MB/s | 1.7 MB 00:00 2024-05-10T04:47:10.962 INFO:teuthology.orchestra.run.smithi129.stdout:(132/153): librbd1-18.2.2-1330.g50174015.el8.x8 5.1 MB/s | 3.5 MB 00:00 2024-05-10T04:47:11.004 INFO:teuthology.orchestra.run.smithi129.stdout:(133/153): NetworkManager-team-1.40.16-15.el8.x 1.2 MB/s | 161 kB 00:00 2024-05-10T04:47:11.046 INFO:teuthology.orchestra.run.smithi129.stdout:(134/153): NetworkManager-libnm-1.40.16-15.el8. 8.4 MB/s | 1.9 MB 00:00 2024-05-10T04:47:11.096 INFO:teuthology.orchestra.run.smithi129.stdout:(135/153): acl-2.2.53-3.el8.x86_64.rpm 898 kB/s | 83 kB 00:00 2024-05-10T04:47:11.122 INFO:teuthology.orchestra.run.smithi129.stdout:(136/153): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 77 kB 00:00 2024-05-10T04:47:11.147 INFO:teuthology.orchestra.run.smithi129.stdout:(137/153): NetworkManager-tui-1.40.16-15.el8.x8 1.9 MB/s | 356 kB 00:00 2024-05-10T04:47:11.172 INFO:teuthology.orchestra.run.smithi129.stdout:(138/153): elfutils-libelf-0.190-2.el8.x86_64.r 3.0 MB/s | 233 kB 00:00 2024-05-10T04:47:11.197 INFO:teuthology.orchestra.run.smithi129.stdout:(139/153): elfutils-libs-0.190-2.el8.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-05-10T04:47:11.222 INFO:teuthology.orchestra.run.smithi129.stdout:(140/153): libacl-2.2.53-3.el8.x86_64.rpm 698 kB/s | 35 kB 00:00 2024-05-10T04:47:11.249 INFO:teuthology.orchestra.run.smithi129.stdout:(141/153): libacl-devel-2.2.53-3.el8.x86_64.rpm 1.7 MB/s | 85 kB 00:00 2024-05-10T04:47:11.290 INFO:teuthology.orchestra.run.smithi129.stdout:(142/153): libblkid-2.32.1-46.el8.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-05-10T04:47:11.324 INFO:teuthology.orchestra.run.smithi129.stdout:(143/153): iproute-6.2.0-5.el8.x86_64.rpm 4.7 MB/s | 854 kB 00:00 2024-05-10T04:47:11.357 INFO:teuthology.orchestra.run.smithi129.stdout:(144/153): libfdisk-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2024-05-10T04:47:11.382 INFO:teuthology.orchestra.run.smithi129.stdout:(145/153): libmount-2.32.1-46.el8.x86_64.rpm 2.5 MB/s | 237 kB 00:00 2024-05-10T04:47:11.407 INFO:teuthology.orchestra.run.smithi129.stdout:(146/153): libsmartcols-2.32.1-46.el8.x86_64.rp 2.1 MB/s | 180 kB 00:00 2024-05-10T04:47:11.424 INFO:teuthology.orchestra.run.smithi129.stdout:(147/153): libuuid-2.32.1-46.el8.x86_64.rpm 1.5 MB/s | 99 kB 00:00 2024-05-10T04:47:11.524 INFO:teuthology.orchestra.run.smithi129.stdout:(148/153): openssl-1.1.1k-12.el8.x86_64.rpm 5.1 MB/s | 738 kB 00:00 2024-05-10T04:47:11.566 INFO:teuthology.orchestra.run.smithi129.stdout:(149/153): util-linux-user-2.32.1-46.el8.x86_64 2.4 MB/s | 103 kB 00:00 2024-05-10T04:47:11.642 INFO:teuthology.orchestra.run.smithi129.stdout:(150/153): util-linux-2.32.1-46.el8.x86_64.rpm 12 MB/s | 2.6 MB 00:00 2024-05-10T04:47:11.667 INFO:teuthology.orchestra.run.smithi129.stdout:(151/153): xfsdump-3.1.8-7.el8.x86_64.rpm 3.3 MB/s | 334 kB 00:00 2024-05-10T04:47:11.726 INFO:teuthology.orchestra.run.smithi129.stdout:(152/153): xfsprogs-5.0.0-12.el8.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-05-10T04:47:11.759 INFO:teuthology.orchestra.run.smithi129.stdout:(153/153): openssl-libs-1.1.1k-12.el8.x86_64.rp 4.2 MB/s | 1.5 MB 00:00 2024-05-10T04:47:11.762 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:47:11.762 INFO:teuthology.orchestra.run.smithi129.stdout:Total 13 MB/s | 227 MB 00:17 2024-05-10T04:47:11.825 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-05-10T04:47:12.287 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-05-10T04:47:12.287 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-05-10T04:47:13.775 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-05-10T04:47:13.919 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-05-10T04:47:13.923 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-05-10T04:47:14.240 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-05-10T04:47:14.241 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-05-10T04:47:15.867 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-05-10T04:47:15.871 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-05-10T04:47:19.805 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-05-10T04:47:20.006 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-05-10T04:47:20.225 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/177 2024-05-10T04:47:20.449 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/177 2024-05-10T04:47:20.680 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/177 2024-05-10T04:47:20.824 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/177 2024-05-10T04:47:20.929 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/177 2024-05-10T04:47:21.157 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/177 2024-05-10T04:47:21.257 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/177 2024-05-10T04:47:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/177 2024-05-10T04:47:21.662 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/177 2024-05-10T04:47:21.893 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/177 2024-05-10T04:47:22.133 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-05-10T04:47:22.144 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 8/177 2024-05-10T04:47:22.323 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/177 2024-05-10T04:47:22.336 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-05-10T04:47:22.587 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/177 2024-05-10T04:47:22.785 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/177 2024-05-10T04:47:22.829 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/177 2024-05-10T04:47:23.023 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:47:23.079 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/177 2024-05-10T04:47:23.209 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/177 2024-05-10T04:47:23.304 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/177 2024-05-10T04:47:23.479 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:47:23.542 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/177 2024-05-10T04:47:23.628 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/177 2024-05-10T04:47:23.673 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:47:23.875 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/177 2024-05-10T04:47:23.931 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:47:24.057 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/177 2024-05-10T04:47:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:47:24.284 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/177 2024-05-10T04:47:24.295 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:47:24.648 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 8/177 2024-05-10T04:47:24.658 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 13/177 2024-05-10T04:47:24.842 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/177 2024-05-10T04:47:24.946 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/177 2024-05-10T04:47:25.034 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/177 2024-05-10T04:47:25.244 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpq-13.5-1.el8.x86_64 15/177 2024-05-10T04:47:25.300 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/177 2024-05-10T04:47:25.488 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 16/177 2024-05-10T04:47:25.517 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:47:25.962 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/177 2024-05-10T04:47:25.987 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:47:26.159 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:47:26.180 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 18/177 2024-05-10T04:47:26.309 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:47:26.380 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:47:26.505 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:47:26.509 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:47:26.625 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:47:26.681 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/177 2024-05-10T04:47:26.760 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/177 2024-05-10T04:47:27.005 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 13/177 2024-05-10T04:47:27.268 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/177 2024-05-10T04:47:27.274 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libacl-2.2.53-3.el8.x86_64 21/177 2024-05-10T04:47:27.356 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/177 2024-05-10T04:47:27.488 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 22/177 2024-05-10T04:47:27.522 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libpq-13.5-1.el8.x86_64 15/177 2024-05-10T04:47:27.579 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 22/177 2024-05-10T04:47:27.775 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 16/177 2024-05-10T04:47:27.874 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:47:28.099 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:47:28.277 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/177 2024-05-10T04:47:28.538 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 18/177 2024-05-10T04:47:28.578 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:47:28.683 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:47:28.811 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:47:28.838 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 24/177 2024-05-10T04:47:29.000 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/177 2024-05-10T04:47:29.012 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 25/177 2024-05-10T04:47:29.074 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/177 2024-05-10T04:47:29.196 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 26/177 2024-05-10T04:47:29.359 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 26/177 2024-05-10T04:47:29.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 27/177 2024-05-10T04:47:29.567 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libacl-2.2.53-3.el8.x86_64 21/177 2024-05-10T04:47:29.833 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 22/177 2024-05-10T04:47:29.908 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 22/177 2024-05-10T04:47:30.211 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:47:30.217 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 27/177 2024-05-10T04:47:30.405 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.15-4.el8.x86_64 28/177 2024-05-10T04:47:30.479 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:47:30.976 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:47:31.091 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 28/177 2024-05-10T04:47:31.234 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 24/177 2024-05-10T04:47:31.254 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 29/177 2024-05-10T04:47:31.440 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 25/177 2024-05-10T04:47:31.633 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 26/177 2024-05-10T04:47:31.796 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 26/177 2024-05-10T04:47:31.991 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 27/177 2024-05-10T04:47:32.064 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 29/177 2024-05-10T04:47:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 30/177 2024-05-10T04:47:32.646 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 31/177 2024-05-10T04:47:32.652 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 27/177 2024-05-10T04:47:32.836 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 32/177 2024-05-10T04:47:32.850 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-0.3.15-4.el8.x86_64 28/177 2024-05-10T04:47:33.059 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/177 2024-05-10T04:47:33.220 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 34/177 2024-05-10T04:47:33.376 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 35/177 2024-05-10T04:47:33.530 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 28/177 2024-05-10T04:47:33.624 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 36/177 2024-05-10T04:47:33.700 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 29/177 2024-05-10T04:47:34.507 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 29/177 2024-05-10T04:47:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 37/177 2024-05-10T04:47:34.874 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 30/177 2024-05-10T04:47:35.065 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 38/177 2024-05-10T04:47:35.091 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 31/177 2024-05-10T04:47:35.314 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 32/177 2024-05-10T04:47:35.355 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 39/177 2024-05-10T04:47:35.536 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/177 2024-05-10T04:47:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/177 2024-05-10T04:47:35.731 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 34/177 2024-05-10T04:47:35.878 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 35/177 2024-05-10T04:47:36.148 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 36/177 2024-05-10T04:47:37.230 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 37/177 2024-05-10T04:47:37.596 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 38/177 2024-05-10T04:47:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/177 2024-05-10T04:47:37.917 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 39/177 2024-05-10T04:47:37.981 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 41/177 2024-05-10T04:47:38.099 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/177 2024-05-10T04:47:38.159 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/177 2024-05-10T04:47:38.392 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el8.noarch 43/177 2024-05-10T04:47:38.601 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 44/177 2024-05-10T04:47:38.795 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 45/177 2024-05-10T04:47:38.991 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 46/177 2024-05-10T04:47:39.607 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 47/177 2024-05-10T04:47:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 48/177 2024-05-10T04:47:39.885 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 48/177 2024-05-10T04:47:40.069 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 49/177 2024-05-10T04:47:40.147 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 49/177 2024-05-10T04:47:40.181 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/177 2024-05-10T04:47:40.333 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 50/177 2024-05-10T04:47:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 51/177 2024-05-10T04:47:40.553 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 41/177 2024-05-10T04:47:40.742 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 52/177 2024-05-10T04:47:40.747 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/177 2024-05-10T04:47:40.989 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rsa-4.9-2.el8.noarch 43/177 2024-05-10T04:47:41.172 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 44/177 2024-05-10T04:47:41.314 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 52/177 2024-05-10T04:47:41.391 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 45/177 2024-05-10T04:47:41.584 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 46/177 2024-05-10T04:47:41.619 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 53/177 2024-05-10T04:47:41.647 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 53/177 2024-05-10T04:47:41.816 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 47/177 2024-05-10T04:47:41.835 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 54/177 2024-05-10T04:47:42.023 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 48/177 2024-05-10T04:47:42.083 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 55/177 2024-05-10T04:47:42.118 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 48/177 2024-05-10T04:47:42.302 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 56/177 2024-05-10T04:47:42.315 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 49/177 2024-05-10T04:47:42.403 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 49/177 2024-05-10T04:47:42.457 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 57/177 2024-05-10T04:47:42.568 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 50/177 2024-05-10T04:47:42.631 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 58/177 2024-05-10T04:47:42.786 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 51/177 2024-05-10T04:47:42.822 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 59/177 2024-05-10T04:47:43.005 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 52/177 2024-05-10T04:47:43.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 60/177 2024-05-10T04:47:43.207 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 61/177 2024-05-10T04:47:43.359 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 62/177 2024-05-10T04:47:43.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 63/177 2024-05-10T04:47:43.562 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 52/177 2024-05-10T04:47:43.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 64/177 2024-05-10T04:47:43.874 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 53/177 2024-05-10T04:47:43.875 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 65/177 2024-05-10T04:47:43.902 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 53/177 2024-05-10T04:47:44.036 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-2.6-1.el8.noarch 66/177 2024-05-10T04:47:44.064 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 54/177 2024-05-10T04:47:44.205 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 67/177 2024-05-10T04:47:44.322 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 55/177 2024-05-10T04:47:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 68/177 2024-05-10T04:47:44.531 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 56/177 2024-05-10T04:47:44.690 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 69/177 2024-05-10T04:47:44.734 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 57/177 2024-05-10T04:47:44.886 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 58/177 2024-05-10T04:47:44.958 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 70/177 2024-05-10T04:47:45.079 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 59/177 2024-05-10T04:47:45.297 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 60/177 2024-05-10T04:47:45.315 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 71/177 2024-05-10T04:47:45.540 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 61/177 2024-05-10T04:47:45.553 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 72/177 2024-05-10T04:47:45.719 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 62/177 2024-05-10T04:47:45.757 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 73/177 2024-05-10T04:47:45.880 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 63/177 2024-05-10T04:47:46.080 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 64/177 2024-05-10T04:47:46.239 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 65/177 2024-05-10T04:47:46.392 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-2.6-1.el8.noarch 66/177 2024-05-10T04:47:46.577 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 67/177 2024-05-10T04:47:46.695 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 74/177 2024-05-10T04:47:46.809 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 68/177 2024-05-10T04:47:46.876 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 75/177 2024-05-10T04:47:46.972 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 75/177 2024-05-10T04:47:47.089 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 69/177 2024-05-10T04:47:47.206 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 76/177 2024-05-10T04:47:47.299 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 70/177 2024-05-10T04:47:47.438 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/177 2024-05-10T04:47:47.648 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 71/177 2024-05-10T04:47:47.677 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 78/177 2024-05-10T04:47:47.916 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 72/177 2024-05-10T04:47:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 79/177 2024-05-10T04:47:48.176 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 73/177 2024-05-10T04:47:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 80/177 2024-05-10T04:47:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 81/177 2024-05-10T04:47:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 82/177 2024-05-10T04:47:49.051 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 83/177 2024-05-10T04:47:49.128 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 74/177 2024-05-10T04:47:49.289 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 75/177 2024-05-10T04:47:49.391 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 75/177 2024-05-10T04:47:49.603 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 76/177 2024-05-10T04:47:49.849 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/177 2024-05-10T04:47:50.082 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 78/177 2024-05-10T04:47:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 84/177 2024-05-10T04:47:50.528 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 79/177 2024-05-10T04:47:50.615 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/177 2024-05-10T04:47:50.838 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 80/177 2024-05-10T04:47:50.901 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 86/177 2024-05-10T04:47:51.054 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 81/177 2024-05-10T04:47:51.127 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 87/177 2024-05-10T04:47:51.324 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 82/177 2024-05-10T04:47:51.455 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 88/177 2024-05-10T04:47:51.599 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 83/177 2024-05-10T04:47:51.728 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/177 2024-05-10T04:47:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 90/177 2024-05-10T04:47:52.213 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 91/177 2024-05-10T04:47:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 92/177 2024-05-10T04:47:52.747 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 93/177 2024-05-10T04:47:52.843 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 84/177 2024-05-10T04:47:52.919 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 94/177 2024-05-10T04:47:53.101 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 95/177 2024-05-10T04:47:53.189 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/177 2024-05-10T04:47:53.448 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 86/177 2024-05-10T04:47:53.451 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 96/177 2024-05-10T04:47:53.688 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 97/177 2024-05-10T04:47:53.717 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 87/177 2024-05-10T04:47:53.831 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 98/177 2024-05-10T04:47:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 99/177 2024-05-10T04:47:54.039 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 88/177 2024-05-10T04:47:54.260 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 100/177 2024-05-10T04:47:54.300 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/177 2024-05-10T04:47:54.485 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.7-19.el8.x86_64 101/177 2024-05-10T04:47:54.597 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 90/177 2024-05-10T04:47:54.687 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 102/177 2024-05-10T04:47:54.868 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 91/177 2024-05-10T04:47:54.891 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-43.el8.x86_64 103/177 2024-05-10T04:47:55.191 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 103/177 2024-05-10T04:47:55.253 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 92/177 2024-05-10T04:47:55.486 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 93/177 2024-05-10T04:47:55.525 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 104/177 2024-05-10T04:47:55.632 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 94/177 2024-05-10T04:47:56.111 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 95/177 2024-05-10T04:47:56.493 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 96/177 2024-05-10T04:47:56.769 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 97/177 2024-05-10T04:47:56.914 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 98/177 2024-05-10T04:47:57.109 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 99/177 2024-05-10T04:47:57.367 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 100/177 2024-05-10T04:47:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.7-19.el8.x86_64 101/177 2024-05-10T04:47:57.808 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 102/177 2024-05-10T04:47:58.029 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : uuid-1.6.2-43.el8.x86_64 103/177 2024-05-10T04:47:58.106 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 103/177 2024-05-10T04:47:58.251 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 104/177 2024-05-10T04:47:58.596 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:47:58.865 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:47:59.596 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:47:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/177 2024-05-10T04:48:00.102 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/177 2024-05-10T04:48:00.706 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/177 2024-05-10T04:48:01.375 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:48:01.638 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:48:02.353 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:48:02.674 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/177 2024-05-10T04:48:02.876 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/177 2024-05-10T04:48:03.096 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/177 2024-05-10T04:48:21.805 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/177 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /run 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2024-05-10T04:48:21.806 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:48:22.194 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/177 2024-05-10T04:48:24.047 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/177 2024-05-10T04:48:24.278 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/177 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/177 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /dev 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /run 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2024-05-10T04:48:24.285 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /dev 2024-05-10T04:48:24.286 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:48:24.539 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/177 2024-05-10T04:48:24.702 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/177 2024-05-10T04:48:24.768 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/177 2024-05-10T04:48:25.351 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/177 2024-05-10T04:48:25.585 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/177 2024-05-10T04:48:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/177 2024-05-10T04:48:25.868 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 112/177 2024-05-10T04:48:26.122 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 113/177 2024-05-10T04:48:26.309 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 114/177 2024-05-10T04:48:26.401 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 114/177 2024-05-10T04:48:26.562 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/177 2024-05-10T04:48:26.702 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-8.el8.x86_64 115/177 2024-05-10T04:48:26.788 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/177 2024-05-10T04:48:26.967 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.1-8.el8.noarch 116/177 2024-05-10T04:48:27.052 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/177 2024-05-10T04:48:27.268 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/177 2024-05-10T04:48:27.569 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 117/177 2024-05-10T04:48:27.747 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 117/177 2024-05-10T04:48:27.853 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/177 2024-05-10T04:48:27.883 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 118/177 2024-05-10T04:48:28.067 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/177 2024-05-10T04:48:28.117 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/177 2024-05-10T04:48:28.117 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 119/177 2024-05-10T04:48:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 120/177 2024-05-10T04:48:28.376 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 112/177 2024-05-10T04:48:28.605 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 113/177 2024-05-10T04:48:28.784 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 114/177 2024-05-10T04:48:28.881 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 114/177 2024-05-10T04:48:29.162 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : jq-1.6-8.el8.x86_64 115/177 2024-05-10T04:48:29.367 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : automake-1.16.1-8.el8.noarch 116/177 2024-05-10T04:48:29.533 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 120/177 2024-05-10T04:48:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 121/177 2024-05-10T04:48:30.023 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 117/177 2024-05-10T04:48:30.190 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 117/177 2024-05-10T04:48:30.292 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 118/177 2024-05-10T04:48:30.517 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 119/177 2024-05-10T04:48:30.733 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 120/177 2024-05-10T04:48:30.856 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 121/177 2024-05-10T04:48:31.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 122/177 2024-05-10T04:48:31.162 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 122/177 2024-05-10T04:48:31.560 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 123/177 2024-05-10T04:48:31.784 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 124/177 2024-05-10T04:48:31.852 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 124/177 2024-05-10T04:48:31.925 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 120/177 2024-05-10T04:48:32.049 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 125/177 2024-05-10T04:48:32.077 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 125/177 2024-05-10T04:48:32.219 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 121/177 2024-05-10T04:48:32.318 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 126/177 2024-05-10T04:48:32.566 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-25.el8.x86_64 127/177 2024-05-10T04:48:33.305 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 121/177 2024-05-10T04:48:33.525 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 122/177 2024-05-10T04:48:33.658 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 122/177 2024-05-10T04:48:34.080 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 123/177 2024-05-10T04:48:34.328 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 124/177 2024-05-10T04:48:34.397 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 124/177 2024-05-10T04:48:34.558 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 125/177 2024-05-10T04:48:34.585 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 125/177 2024-05-10T04:48:34.868 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 126/177 2024-05-10T04:48:35.099 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libtool-2.4.6-25.el8.x86_64 127/177 2024-05-10T04:48:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 127/177 2024-05-10T04:48:39.599 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 128/177 2024-05-10T04:48:39.849 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 129/177 2024-05-10T04:48:39.910 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 129/177 2024-05-10T04:48:40.156 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 130/177 2024-05-10T04:48:40.225 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 130/177 2024-05-10T04:48:40.387 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 127/177 2024-05-10T04:48:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 131/177 2024-05-10T04:48:40.870 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 131/177 2024-05-10T04:48:41.114 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:48:41.403 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:48:41.745 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 133/177 2024-05-10T04:48:42.207 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 128/177 2024-05-10T04:48:42.469 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 129/177 2024-05-10T04:48:42.535 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 129/177 2024-05-10T04:48:42.774 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 130/177 2024-05-10T04:48:42.844 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 130/177 2024-05-10T04:48:43.031 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 134/177 2024-05-10T04:48:43.049 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 131/177 2024-05-10T04:48:43.411 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 135/177 2024-05-10T04:48:43.457 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 131/177 2024-05-10T04:48:43.637 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 136/177 2024-05-10T04:48:43.724 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:48:43.844 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 137/177 2024-05-10T04:48:44.008 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:48:44.035 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 138/177 2024-05-10T04:48:44.259 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 139/177 2024-05-10T04:48:44.364 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 133/177 2024-05-10T04:48:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 140/177 2024-05-10T04:48:44.706 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 141/177 2024-05-10T04:48:45.011 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : acl-2.2.53-3.el8.x86_64 142/177 2024-05-10T04:48:45.264 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libacl-devel-2.2.53-3.el8.x86_64 143/177 2024-05-10T04:48:45.633 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 134/177 2024-05-10T04:48:45.954 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 135/177 2024-05-10T04:48:46.172 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 136/177 2024-05-10T04:48:46.379 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 137/177 2024-05-10T04:48:46.381 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:48:46.604 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 138/177 2024-05-10T04:48:46.688 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:48:46.778 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:48:46.794 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 139/177 2024-05-10T04:48:47.009 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsdump-3.1.8-7.el8.x86_64 145/177 2024-05-10T04:48:47.030 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 140/177 2024-05-10T04:48:47.233 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 141/177 2024-05-10T04:48:47.238 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 146/177 2024-05-10T04:48:47.472 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 147/177 2024-05-10T04:48:47.549 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : acl-2.2.53-3.el8.x86_64 142/177 2024-05-10T04:48:47.741 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : libacl-devel-2.2.53-3.el8.x86_64 143/177 2024-05-10T04:48:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 148/177 2024-05-10T04:48:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 149/177 2024-05-10T04:48:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 150/177 2024-05-10T04:48:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 151/177 2024-05-10T04:48:48.916 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:48:49.028 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.1-9.el8.x86_64 152/177 2024-05-10T04:48:49.139 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 152/177 2024-05-10T04:48:49.215 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:48:49.299 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:48:49.387 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.0.4-10.el8.x86_64 153/177 2024-05-10T04:48:49.414 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 153/177 2024-05-10T04:48:49.545 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : xfsdump-3.1.8-7.el8.x86_64 145/177 2024-05-10T04:48:49.572 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 154/177 2024-05-10T04:48:49.757 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 146/177 2024-05-10T04:48:50.008 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 147/177 2024-05-10T04:48:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 155/177 2024-05-10T04:48:50.352 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 156/177 2024-05-10T04:48:50.395 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 148/177 2024-05-10T04:48:50.572 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 157/177 2024-05-10T04:48:50.725 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 158/177 2024-05-10T04:48:50.725 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 159/177 2024-05-10T04:48:50.812 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 149/177 2024-05-10T04:48:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 159/177 2024-05-10T04:48:51.008 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 160/177 2024-05-10T04:48:51.074 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 150/177 2024-05-10T04:48:51.278 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 160/177 2024-05-10T04:48:51.278 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 161/177 2024-05-10T04:48:51.292 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 151/177 2024-05-10T04:48:51.549 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 161/177 2024-05-10T04:48:51.556 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : flex-2.6.1-9.el8.x86_64 152/177 2024-05-10T04:48:51.666 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 152/177 2024-05-10T04:48:51.706 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : acl-2.2.53-1.el8.x86_64 162/177 2024-05-10T04:48:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libacl-devel-2.2.53-1.el8.x86_64 163/177 2024-05-10T04:48:51.889 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : bison-3.0.4-10.el8.x86_64 153/177 2024-05-10T04:48:51.915 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 153/177 2024-05-10T04:48:52.054 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 164/177 2024-05-10T04:48:52.238 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 165/177 2024-05-10T04:48:52.417 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 154/177 2024-05-10T04:48:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 166/177 2024-05-10T04:48:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 167/177 2024-05-10T04:48:52.624 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 155/177 2024-05-10T04:48:52.723 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 167/177 2024-05-10T04:48:52.723 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 168/177 2024-05-10T04:48:52.797 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 156/177 2024-05-10T04:48:52.981 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 168/177 2024-05-10T04:48:52.982 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 169/177 2024-05-10T04:48:52.999 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 157/177 2024-05-10T04:48:53.202 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 158/177 2024-05-10T04:48:53.202 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 159/177 2024-05-10T04:48:53.205 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 169/177 2024-05-10T04:48:53.347 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 170/177 2024-05-10T04:48:53.369 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:48:53.369 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:48:53.502 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 159/177 2024-05-10T04:48:53.502 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 160/177 2024-05-10T04:48:53.729 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 160/177 2024-05-10T04:48:53.730 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 161/177 2024-05-10T04:48:53.892 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:48:53.892 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 172/177 2024-05-10T04:48:54.043 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 161/177 2024-05-10T04:48:54.147 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 172/177 2024-05-10T04:48:54.147 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:48:54.216 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : acl-2.2.53-1.el8.x86_64 162/177 2024-05-10T04:48:54.353 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libacl-devel-2.2.53-1.el8.x86_64 163/177 2024-05-10T04:48:54.397 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:48:54.397 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 174/177 2024-05-10T04:48:54.532 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 164/177 2024-05-10T04:48:54.656 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 174/177 2024-05-10T04:48:54.755 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 165/177 2024-05-10T04:48:54.846 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 175/177 2024-05-10T04:48:54.972 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libacl-2.2.53-1.el8.x86_64 176/177 2024-05-10T04:48:54.972 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 177/177 2024-05-10T04:48:54.991 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 166/177 2024-05-10T04:48:54.991 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 167/177 2024-05-10T04:48:55.250 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 167/177 2024-05-10T04:48:55.251 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 168/177 2024-05-10T04:48:55.475 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 168/177 2024-05-10T04:48:55.475 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 169/177 2024-05-10T04:48:55.721 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 169/177 2024-05-10T04:48:55.874 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 170/177 2024-05-10T04:48:55.897 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:48:55.897 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:48:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 177/177 2024-05-10T04:48:56.057 INFO:teuthology.orchestra.run.smithi082.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-10T04:48:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:48:56.438 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:48:56.438 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 172/177 2024-05-10T04:48:56.725 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 172/177 2024-05-10T04:48:56.725 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:48:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/177 2024-05-10T04:48:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/177 2024-05-10T04:48:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/177 2024-05-10T04:48:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/177 2024-05-10T04:48:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/177 2024-05-10T04:48:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-8.el8.x86_64 42/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 44/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 47/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/177 2024-05-10T04:48:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 54/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/177 2024-05-10T04:48:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 66/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 71/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 72/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 77/177 2024-05-10T04:48:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 78/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 79/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 82/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 85/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 90/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/177 2024-05-10T04:48:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 97/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 98/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 99/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 100/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 101/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 102/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 103/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 104/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 105/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 106/177 2024-05-10T04:48:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 107/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 108/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 109/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 110/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 111/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 112/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 113/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 114/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 115/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-2.6-1.el8.noarch 116/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 117/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 118/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 119/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 120/177 2024-05-10T04:48:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 121/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 122/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 123/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 124/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 125/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 126/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 127/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 128/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 129/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 130/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 134/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 135/177 2024-05-10T04:48:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 136/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 137/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 138/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 139/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 140/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 141/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : acl-2.2.53-3.el8.x86_64 142/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : acl-2.2.53-1.el8.x86_64 143/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 144/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 146/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 147/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 148/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 149/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 150/177 2024-05-10T04:48:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 151/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-2.2.53-3.el8.x86_64 152/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-2.2.53-1.el8.x86_64 153/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-devel-2.2.53-3.el8.x86_64 154/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 155/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 156/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 157/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 158/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 159/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 160/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 161/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 162/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 163/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 164/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 165/177 2024-05-10T04:48:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 166/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 167/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 168/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 169/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 170/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 171/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 172/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.8-7.el8.x86_64 174/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 175/177 2024-05-10T04:48:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 176/177 2024-05-10T04:48:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:48:57.000 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 174/177 2024-05-10T04:48:57.225 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 174/177 2024-05-10T04:48:57.448 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 175/177 2024-05-10T04:48:57.574 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : libacl-2.2.53-1.el8.x86_64 176/177 2024-05-10T04:48:57.575 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 177/177 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 177/177 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout: acl-2.2.53-3.el8.x86_64 2024-05-10T04:48:58.930 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: iproute-6.2.0-5.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-2.2.53-3.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-devel-2.2.53-3.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid-2.32.1-46.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: libmount-2.32.1-46.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-2.32.1-46.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-05-10T04:48:58.931 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-2.32.1-46.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump-3.1.8-7.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.7-19.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-8.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-05-10T04:48:58.934 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libpq-13.5-1.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-05-10T04:48:58.935 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.15-4.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T04:48:58.936 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-05-10T04:48:58.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T04:48:58.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T04:48:58.939 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T04:48:58.940 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T04:48:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:48:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T04:48:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T04:48:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T04:48:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T04:48:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T04:48:58.942 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 177/177 2024-05-10T04:48:58.942 INFO:teuthology.orchestra.run.smithi129.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-10T04:48:58.942 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:48:58.942 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-05-10T04:48:58.942 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:48:58.942 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-10T04:48:59.269 DEBUG:teuthology.parallel:result is None 2024-05-10T04:48:59.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/177 2024-05-10T04:48:59.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/177 2024-05-10T04:48:59.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/177 2024-05-10T04:48:59.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/177 2024-05-10T04:48:59.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/177 2024-05-10T04:48:59.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/177 2024-05-10T04:48:59.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/177 2024-05-10T04:48:59.705 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/177 2024-05-10T04:48:59.706 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/177 2024-05-10T04:48:59.707 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/177 2024-05-10T04:48:59.708 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : jq-1.6-8.el8.x86_64 42/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 44/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 47/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/177 2024-05-10T04:48:59.709 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 54/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/177 2024-05-10T04:48:59.710 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 66/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 71/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 72/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/177 2024-05-10T04:48:59.711 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 77/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 78/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 79/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 82/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 85/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/177 2024-05-10T04:48:59.712 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 90/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 97/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 98/177 2024-05-10T04:48:59.713 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 99/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 100/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 101/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 102/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 103/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 104/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 105/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 106/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 107/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 108/177 2024-05-10T04:48:59.714 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 109/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 110/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 111/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 112/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 113/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 114/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 115/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-2.6-1.el8.noarch 116/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 117/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 118/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 119/177 2024-05-10T04:48:59.715 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 120/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 121/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 122/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 123/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 124/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 125/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 126/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 127/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 128/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 129/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 130/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:48:59.716 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 134/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 135/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 136/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 137/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 138/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 139/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 140/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 141/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : acl-2.2.53-3.el8.x86_64 142/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : acl-2.2.53-1.el8.x86_64 143/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 144/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/177 2024-05-10T04:48:59.717 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 146/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 147/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 148/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 149/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 150/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 151/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libacl-2.2.53-3.el8.x86_64 152/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libacl-2.2.53-1.el8.x86_64 153/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libacl-devel-2.2.53-3.el8.x86_64 154/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 155/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 156/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 157/177 2024-05-10T04:48:59.718 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 158/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 159/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 160/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 161/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 162/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 163/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 164/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 165/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 166/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 167/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 168/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 169/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 170/177 2024-05-10T04:48:59.719 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 171/177 2024-05-10T04:48:59.720 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 172/177 2024-05-10T04:48:59.720 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:48:59.720 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsdump-3.1.8-7.el8.x86_64 174/177 2024-05-10T04:48:59.720 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 175/177 2024-05-10T04:48:59.720 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 176/177 2024-05-10T04:49:01.845 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 177/177 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: acl-2.2.53-3.el8.x86_64 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-05-10T04:49:01.846 INFO:teuthology.orchestra.run.smithi129.stdout: iproute-6.2.0-5.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: libacl-2.2.53-3.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: libacl-devel-2.2.53-3.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: libblkid-2.32.1-46.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: libmount-2.32.1-46.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-2.32.1-46.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-05-10T04:49:01.847 INFO:teuthology.orchestra.run.smithi129.stdout: util-linux-2.32.1-46.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: xfsdump-3.1.8-7.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.848 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.849 INFO:teuthology.orchestra.run.smithi129.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: fuse-2.9.7-19.el8.x86_64 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: jq-1.6-8.el8.x86_64 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T04:49:01.850 INFO:teuthology.orchestra.run.smithi129.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libpq-13.5-1.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.851 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-0.3.15-4.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-05-10T04:49:01.852 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.853 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T04:49:01.854 INFO:teuthology.orchestra.run.smithi129.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T04:49:01.855 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T04:49:01.856 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T04:49:01.857 INFO:teuthology.orchestra.run.smithi129.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T04:49:01.858 INFO:teuthology.orchestra.run.smithi129.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T04:49:01.858 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T04:49:01.858 INFO:teuthology.orchestra.run.smithi129.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-05-10T04:49:01.858 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:01.858 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-05-10T04:49:02.226 DEBUG:teuthology.parallel:result is None 2024-05-10T04:49:02.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:49:02.391 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T04:49:02.448 INFO:teuthology.orchestra.run.smithi082.stdout:18.2.2-1330.g50174015.el8 2024-05-10T04:49:02.448 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T04:49:02.448 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T04:49:02.450 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:49:02.602 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T04:49:02.658 INFO:teuthology.orchestra.run.smithi129.stdout:18.2.2-1330.g50174015.el8 2024-05-10T04:49:02.658 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T04:49:02.658 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T04:49:02.660 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T04:49:02.660 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:02.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T04:49:02.734 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:02.734 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T04:49:02.814 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T04:49:02.814 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:02.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T04:49:02.884 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T04:49:03.005 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:03.006 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T04:49:03.082 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T04:49:03.196 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T04:49:03.196 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:03.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T04:49:03.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T04:49:03.372 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:03.372 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T04:49:03.444 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T04:49:03.554 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T04:49:03.554 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:03.554 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T04:49:03.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T04:49:03.733 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:03.733 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T04:49:03.805 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T04:49:03.915 INFO:teuthology.run_tasks:Running task ceph... 2024-05-10T04:49:04.017 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-10T04:49:04.017 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2024-05-10T04:49:04.021 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2024-05-10T04:49:04.090 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-10T04:49:04.090 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T04:49:04.094 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T04:49:04.162 INFO:tasks.ceph:Creating extra log directories... 2024-05-10T04:49:04.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T04:49:04.166 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T04:49:04.240 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-10T04:49:04.241 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-10T04:49:04.241 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-10T04:49:04.241 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:04.241 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T04:49:04.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T04:49:04.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T04:49:04.731 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:04.732 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T04:49:04.775 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T04:49:04.987 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T04:49:05.061 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-10T04:49:05.061 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds.a'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-10T04:49:05.061 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567', 'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/cap-flush}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7700567', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds.a'], 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4933, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'sleep_before_teardown': 0, 'subset': '420/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '50174015a7e79f951b988949abe236791f52d4da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5zI8f/Vmqt9ckC5nib5M/1cLyNpw2cqzhvKg8lUYKA4QThkX+Ysxrdxo2L24xWSzgLmtxVZVBXZPG6gWT3kNs=', 'smithi129.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKL0pYv3+TY33uNxOtK5ETDayGrI2phIDOVKQ/QblVEgaDWT22RBe1itRNIptcdDM7XIp3H48NhLF40POwkpBpw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds.a'], 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cap_flush']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-10_02:33:39', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-10T04:49:05.062 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T04:49:05.066 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T04:49:05.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T04:49:05.153 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T04:49:05.222 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:05.222 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T04:49:05.267 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T04:49:05.267 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-05-10T04:49:05.353 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T04:49:05.353 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:49:05.354 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 444 Links: 1 2024-05-10T04:49:05.354 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:49:05.354 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:49:05.354 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-10 04:48:56.252710079 +0000 2024-05-10T04:49:05.354 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-10 04:45:47.717577116 +0000 2024-05-10T04:49:05.354 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-10 04:45:47.717577116 +0000 2024-05-10T04:49:05.355 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-10 04:45:47.692577577 +0000 2024-05-10T04:49:05.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T04:49:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-10T04:49:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-10T04:49:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000295464 s, 1.7 MB/s 2024-05-10T04:49:05.460 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T04:49:05.509 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-05-10T04:49:05.556 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T04:49:05.556 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:49:05.556 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 450 Links: 1 2024-05-10T04:49:05.556 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:49:05.556 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:49:05.556 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-10 04:48:56.253710060 +0000 2024-05-10T04:49:05.556 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-10 04:45:48.204568139 +0000 2024-05-10T04:49:05.557 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-10 04:45:48.204568139 +0000 2024-05-10T04:49:05.557 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-10 04:45:48.182568544 +0000 2024-05-10T04:49:05.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T04:49:05.660 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-10T04:49:05.661 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-10T04:49:05.661 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000285999 s, 1.8 MB/s 2024-05-10T04:49:05.663 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T04:49:05.711 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 456 Links: 1 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-10 04:48:56.253710060 +0000 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-10 04:45:48.713558756 +0000 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-10 04:45:48.713558756 +0000 2024-05-10T04:49:05.755 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-10 04:45:48.691559162 +0000 2024-05-10T04:49:05.756 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T04:49:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-10T04:49:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-10T04:49:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000274276 s, 1.9 MB/s 2024-05-10T04:49:05.864 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T04:49:05.912 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 462 Links: 1 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-10 04:48:56.253710060 +0000 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-10 04:45:49.222549373 +0000 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-10 04:45:49.222549373 +0000 2024-05-10T04:49:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-10 04:45:49.199549797 +0000 2024-05-10T04:49:06.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T04:49:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-10T04:49:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-10T04:49:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.00029124 s, 1.8 MB/s 2024-05-10T04:49:06.067 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T04:49:06.116 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:06.117 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:06.117 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T04:49:06.163 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T04:49:06.163 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 444 Links: 1 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-05-10 04:48:59.139141000 +0000 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-05-10 04:45:39.041516764 +0000 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-05-10 04:45:39.041516764 +0000 2024-05-10T04:49:06.252 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-05-10 04:45:39.016517299 +0000 2024-05-10T04:49:06.253 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T04:49:06.319 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-05-10T04:49:06.319 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-05-10T04:49:06.319 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000376662 s, 1.4 MB/s 2024-05-10T04:49:06.322 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T04:49:06.369 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 450 Links: 1 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-05-10 04:48:59.139141000 +0000 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-05-10 04:45:39.563505587 +0000 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-05-10 04:45:39.563505587 +0000 2024-05-10T04:49:06.415 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-05-10 04:45:39.540506079 +0000 2024-05-10T04:49:06.415 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T04:49:06.480 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-05-10T04:49:06.480 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-05-10T04:49:06.480 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000265608 s, 1.9 MB/s 2024-05-10T04:49:06.483 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T04:49:06.530 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 2024-05-10T04:49:06.575 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 456 Links: 1 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-05-10 04:48:59.139141000 +0000 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-05-10 04:45:40.063494882 +0000 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-05-10 04:45:40.063494882 +0000 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-05-10 04:45:40.040495374 +0000 2024-05-10T04:49:06.576 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T04:49:06.681 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-05-10T04:49:06.681 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-05-10T04:49:06.681 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000269797 s, 1.9 MB/s 2024-05-10T04:49:06.683 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T04:49:06.730 DEBUG:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 462 Links: 1 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2024-05-10 04:48:59.139141000 +0000 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-05-10 04:45:40.573483962 +0000 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-05-10 04:45:40.573483962 +0000 2024-05-10T04:49:06.778 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: 2024-05-10 04:45:40.550484454 +0000 2024-05-10T04:49:06.779 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T04:49:06.843 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2024-05-10T04:49:06.843 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2024-05-10T04:49:06.843 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000300224 s, 1.7 MB/s 2024-05-10T04:49:06.846 DEBUG:teuthology.orchestra.run.smithi129:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T04:49:06.892 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:06.892 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T04:49:06.892 INFO:tasks.ceph:Generating config... 2024-05-10T04:49:06.893 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-10T04:49:06.893 INFO:tasks.ceph:[client] debug client = 20 2024-05-10T04:49:06.893 INFO:tasks.ceph:[client] debug ms = 1 2024-05-10T04:49:06.893 INFO:tasks.ceph:[client] pid file = 2024-05-10T04:49:06.894 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-10T04:49:06.894 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-10T04:49:06.894 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-10T04:49:06.894 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-10T04:49:06.895 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-10T04:49:06.895 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-10T04:49:06.895 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-10T04:49:06.895 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-10T04:49:06.895 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-10T04:49:06.896 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-10T04:49:06.896 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-10T04:49:06.896 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-10T04:49:06.896 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-10T04:49:06.896 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-10T04:49:06.896 INFO:tasks.ceph:Setting up mon.a... 2024-05-10T04:49:06.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-10T04:49:07.556 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.keyring 2024-05-10T04:49:07.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-10T04:49:07.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:49:07.809 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.82'), ('mon.b', '172.21.15.129'), ('mon.c', '[v2:172.21.15.129:3301,v1:172.21.15.129:6790]')] 2024-05-10T04:49:07.809 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.82,172.21.15.129,[v2:172.21.15.129:3301,v1:172.21.15.129:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-10T04:49:07.811 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:07.811 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T04:49:07.856 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.82 --add b 172.21.15.129 --addv c '[v2:172.21.15.129:3301,v1:172.21.15.129:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:08.053 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:08.054 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: generated fsid c7bb1514-6d11-4350-825d-a52cfeee72e9 2024-05-10T04:49:08.054 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = pacific 2024-05-10T04:49:08.054 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 0 2024-05-10T04:49:08.054 INFO:teuthology.orchestra.run.smithi082.stdout:fsid c7bb1514-6d11-4350-825d-a52cfeee72e9 2024-05-10T04:49:08.054 INFO:teuthology.orchestra.run.smithi082.stdout:last_changed 2024-05-10T04:49:08.053532+0000 2024-05-10T04:49:08.054 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-05-10T04:49:08.053532+0000 2024-05-10T04:49:08.055 INFO:teuthology.orchestra.run.smithi082.stdout:min_mon_release 16 (pacific) 2024-05-10T04:49:08.055 INFO:teuthology.orchestra.run.smithi082.stdout:election_strategy: 1 2024-05-10T04:49:08.055 INFO:teuthology.orchestra.run.smithi082.stdout:0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-10T04:49:08.055 INFO:teuthology.orchestra.run.smithi082.stdout:1: [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] mon.b 2024-05-10T04:49:08.055 INFO:teuthology.orchestra.run.smithi082.stdout:2: [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] mon.c 2024-05-10T04:49:08.055 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-10T04:49:08.063 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T04:49:08.106 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c7bb1514-6d11-4350-825d-a52cfeee72e9... 2024-05-10T04:49:08.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T04:49:08.151 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T04:49:08.259 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-05-10T04:49:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-05-10T04:49:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.82,172.21.15.129,[v2:172.21.15.129:3301,v1:172.21.15.129:6790]" 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = c7bb1514-6d11-4350-825d-a52cfeee72e9 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-05-10T04:49:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: bdev async discard = True 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: bdev enable discard = True 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore allocator = bitmap 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-05-10T04:49:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-05-10T04:49:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-05-10T04:49:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-05-10T04:49:08.269 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2024-05-10T04:49:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2024-05-10T04:49:08.271 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.272 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon_allow_pool_size_one = true 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2024-05-10T04:49:08.273 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: mon health detail to clog = false 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = "172.21.15.82,172.21.15.129,[v2:172.21.15.129:3301,v1:172.21.15.129:6790]" 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on skipped message = False 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = c7bb1514-6d11-4350-825d-a52cfeee72e9 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.274 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd mclock profile = high_recovery_ops 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.275 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: bdev async discard = True 2024-05-10T04:49:08.276 INFO:teuthology.orchestra.run.smithi129.stdout: bdev enable discard = True 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore allocator = bitmap 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 1/20 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 1/20 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 20 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 4/10 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2024-05-10T04:49:08.277 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: osd op complaint time = 180 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:49:08.278 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.279 INFO:teuthology.orchestra.run.smithi129.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: # 1m isn't quite enough 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: mon_down_mkfs_grace = 2m 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_filestore_osds = false 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: mon op complaint time = 120 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2024-05-10T04:49:08.280 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: client mount timeout = 600 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: debug client = 20 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = "" 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: rados mon op timeout = 900 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout: rados osd op timeout = 900 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.b] 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.c] 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.c] 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.b] 2024-05-10T04:49:08.281 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.d] 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout:[mds] 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: debug mds = 20 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: debug mds balancer = 20 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: mds debug frag = True 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: mds debug scatterstat = True 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: mds op complaint time = 180 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: mds verify scatter = True 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: osd op complaint time = 180 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: rados mon op timeout = 900 2024-05-10T04:49:08.282 INFO:teuthology.orchestra.run.smithi129.stdout: rados osd op timeout = 900 2024-05-10T04:49:08.297 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-10T04:49:08.297 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-10T04:49:08.615 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-10T04:49:08.615 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:08.615 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-10T04:49:08.660 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:08.660 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-10T04:49:08.744 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:49:08.745 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:08.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T04:49:08.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:49:08.950 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:08.950 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:08.993 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:49:08.993 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:08.993 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T04:49:08.993 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:49:09.084 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:09.084 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:09.168 INFO:tasks.ceph:Setting up mon nodes... 2024-05-10T04:49:09.168 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-10T04:49:09.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T04:49:09.352 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T04:49:09.366 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T04:49:09.863 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T04:49:09.878 INFO:tasks.ceph:Setting up mds nodes... 2024-05-10T04:49:09.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T04:49:10.064 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T04:49:10.076 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-10T04:49:10.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T04:49:10.326 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T04:49:10.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-10T04:49:10.404 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T04:49:10.589 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T04:49:10.601 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-10T04:49:10.666 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T04:49:10.848 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T04:49:10.860 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-10T04:49:10.926 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-10T04:49:10.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T04:49:11.086 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-10T04:49:11.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-10T04:49:11.281 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-10T04:49:11.316 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-10T04:49:11.479 INFO:teuthology.orchestra.run.smithi129.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-10T04:49:11.515 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-10T04:49:11.676 INFO:teuthology.orchestra.run.smithi129.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-10T04:49:11.712 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-10T04:49:11.712 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T04:49:11.713 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-10T04:49:11.780 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:11.781 INFO:tasks.ceph:role: osd.0 2024-05-10T04:49:11.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:49:11.781 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:49:11.855 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:49:11.856 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:49:12.218 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-05-10T04:49:12.223 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-05-10T04:49:12.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-10T04:49:12.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-10T04:49:12.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-10T04:49:12.527 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:12.527 INFO:tasks.ceph:role: osd.1 2024-05-10T04:49:12.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:49:12.528 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:49:12.601 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:49:12.956 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-05-10T04:49:12.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-05-10T04:49:12.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-10T04:49:13.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-10T04:49:13.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-10T04:49:13.208 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:13.208 INFO:tasks.ceph:role: osd.2 2024-05-10T04:49:13.208 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:49:13.208 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T04:49:13.282 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:49:13.283 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:49:13.283 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:49:13.283 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:49:13.283 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:49:13.283 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:49:13.284 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:49:13.284 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:49:13.284 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:49:13.284 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:49:13.657 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-05-10T04:49:13.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-05-10T04:49:13.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-10T04:49:13.797 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-10T04:49:13.875 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-10T04:49:13.941 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:13.941 INFO:tasks.ceph:role: osd.3 2024-05-10T04:49:13.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:49:13.942 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T04:49:14.016 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:49:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:49:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:49:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:49:14.016 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:49:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:49:14.017 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:49:14.017 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:49:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:49:14.017 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:49:14.398 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-05-10T04:49:14.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-05-10T04:49:14.402 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-10T04:49:14.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-10T04:49:14.645 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:14.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:14.829+0000 7fdb934bb800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-10T04:49:14.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:14.830+0000 7fdb934bb800 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-10T04:49:14.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:14.830+0000 7fdb934bb800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:49:14.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:14.830+0000 7fdb934bb800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:49:14.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:14.830+0000 7fdb934bb800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:49:14.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:14.832+0000 7fdb934bb800 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-10T04:49:17.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-10T04:49:17.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:18.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:18.014+0000 7f745be27800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-10T04:49:18.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:18.014+0000 7f745be27800 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-10T04:49:18.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:18.014+0000 7f745be27800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:49:18.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:18.014+0000 7f745be27800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:49:18.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:18.014+0000 7f745be27800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:49:18.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:18.016+0000 7f745be27800 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-10T04:49:20.969 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-10T04:49:21.037 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:21.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:21.204+0000 7f2973b69800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-10T04:49:21.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:21.205+0000 7f2973b69800 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-10T04:49:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:21.205+0000 7f2973b69800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:49:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:21.205+0000 7f2973b69800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:49:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:21.205+0000 7f2973b69800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:49:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:21.207+0000 7f2973b69800 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-10T04:49:24.151 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-10T04:49:24.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:24.388+0000 7f59a6c9f800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-10T04:49:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:24.388+0000 7f59a6c9f800 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-10T04:49:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:24.388+0000 7f59a6c9f800 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:49:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:24.388+0000 7f59a6c9f800 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:49:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:24.388+0000 7f59a6c9f800 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:49:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:24.390+0000 7f59a6c9f800 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-10T04:49:27.317 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-10T04:49:27.385 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-10T04:49:27.460 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:27.460 INFO:tasks.ceph:role: osd.4 2024-05-10T04:49:27.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:49:27.460 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T04:49:27.535 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:49:27.536 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:49:27.901 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-05-10T04:49:27.905 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-05-10T04:49:27.906 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-10T04:49:28.078 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-10T04:49:28.157 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-10T04:49:28.223 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:28.224 INFO:tasks.ceph:role: osd.5 2024-05-10T04:49:28.224 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:49:28.224 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T04:49:28.298 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:49:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:49:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:49:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:49:28.298 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:49:28.298 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:49:28.298 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:49:28.298 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:49:28.299 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:49:28.299 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:49:28.654 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-05-10T04:49:28.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-05-10T04:49:28.659 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-10T04:49:28.778 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-10T04:49:28.854 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-10T04:49:28.921 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:28.921 INFO:tasks.ceph:role: osd.6 2024-05-10T04:49:28.921 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:49:28.922 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T04:49:28.996 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:49:28.996 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:49:28.996 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:49:28.996 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:49:28.996 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:49:28.997 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:49:28.997 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:49:28.997 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:49:28.997 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:49:28.997 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:49:29.371 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-05-10T04:49:29.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-05-10T04:49:29.376 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-10T04:49:29.500 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-10T04:49:29.573 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-10T04:49:29.640 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:49:29.640 INFO:tasks.ceph:role: osd.7 2024-05-10T04:49:29.640 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:49:29.640 DEBUG:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:49:29.714 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:49:30.095 INFO:teuthology.orchestra.run.smithi129.stdout:Discarding blocks...Done. 2024-05-10T04:49:30.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2024-05-10T04:49:30.099 DEBUG:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-10T04:49:30.268 DEBUG:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-10T04:49:30.344 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:30.528 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:30.526+0000 7fb0958b9800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-10T04:49:30.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:30.527+0000 7fb0958b9800 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-10T04:49:30.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:30.527+0000 7fb0958b9800 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:49:30.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:30.527+0000 7fb0958b9800 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:49:30.529 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:30.527+0000 7fb0958b9800 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:49:30.531 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:30.529+0000 7fb0958b9800 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-10T04:49:33.469 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-10T04:49:33.537 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:33.705 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:33.703+0000 7f8f97ebe800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-10T04:49:33.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:33.704+0000 7f8f97ebe800 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-10T04:49:33.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:33.704+0000 7f8f97ebe800 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:49:33.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:33.704+0000 7f8f97ebe800 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:49:33.706 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:33.704+0000 7f8f97ebe800 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:49:33.707 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:33.706+0000 7f8f97ebe800 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-10T04:49:35.063 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:49:35.067 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:49:36.655 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-10T04:49:36.723 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:36.891 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:36.889+0000 7f8d52db0800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-10T04:49:36.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:36.890+0000 7f8d52db0800 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-10T04:49:36.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:36.890+0000 7f8d52db0800 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:49:36.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:36.890+0000 7f8d52db0800 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:49:36.892 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:36.890+0000 7f8d52db0800 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:49:36.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:36.893+0000 7f8d52db0800 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-10T04:49:39.821 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-10T04:49:39.891 DEBUG:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:40.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:40.060+0000 7fd1ef18a800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-10T04:49:40.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:40.060+0000 7fd1ef18a800 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-10T04:49:40.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:40.060+0000 7fd1ef18a800 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:49:40.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:40.060+0000 7fd1ef18a800 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:49:40.061 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:40.060+0000 7fd1ef18a800 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:49:40.063 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:40.062+0000 7fd1ef18a800 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-10T04:49:42.988 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-10T04:49:43.059 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-10T04:49:43.059 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:43.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-10T04:49:43.133 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:43.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-10T04:49:43.202 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:43.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-10T04:49:43.309 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:43.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-10T04:49:43.416 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:43.416 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-10T04:49:43.522 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:43.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-10T04:49:43.629 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:43.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-10T04:49:43.736 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:43.736 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-10T04:49:43.809 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:43.810 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-10T04:49:43.878 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:43.878 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-10T04:49:43.985 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:43.985 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-10T04:49:44.090 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:44.091 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-10T04:49:44.198 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:44.198 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-10T04:49:44.304 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:44.304 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-10T04:49:44.410 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:44.410 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-10T04:49:44.456 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:44.456 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-10T04:49:44.542 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:44.542 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-10T04:49:44.586 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:44.586 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-10T04:49:44.670 INFO:tasks.ceph:Adding keys to all mons... 2024-05-10T04:49:44.670 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T04:49:44.674 DEBUG:teuthology.orchestra.run.smithi129:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T04:49:44.734 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2024-05-10T04:49:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBFpz1m3pgDFRAAbY3bzHLqc500AdfB5PzzIA== 2024-05-10T04:49:44.734 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-05-10T04:49:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBGpz1mDRTWAxAACk0gFXIT14HYWwVgIplu2A== 2024-05-10T04:49:44.734 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2024-05-10T04:49:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBGpz1mg/92ExAA6oh5LV1Bg5Kr3sGXOElCxA== 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBKpz1mdgKKMRAATz0iNoHijuFfo9T6Q9rSaQ== 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBOpz1mRwrrABAAeGW0y83zCm2u6qFV+1nnjQ== 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBRpz1mXhtJDBAAqBpz0VzVWsgF68GXfvF61Q== 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBUpz1mKPopFxAALRbiK8KaHX0cvDjG8KgqSg== 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBFpz1mfHN2MxAAHjG3b/dqoc3+K/QwMVIdig== 2024-05-10T04:49:44.735 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBGpz1mCpYjIxAAKSMseAs/I2sx1XpIwyZXmQ== 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBGpz1mErySMhAADOhyIMzLzTdB1LENN7T71Q== 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBapz1mgQN8HxAAzHwsLeeHnrIike0QK3cRwg== 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBdpz1maw8HKhAAcQqkEj01J93GH4ZvbalYHw== 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBgpz1maxchNRAAOpaJPQt2+qadukNtZViVKg== 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBkpz1myoqdAxAAMxlMaKOuaQ0XsA1USkFsFw== 2024-05-10T04:49:44.736 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-05-10T04:49:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBHpz1myssrBRAAH/ztxl/ZDNu0XXnOGRXu3g== 2024-05-10T04:49:44.737 INFO:teuthology.orchestra.run.smithi082.stdout:[client.2] 2024-05-10T04:49:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBHpz1mgTnGEBAA3N5mS1VUUJcTWYbRZmYJXA== 2024-05-10T04:49:44.737 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2024-05-10T04:49:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBHpz1m+DqPHBAA//s7HgavRK06cgzVvfQ+nA== 2024-05-10T04:49:44.737 INFO:teuthology.orchestra.run.smithi082.stdout:[client.3] 2024-05-10T04:49:44.737 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBHpz1mfKBQKBAAG3iThGRFufRl/Jw8O9pHjg== 2024-05-10T04:49:44.773 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr.y] 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBFpz1m3pgDFRAAbY3bzHLqc500AdfB5PzzIA== 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBGpz1mDRTWAxAACk0gFXIT14HYWwVgIplu2A== 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.c] 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBGpz1mg/92ExAA6oh5LV1Bg5Kr3sGXOElCxA== 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.0] 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBKpz1mdgKKMRAATz0iNoHijuFfo9T6Q9rSaQ== 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.1] 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBOpz1mRwrrABAAeGW0y83zCm2u6qFV+1nnjQ== 2024-05-10T04:49:44.774 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.2] 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBRpz1mXhtJDBAAqBpz0VzVWsgF68GXfvF61Q== 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.3] 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBUpz1mKPopFxAALRbiK8KaHX0cvDjG8KgqSg== 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr.x] 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBFpz1mfHN2MxAAHjG3b/dqoc3+K/QwMVIdig== 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.b] 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBGpz1mCpYjIxAAKSMseAs/I2sx1XpIwyZXmQ== 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.d] 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBGpz1mErySMhAADOhyIMzLzTdB1LENN7T71Q== 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.4] 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBapz1mgQN8HxAAzHwsLeeHnrIike0QK3cRwg== 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.5] 2024-05-10T04:49:44.775 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBdpz1maw8HKhAAcQqkEj01J93GH4ZvbalYHw== 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.6] 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBgpz1maxchNRAAOpaJPQt2+qadukNtZViVKg== 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.7] 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBkpz1myoqdAxAAMxlMaKOuaQ0XsA1USkFsFw== 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout:[client.0] 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBHpz1myssrBRAAH/ztxl/ZDNu0XXnOGRXu3g== 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout:[client.2] 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBHpz1mgTnGEBAA3N5mS1VUUJcTWYbRZmYJXA== 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout:[client.1] 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBHpz1m+DqPHBAA//s7HgavRK06cgzVvfQ+nA== 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout:[client.3] 2024-05-10T04:49:44.776 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBHpz1mfKBQKBAAG3iThGRFufRl/Jw8O9pHjg== 2024-05-10T04:49:44.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:49:44.784 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:49:44.997 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:49:45.001 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:49:45.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:49:45.186 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:49:45.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:45.371 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:45.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:45.553 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:45.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:45.734 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:45.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:45.916 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:46.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:49:46.096 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:49:46.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:49:46.277 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:49:46.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:49:46.466 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:49:46.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:46.651 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:46.832 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:46.836 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:47.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:47.019 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:47.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:47.202 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:49:47.380 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:49:47.384 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:49:47.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:49:47.568 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:49:47.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:49:47.752 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:49:47.935 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:49:47.939 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:49:48.119 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-10T04:49:48.119 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-10T04:49:48.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:49:48.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-10T04:49:48.446 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-10T04:49:48.514 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:49:48.707 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-10T04:49:48.774 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-10T04:49:48.841 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:49:49.034 DEBUG:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-10T04:49:49.101 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:49.105 DEBUG:teuthology.orchestra.run.smithi129:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:49:49.149 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-10T04:49:49.149 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-10T04:49:49.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-10T04:49:49.190 INFO:tasks.ceph.mon.a:Started 2024-05-10T04:49:49.190 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-10T04:49:49.190 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-10T04:49:49.194 INFO:tasks.ceph.mon.b:Started 2024-05-10T04:49:49.194 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-10T04:49:49.195 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-10T04:49:49.198 INFO:tasks.ceph.mon.c:Started 2024-05-10T04:49:49.199 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-10T04:49:49.199 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-10T04:49:49.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-10T04:49:49.202 INFO:tasks.ceph.mgr.y:Started 2024-05-10T04:49:49.203 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-10T04:49:49.203 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-10T04:49:49.208 INFO:tasks.ceph.mgr.x:Started 2024-05-10T04:49:49.208 INFO:tasks.ceph:Setting crush tunables to default 2024-05-10T04:49:49.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd crush tunables default 2024-05-10T04:49:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.474+0000 7f5949c00700 1 Processor -- start 2024-05-10T04:49:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.474+0000 7f5949c00700 1 -- start start 2024-05-10T04:49:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5949c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 0x7f59440cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5949c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f594406e800 0x7f594406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5949c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594415c4e0 con 0x7f594415b9c0 2024-05-10T04:49:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5949c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594415c710 con 0x7f59440b47e0 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5949c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440cf940 con 0x7f594406e800 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5942a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 0x7f59440cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5942a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 0x7f59440cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41732/0 (socket says 172.21.15.82:41732) 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5942a00700 1 -- 172.21.15.82:0/3598464454 learned_addr learned my addr 172.21.15.82:0/3598464454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f593be00700 1 --2- 172.21.15.82:0/3598464454 >> v2:172.21.15.129:3300/0 conn(0x7f594406e800 0x7f594406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5942a00700 1 -- 172.21.15.82:0/3598464454 >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 msgr2=0x7f59440cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5942a00700 1 -- 172.21.15.82:0/3598464454 >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 msgr2=0x7f59440cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5942a00700 1 --2- 172.21.15.82:0/3598464454 >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 0x7f59440cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f593be00700 1 -- 172.21.15.82:0/3598464454 >> v2:172.21.15.129:3300/0 conn(0x7f594406e800 msgr2=0x7f594406ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f593be00700 1 -- 172.21.15.82:0/3598464454 >> v2:172.21.15.129:3300/0 conn(0x7f594406e800 msgr2=0x7f594406ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f593be00700 1 --2- 172.21.15.82:0/3598464454 >> v2:172.21.15.129:3300/0 conn(0x7f594406e800 0x7f594406ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f5942a00700 1 --2- 172.21.15.82:0/3598464454 >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 0x7f59440cf400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T04:49:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.476+0000 7f593be00700 1 --2- 172.21.15.82:0/3598464454 >> v2:172.21.15.129:3300/0 conn(0x7f594406e800 0x7f594406ec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T04:49:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708882154 0 0) 0x7f594415c4e0 con 0x7f594415b9c0 2024-05-10T04:49:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59280035b0 con 0x7f594415b9c0 2024-05-10T04:49:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425198970 0 0) 0x7f59280035b0 con 0x7f594415b9c0 2024-05-10T04:49:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 >> v2:172.21.15.129:3300/0 conn(0x7f594406e800 msgr2=0x7f594406ec10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 --2- 172.21.15.82:0/3598464454 >> v2:172.21.15.129:3300/0 conn(0x7f594406e800 0x7f594406ec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 msgr2=0x7f59440cf400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 --2- 172.21.15.82:0/3598464454 >> v2:172.21.15.82:3300/0 conn(0x7f59440b47e0 0x7f59440cf400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594406f150 con 0x7f594415b9c0 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f593c0019f0 con 0x7f594415b9c0 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 >> v1:172.21.15.82:6789/0 conn(0x7f594415b9c0 legacy=0x7f594415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5928003a30 0x7f5928003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f5928004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5928005210 0x7f592800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594415c710 con 0x7f5928004850 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440cf940 con 0x7f5928005210 2024-05-10T04:49:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.666+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592800c230 con 0x7f5928003a30 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f593be00700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f5928004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f5942a00700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5928003a30 0x7f5928003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f5943400700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5928005210 0x7f592800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f593be00700 1 -- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5928003a30 msgr2=0x7f5928003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f593be00700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5928003a30 0x7f5928003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f593be00700 1 -- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5928005210 msgr2=0x7f592800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f593be00700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5928005210 0x7f592800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f593be00700 1 -- 172.21.15.82:0/3598464454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594406f150 con 0x7f5928004850 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f5943400700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5928005210 0x7f592800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.667+0000 7f5943400700 1 -- 172.21.15.82:0/3598464454 reap_dead start 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.668+0000 7f593be00700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f5928004c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f592c009890 tx=0x7f5928005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3229e5c470b0af0e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.668+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00c070 con 0x7f5928004850 2024-05-10T04:49:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.668+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c004020 con 0x7f5928004850 2024-05-10T04:49:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.668+0000 7f5942000700 1 -- 172.21.15.82:0/3598464454 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0043d0 con 0x7f5928004850 2024-05-10T04:49:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.669+0000 7f5949c00700 1 -- 172.21.15.82:0/3598464454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 msgr2=0x7f5928004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.669+0000 7f5949c00700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f5928004c60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f592c009890 tx=0x7f5928005880 comp rx=0 tx=0).stop 2024-05-10T04:49:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.669+0000 7f5949c00700 1 -- 172.21.15.82:0/3598464454 shutdown_connections 2024-05-10T04:49:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.669+0000 7f5949c00700 1 --2- 172.21.15.82:0/3598464454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f5928004c60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.669+0000 7f5949c00700 1 -- 172.21.15.82:0/3598464454 >> 172.21.15.82:0/3598464454 conn(0x7f59440b1830 msgr2=0x7f59440b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.669+0000 7f5949c00700 1 -- 172.21.15.82:0/3598464454 shutdown_connections 2024-05-10T04:49:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.669+0000 7f5949c00700 1 -- 172.21.15.82:0/3598464454 wait complete. 2024-05-10T04:49:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.673+0000 7f5949c00700 1 Processor -- start 2024-05-10T04:49:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.673+0000 7f5949c00700 1 -- start start 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5949c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f59441597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5949c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5944168bc0 0x7f594414efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5949c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f59441f43a0 0x7f5944158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5949c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59441f4ee0 con 0x7f5928004850 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5949c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944159eb0 con 0x7f59441f43a0 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5949c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594415a100 con 0x7f5944168bc0 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5942a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f59441597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5942a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f59441597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41782/0 (socket says 172.21.15.82:41782) 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5942a00700 1 -- 172.21.15.82:0/3946998695 learned_addr learned my addr 172.21.15.82:0/3946998695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f593be00700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5944168bc0 0x7f594414efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5943400700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f59441f43a0 0x7f5944158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5942a00700 1 -- 172.21.15.82:0/3946998695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5944168bc0 msgr2=0x7f594414efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5942a00700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5944168bc0 0x7f594414efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5942a00700 1 -- 172.21.15.82:0/3946998695 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f59441f43a0 msgr2=0x7f5944158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5942a00700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f59441f43a0 0x7f5944158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.675+0000 7f5942a00700 1 -- 172.21.15.82:0/3946998695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594414f500 con 0x7f5928004850 2024-05-10T04:49:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.676+0000 7f5942a00700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f59441597d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5934011930 tx=0x7f5934011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.677+0000 7f593aa00700 1 -- 172.21.15.82:0/3946998695 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400c070 con 0x7f5928004850 2024-05-10T04:49:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.677+0000 7f593aa00700 1 -- 172.21.15.82:0/3946998695 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593400f8d0 con 0x7f5928004850 2024-05-10T04:49:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.677+0000 7f593aa00700 1 -- 172.21.15.82:0/3946998695 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400fc60 con 0x7f5928004850 2024-05-10T04:49:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.677+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59441580e0 con 0x7f5928004850 2024-05-10T04:49:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.677+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59441586a0 con 0x7f5928004850 2024-05-10T04:49:49.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.677+0000 7f593aa00700 1 -- 172.21.15.82:0/3946998695 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5934015460 con 0x7f5928004850 2024-05-10T04:49:49.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.678+0000 7f593aa00700 1 -- 172.21.15.82:0/3946998695 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f593401e790 con 0x7f5928004850 2024-05-10T04:49:49.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.678+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5944074af0 con 0x7f5928004850 2024-05-10T04:49:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.684+0000 7f593aa00700 1 -- 172.21.15.82:0/3946998695 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f5934023060 con 0x7f5928004850 2024-05-10T04:49:49.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.765+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f594415ed50 con 0x7f5928004850 2024-05-10T04:49:49.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.768+0000 7f593aa00700 1 -- 172.21.15.82:0/3946998695 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f593402d090 con 0x7f5928004850 2024-05-10T04:49:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.769+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 msgr2=0x7f59441597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:49.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.769+0000 7f5949c00700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f59441597d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5934011930 tx=0x7f5934011c40 comp rx=0 tx=0).stop 2024-05-10T04:49:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.770+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 shutdown_connections 2024-05-10T04:49:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.770+0000 7f5949c00700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f59441f43a0 0x7f5944158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.770+0000 7f5949c00700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5928004850 0x7f59441597d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.770+0000 7f5949c00700 1 --2- 172.21.15.82:0/3946998695 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5944168bc0 0x7f594414efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.770+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 >> 172.21.15.82:0/3946998695 conn(0x7f59440b1830 msgr2=0x7f59440740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.770+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 shutdown_connections 2024-05-10T04:49:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:49.770+0000 7f5949c00700 1 -- 172.21.15.82:0/3946998695 wait complete. 2024-05-10T04:49:49.773 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-05-10T04:49:49.797 INFO:tasks.ceph:check_enable_crimson: False 2024-05-10T04:49:49.797 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-10T04:49:49.797 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:49.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-10T04:49:49.830 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:49.830+0000 7f16a0a85240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T04:49:49.833 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:49.832+0000 7f630fe48240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T04:49:49.863 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:49.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-10T04:49:49.985 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:49.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-10T04:49:50.046 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:50.046+0000 7f16a0a85240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T04:49:50.052 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:50.051+0000 7f630fe48240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T04:49:50.092 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:49:50.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-10T04:49:50.198 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:50.198 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-10T04:49:50.265 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:50.265 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-10T04:49:50.373 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:50.373 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-10T04:49:50.480 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:49:50.480 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-10T04:49:50.485 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:50.484+0000 7f630fe48240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T04:49:50.542 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:50.541+0000 7f16a0a85240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T04:49:50.588 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new c25e5b0c-03f8-48b2-a338-9fbf05e16b50 0 2024-05-10T04:49:50.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.892+0000 7f5597200700 1 Processor -- start 2024-05-10T04:49:50.893 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.892+0000 7f5597200700 1 -- start start 2024-05-10T04:49:50.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5597200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f559015e610 0x7f55900b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:50.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5597200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:50.895 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5597200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55900d2c00 con 0x7f5590162150 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5597200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559015ea20 con 0x7f559015e610 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5597200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5590162630 con 0x7f55900b7910 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5595200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5595200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559006c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:46936/0 (socket says 172.21.15.129:46936) 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5595200700 1 -- 172.21.15.129:0/1970614062 learned_addr learned my addr 172.21.15.129:0/1970614062 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.894+0000 7f5587e00700 1 --2- 172.21.15.129:0/1970614062 >> v2:172.21.15.82:3300/0 conn(0x7f559015e610 0x7f55900b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.895+0000 7f5595200700 1 -- 172.21.15.129:0/1970614062 >> v2:172.21.15.82:3300/0 conn(0x7f559015e610 msgr2=0x7f55900b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.895+0000 7f5595200700 1 --2- 172.21.15.129:0/1970614062 >> v2:172.21.15.82:3300/0 conn(0x7f559015e610 0x7f55900b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.895+0000 7f5595200700 1 -- 172.21.15.129:0/1970614062 >> v1:172.21.15.82:6789/0 conn(0x7f5590162150 legacy=0x7f55900cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:50.896 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.895+0000 7f5595200700 1 -- 172.21.15.129:0/1970614062 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5590162910 con 0x7f55900b7910 2024-05-10T04:49:50.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.895+0000 7f5595200700 1 --2- 172.21.15.129:0/1970614062 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559006c160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5588009e50 tx=0x7f558800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4c356959603fe0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:50.897 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.895+0000 7f558f400700 1 -- 172.21.15.129:0/1970614062 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558800e070 con 0x7f55900b7910 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.896+0000 7f558f400700 1 -- 172.21.15.129:0/1970614062 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558800b910 con 0x7f55900b7910 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.896+0000 7f558f400700 1 -- 172.21.15.129:0/1970614062 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558800bcc0 con 0x7f55900b7910 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.897+0000 7f5597200700 1 -- 172.21.15.129:0/1970614062 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 msgr2=0x7f559006c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.897+0000 7f5597200700 1 --2- 172.21.15.129:0/1970614062 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559006c160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5588009e50 tx=0x7f558800b330 comp rx=0 tx=0).stop 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.897+0000 7f5597200700 1 -- 172.21.15.129:0/1970614062 shutdown_connections 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.897+0000 7f5597200700 1 --2- 172.21.15.129:0/1970614062 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559006c160 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.897+0000 7f5597200700 1 --2- 172.21.15.129:0/1970614062 >> v2:172.21.15.82:3300/0 conn(0x7f559015e610 0x7f55900b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.897+0000 7f5597200700 1 -- 172.21.15.129:0/1970614062 >> 172.21.15.129:0/1970614062 conn(0x7f55900d3e10 msgr2=0x7f55900d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.897+0000 7f5597200700 1 -- 172.21.15.129:0/1970614062 shutdown_connections 2024-05-10T04:49:50.898 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.897+0000 7f5597200700 1 -- 172.21.15.129:0/1970614062 wait complete. 2024-05-10T04:49:50.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.900+0000 7f5597200700 1 Processor -- start 2024-05-10T04:49:50.900 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.900+0000 7f5597200700 1 -- start start 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5597200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5597200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f559015e610 0x7f559015eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5597200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5590162150 0x7f55901611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5597200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5590151a10 con 0x7f5590162150 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5597200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559015f4f0 con 0x7f559015e610 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5597200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559014fa60 con 0x7f55900b7910 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f558fe00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5587e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f559015e610 0x7f559015eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f558fe00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559014efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:46940/0 (socket says 172.21.15.129:46940) 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5587e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f559015e610 0x7f559015eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58728/0 (socket says 172.21.15.129:58728) 2024-05-10T04:49:50.903 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f558fe00700 1 -- 172.21.15.129:0/3042348678 learned_addr learned my addr 172.21.15.129:0/3042348678 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:50.904 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.902+0000 7f5595200700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5590162150 0x7f55901611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:50.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558fe00700 1 -- 172.21.15.129:0/3042348678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f559015e610 msgr2=0x7f559015eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:50.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558fe00700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f559015e610 0x7f559015eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:50.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558fe00700 1 -- 172.21.15.129:0/3042348678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5590162150 msgr2=0x7f55901611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:50.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558fe00700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5590162150 0x7f55901611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:50.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558fe00700 1 -- 172.21.15.129:0/3042348678 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588009b30 con 0x7f55900b7910 2024-05-10T04:49:50.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f5595200700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5590162150 0x7f55901611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:50.905 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f5587e00700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f559015e610 0x7f559015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558fe00700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559014efa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f558000c450 tx=0x7f558000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558cc00700 1 -- 172.21.15.129:0/3042348678 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800052d0 con 0x7f55900b7910 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558cc00700 1 -- 172.21.15.129:0/3042348678 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5580005430 con 0x7f55900b7910 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f558cc00700 1 -- 172.21.15.129:0/3042348678 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800038c0 con 0x7f55900b7910 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559014f4e0 con 0x7f55900b7910 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.903+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559015fa20 con 0x7f55900b7910 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.904+0000 7f558cc00700 1 -- 172.21.15.129:0/3042348678 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5580003d20 con 0x7f55900b7910 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.904+0000 7f558cc00700 1 -- 172.21.15.129:0/3042348678 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f558001c780 con 0x7f55900b7910 2024-05-10T04:49:50.906 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.905+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5590074af0 con 0x7f55900b7910 2024-05-10T04:49:50.908 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.908+0000 7f558cc00700 1 -- 172.21.15.129:0/3042348678 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f5580017070 con 0x7f55900b7910 2024-05-10T04:49:50.996 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:50.995+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c25e5b0c-03f8-48b2-a338-9fbf05e16b50", "id": 0} v 0) v1 -- 0x7f5590161ec0 con 0x7f55900b7910 2024-05-10T04:49:51.002 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.002+0000 7f558cc00700 1 -- 172.21.15.129:0/3042348678 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c25e5b0c-03f8-48b2-a338-9fbf05e16b50", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5580011d10 con 0x7f55900b7910 2024-05-10T04:49:51.003 INFO:teuthology.orchestra.run.smithi129.stdout:0 2024-05-10T04:49:51.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 msgr2=0x7f559014efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559014efa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f558000c450 tx=0x7f558000c760 comp rx=0 tx=0).stop 2024-05-10T04:49:51.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 shutdown_connections 2024-05-10T04:49:51.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5590162150 0x7f55901611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.004 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f55900b7910 0x7f559014efa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 --2- 172.21.15.129:0/3042348678 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f559015e610 0x7f559015eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 >> 172.21.15.129:0/3042348678 conn(0x7f55900d3e10 msgr2=0x7f55900b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:51.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 shutdown_connections 2024-05-10T04:49:51.005 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.003+0000 7f5597200700 1 -- 172.21.15.129:0/3042348678 wait complete. 2024-05-10T04:49:51.031 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new caa734a3-6c99-4088-a935-5cdfd6eb0b81 1 2024-05-10T04:49:51.077 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:51.075+0000 7f630fe48240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T04:49:51.175 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:51.174+0000 7f16a0a85240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T04:49:51.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.292+0000 7f3b07e00700 1 Processor -- start 2024-05-10T04:49:51.293 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.292+0000 7f3b07e00700 1 -- start start 2024-05-10T04:49:51.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b07e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3b00162150 0x7f3b0015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b07e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3b000cf4d0 0x7f3b000b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b07e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000b7910 0x7f3b0006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b07e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000d2c00 con 0x7f3b000cf4d0 2024-05-10T04:49:51.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b07e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b00162630 con 0x7f3b00162150 2024-05-10T04:49:51.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b07e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b00162910 con 0x7f3b000b7910 2024-05-10T04:49:51.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b05400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3b00162150 0x7f3b0015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b05e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000b7910 0x7f3b0006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b05e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000b7910 0x7f3b0006c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:46954/0 (socket says 172.21.15.129:46954) 2024-05-10T04:49:51.297 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.294+0000 7f3b05e00700 1 -- 172.21.15.129:0/3278241990 learned_addr learned my addr 172.21.15.129:0/3278241990 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:51.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b04a00700 1 --2- 172.21.15.129:0/3278241990 >> v2:172.21.15.82:3300/0 conn(0x7f3b000cf4d0 0x7f3b000b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b05400700 1 -- 172.21.15.129:0/3278241990 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000b7910 msgr2=0x7f3b0006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:51.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b05400700 1 --2- 172.21.15.129:0/3278241990 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000b7910 0x7f3b0006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b05400700 1 -- 172.21.15.129:0/3278241990 >> v2:172.21.15.82:3300/0 conn(0x7f3b000cf4d0 msgr2=0x7f3b000b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:51.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b05400700 1 --2- 172.21.15.129:0/3278241990 >> v2:172.21.15.82:3300/0 conn(0x7f3b000cf4d0 0x7f3b000b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b05400700 1 -- 172.21.15.129:0/3278241990 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b00162bf0 con 0x7f3b00162150 2024-05-10T04:49:51.299 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b04a00700 1 --2- 172.21.15.129:0/3278241990 >> v2:172.21.15.82:3300/0 conn(0x7f3b000cf4d0 0x7f3b000b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b05e00700 1 --2- 172.21.15.129:0/3278241990 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000b7910 0x7f3b0006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3b05400700 1 --2- 172.21.15.129:0/3278241990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b0015e610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009840 tx=0x7f3af4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc65e1cb98027e01 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3affe00700 1 -- 172.21.15.129:0/3278241990 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4011830 con 0x7f3b00162150 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3affe00700 1 -- 172.21.15.129:0/3278241990 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af4011990 con 0x7f3b00162150 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.295+0000 7f3affe00700 1 -- 172.21.15.129:0/3278241990 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4011d20 con 0x7f3b00162150 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 -- 172.21.15.129:0/3278241990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 msgr2=0x7f3b0015e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 --2- 172.21.15.129:0/3278241990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b0015e610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009840 tx=0x7f3af4009b50 comp rx=0 tx=0).stop 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 -- 172.21.15.129:0/3278241990 shutdown_connections 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 --2- 172.21.15.129:0/3278241990 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000b7910 0x7f3b0006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 --2- 172.21.15.129:0/3278241990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b0015e610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 --2- 172.21.15.129:0/3278241990 >> v2:172.21.15.82:3300/0 conn(0x7f3b000cf4d0 0x7f3b000b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 -- 172.21.15.129:0/3278241990 >> 172.21.15.129:0/3278241990 conn(0x7f3b000d3e10 msgr2=0x7f3b000d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 -- 172.21.15.129:0/3278241990 shutdown_connections 2024-05-10T04:49:51.300 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.296+0000 7f3b07e00700 1 -- 172.21.15.129:0/3278241990 wait complete. 2024-05-10T04:49:51.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.299+0000 7f3b07e00700 1 Processor -- start 2024-05-10T04:49:51.301 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.299+0000 7f3b07e00700 1 -- start start 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.300+0000 7f3b07e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b000b7910 0x7f3b000ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.300+0000 7f3b07e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000cf4d0 0x7f3b000cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.300+0000 7f3b07e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b001f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.300+0000 7f3b07e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000c9ce0 con 0x7f3b000b7910 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.300+0000 7f3b07e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000cb440 con 0x7f3b00162150 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.300+0000 7f3b07e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000cbf20 con 0x7f3b000cf4d0 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.300+0000 7f3b05e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b001f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b000b7910 0x7f3b000ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b001f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58754/0 (socket says 172.21.15.129:58754) 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05e00700 1 -- 172.21.15.129:0/1140708262 learned_addr learned my addr 172.21.15.129:0/1140708262 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:51.303 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b04a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000cf4d0 0x7f3b000cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05e00700 1 -- 172.21.15.129:0/1140708262 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000cf4d0 msgr2=0x7f3b000cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05e00700 1 --2- 172.21.15.129:0/1140708262 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000cf4d0 0x7f3b000cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05e00700 1 -- 172.21.15.129:0/1140708262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b000b7910 msgr2=0x7f3b000ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05e00700 1 --2- 172.21.15.129:0/1140708262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b000b7910 0x7f3b000ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05e00700 1 -- 172.21.15.129:0/1140708262 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009b30 con 0x7f3b00162150 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05400700 1 --2- 172.21.15.129:0/1140708262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b000b7910 0x7f3b000ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3b05e00700 1 --2- 172.21.15.129:0/1140708262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b001f7dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3af800eea0 tx=0x7f3af800b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.301+0000 7f3afd600700 1 -- 172.21.15.129:0/1140708262 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8018070 con 0x7f3b00162150 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.302+0000 7f3afd600700 1 -- 172.21.15.129:0/1140708262 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8003a20 con 0x7f3b00162150 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.302+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af40094a0 con 0x7f3b00162150 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.302+0000 7f3afd600700 1 -- 172.21.15.129:0/1140708262 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8010040 con 0x7f3b00162150 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.302+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000c8c30 con 0x7f3b00162150 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.302+0000 7f3afd600700 1 -- 172.21.15.129:0/1140708262 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3af800bb70 con 0x7f3b00162150 2024-05-10T04:49:51.304 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.302+0000 7f3afd600700 1 -- 172.21.15.129:0/1140708262 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3af800be20 con 0x7f3b00162150 2024-05-10T04:49:51.305 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.303+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b00074af0 con 0x7f3b00162150 2024-05-10T04:49:51.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.306+0000 7f3afd600700 1 -- 172.21.15.129:0/1140708262 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f3af8003dd0 con 0x7f3b00162150 2024-05-10T04:49:51.335 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:51.333+0000 7f630fe48240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T04:49:51.414 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.413+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "caa734a3-6c99-4088-a935-5cdfd6eb0b81", "id": 1} v 0) v1 -- 0x7f3b000b6740 con 0x7f3b00162150 2024-05-10T04:49:51.422 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.421+0000 7f3afd600700 1 -- 172.21.15.129:0/1140708262 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "caa734a3-6c99-4088-a935-5cdfd6eb0b81", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3af802c0b0 con 0x7f3b00162150 2024-05-10T04:49:51.422 INFO:teuthology.orchestra.run.smithi129.stdout:1 2024-05-10T04:49:51.423 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 msgr2=0x7f3b001f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 --2- 172.21.15.129:0/1140708262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b001f7dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3af800eea0 tx=0x7f3af800b390 comp rx=0 tx=0).stop 2024-05-10T04:49:51.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 shutdown_connections 2024-05-10T04:49:51.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 --2- 172.21.15.129:0/1140708262 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b00162150 0x7f3b001f7dd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 --2- 172.21.15.129:0/1140708262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b000b7910 0x7f3b000ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 --2- 172.21.15.129:0/1140708262 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b000cf4d0 0x7f3b000cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 >> 172.21.15.129:0/1140708262 conn(0x7f3b000d3e10 msgr2=0x7f3b000b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:51.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 shutdown_connections 2024-05-10T04:49:51.424 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.423+0000 7f3b07e00700 1 -- 172.21.15.129:0/1140708262 wait complete. 2024-05-10T04:49:51.447 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 25e45572-97fc-438e-b46b-623e1f7dcc18 2 2024-05-10T04:49:51.463 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:51.462+0000 7f16a0a85240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T04:49:51.708 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.708+0000 7fc4a9c00700 1 Processor -- start 2024-05-10T04:49:51.709 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.708+0000 7fc4a9c00700 1 -- start start 2024-05-10T04:49:51.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.709+0000 7fc4a9c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a4162150 0x7fc4a415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a9c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a40d2c00 con 0x7fc4a406c160 2024-05-10T04:49:51.710 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a9c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a4162630 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a9c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4162910 con 0x7fc4a4162150 2024-05-10T04:49:51.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a2a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a4162150 0x7fc4a415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a2a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a4162150 0x7fc4a415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:46978/0 (socket says 172.21.15.129:46978) 2024-05-10T04:49:51.711 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a2a00700 1 -- 172.21.15.129:0/579344134 learned_addr learned my addr 172.21.15.129:0/579344134 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:51.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a2a00700 1 -- 172.21.15.129:0/579344134 >> v1:172.21.15.129:6789/0 conn(0x7fc4a40cf4d0 legacy=0x7fc4a40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a2a00700 1 -- 172.21.15.129:0/579344134 >> v1:172.21.15.82:6789/0 conn(0x7fc4a406c160 legacy=0x7fc4a406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a2a00700 1 -- 172.21.15.129:0/579344134 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a4162bf0 con 0x7fc4a4162150 2024-05-10T04:49:51.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.710+0000 7fc4a1600700 1 -- 172.21.15.129:0/579344134 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351828577 0 0) 0x7fc4a4162630 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.711+0000 7fc4a2a00700 1 --2- 172.21.15.129:0/579344134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a4162150 0x7fc4a415e610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc494009920 tx=0x7fc494009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743cf65a4bb14523 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:51.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.711+0000 7fc4a1600700 1 -- 172.21.15.129:0/579344134 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49400ba60 con 0x7fc4a4162150 2024-05-10T04:49:51.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.711+0000 7fc4a1600700 1 -- 172.21.15.129:0/579344134 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49400bbc0 con 0x7fc4a4162150 2024-05-10T04:49:51.712 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.711+0000 7fc4a1600700 1 -- 172.21.15.129:0/579344134 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494009e70 con 0x7fc4a4162150 2024-05-10T04:49:51.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.712+0000 7fc4a9c00700 1 -- 172.21.15.129:0/579344134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a4162150 msgr2=0x7fc4a415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.712+0000 7fc4a9c00700 1 --2- 172.21.15.129:0/579344134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a4162150 0x7fc4a415e610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc494009920 tx=0x7fc494009c30 comp rx=0 tx=0).stop 2024-05-10T04:49:51.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.712+0000 7fc4a9c00700 1 -- 172.21.15.129:0/579344134 shutdown_connections 2024-05-10T04:49:51.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.712+0000 7fc4a9c00700 1 --2- 172.21.15.129:0/579344134 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a4162150 0x7fc4a415e610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.712+0000 7fc4a9c00700 1 -- 172.21.15.129:0/579344134 >> 172.21.15.129:0/579344134 conn(0x7fc4a40d3e10 msgr2=0x7fc4a40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:51.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.712+0000 7fc4a9c00700 1 -- 172.21.15.129:0/579344134 shutdown_connections 2024-05-10T04:49:51.713 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.712+0000 7fc4a9c00700 1 -- 172.21.15.129:0/579344134 wait complete. 2024-05-10T04:49:51.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.714+0000 7fc4a9c00700 1 Processor -- start 2024-05-10T04:49:51.715 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.714+0000 7fc4a9c00700 1 -- start start 2024-05-10T04:49:51.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a9c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4a406c160 0x7fc4a40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a9c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a40cf4d0 0x7fc4a41f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a4162150 0x7fc4a40d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:51.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a9c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40cd7f0 con 0x7fc4a4162150 2024-05-10T04:49:51.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a9c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40caa20 con 0x7fc4a406c160 2024-05-10T04:49:51.718 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a9c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a40c8e30 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4a406c160 0x7fc4a40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4a406c160 0x7fc4a40ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58756/0 (socket says 172.21.15.129:58756) 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2a00700 1 -- 172.21.15.129:0/1548795195 learned_addr learned my addr 172.21.15.129:0/1548795195 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2000700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a40cf4d0 0x7fc4a41f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a3400700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a4162150 0x7fc4a40d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2000700 1 -- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4a406c160 msgr2=0x7fc4a40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2000700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4a406c160 0x7fc4a40ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2000700 1 -- 172.21.15.129:0/1548795195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a4162150 msgr2=0x7fc4a40d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2000700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a4162150 0x7fc4a40d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2000700 1 -- 172.21.15.129:0/1548795195 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009550 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.716+0000 7fc4a2a00700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4a406c160 0x7fc4a40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.717+0000 7fc4a2000700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a40cf4d0 0x7fc4a41f7ef0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c3c0 tx=0x7fc49000c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.717+0000 7fc49aa00700 1 -- 172.21.15.129:0/1548795195 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4900052d0 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.719 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.717+0000 7fc49aa00700 1 -- 172.21.15.129:0/1548795195 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc490005450 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.717+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a41f8960 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.717+0000 7fc49aa00700 1 -- 172.21.15.129:0/1548795195 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4900038c0 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.717+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a41f8e90 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.717+0000 7fc49aa00700 1 -- 172.21.15.129:0/1548795195 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc490003d20 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.718+0000 7fc49aa00700 1 -- 172.21.15.129:0/1548795195 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc49001c860 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.720 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.718+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a40cf0f0 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.721 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.721+0000 7fc49aa00700 1 -- 172.21.15.129:0/1548795195 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc490017070 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.808 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.807+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd new", "uuid": "25e45572-97fc-438e-b46b-623e1f7dcc18", "id": 2} v 0) v1 -- 0x7fc4a40cd930 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.815 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:51.814+0000 7f630fe48240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T04:49:51.816 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.816+0000 7fc49aa00700 1 -- 172.21.15.129:0/1548795195 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "25e45572-97fc-438e-b46b-623e1f7dcc18", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc4a40cd930 con 0x7fc4a40cf4d0 2024-05-10T04:49:51.817 INFO:teuthology.orchestra.run.smithi129.stdout:2 2024-05-10T04:49:51.818 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a40cf4d0 msgr2=0x7fc4a41f7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:51.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a40cf4d0 0x7fc4a41f7ef0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c3c0 tx=0x7fc49000c6d0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 shutdown_connections 2024-05-10T04:49:51.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4a4162150 0x7fc4a40d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4a406c160 0x7fc4a40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.819 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 --2- 172.21.15.129:0/1548795195 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4a40cf4d0 0x7fc4a41f7ef0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:51.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 >> 172.21.15.129:0/1548795195 conn(0x7fc4a40d3e10 msgr2=0x7fc4a40740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:51.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 shutdown_connections 2024-05-10T04:49:51.820 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:51.817+0000 7fc4a9c00700 1 -- 172.21.15.129:0/1548795195 wait complete. 2024-05-10T04:49:51.843 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 02301f01-ba44-4a50-af7e-51b08f106b42 3 2024-05-10T04:49:51.956 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:51.955+0000 7f16a0a85240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T04:49:52.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.143+0000 7f677bc00700 1 Processor -- start 2024-05-10T04:49:52.144 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.143+0000 7f677bc00700 1 -- start start 2024-05-10T04:49:52.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.145+0000 7f677bc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67740cf610 0x7f677415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.145+0000 7f677bc00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677406db00 con 0x7f677406df90 2024-05-10T04:49:52.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.145+0000 7f677bc00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677406e7b0 con 0x7f677406e3a0 2024-05-10T04:49:52.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.145+0000 7f677bc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677415d160 con 0x7f67740cf610 2024-05-10T04:49:52.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6779200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67740cf610 0x7f677415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6779c00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f677406e3a0 0x7f6774071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:59882/0 (socket says 172.21.15.129:59882) 2024-05-10T04:49:52.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6779c00700 1 -- 172.21.15.129:0/336353550 learned_addr learned my addr 172.21.15.129:0/336353550 (peer_addr_for_me v1:172.21.15.129:0/0) 2024-05-10T04:49:52.146 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6779200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67740cf610 0x7f677415c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:46986/0 (socket says 172.21.15.129:46986) 2024-05-10T04:49:52.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6779200700 1 -- 172.21.15.129:0/336353550 >> v1:172.21.15.129:6789/0 conn(0x7f677406e3a0 legacy=0x7f6774071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6779200700 1 -- 172.21.15.129:0/336353550 >> v1:172.21.15.82:6789/0 conn(0x7f677406df90 legacy=0x7f677415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.147 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6779200700 1 -- 172.21.15.129:0/336353550 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677415d440 con 0x7f67740cf610 2024-05-10T04:49:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6773400700 1 -- 172.21.15.129:0/336353550 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980757157 0 0) 0x7f677406db00 con 0x7f677406df90 2024-05-10T04:49:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.146+0000 7f6779200700 1 --2- 172.21.15.129:0/336353550 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67740cf610 0x7f677415c7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6768009870 tx=0x7f6768009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f32be89bc2c7604 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f6773400700 1 -- 172.21.15.129:0/336353550 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768011830 con 0x7f67740cf610 2024-05-10T04:49:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f6773400700 1 -- 172.21.15.129:0/336353550 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6768011990 con 0x7f67740cf610 2024-05-10T04:49:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f6773400700 1 -- 172.21.15.129:0/336353550 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768011d20 con 0x7f67740cf610 2024-05-10T04:49:52.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f677bc00700 1 -- 172.21.15.129:0/336353550 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67740cf610 msgr2=0x7f677415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f677bc00700 1 --2- 172.21.15.129:0/336353550 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67740cf610 0x7f677415c7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6768009870 tx=0x7f6768009b80 comp rx=0 tx=0).stop 2024-05-10T04:49:52.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f677bc00700 1 -- 172.21.15.129:0/336353550 shutdown_connections 2024-05-10T04:49:52.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f677bc00700 1 --2- 172.21.15.129:0/336353550 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f67740cf610 0x7f677415c7f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f677bc00700 1 -- 172.21.15.129:0/336353550 >> 172.21.15.129:0/336353550 conn(0x7f67740b1830 msgr2=0x7f67740b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:52.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.147+0000 7f677bc00700 1 -- 172.21.15.129:0/336353550 shutdown_connections 2024-05-10T04:49:52.149 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.148+0000 7f677bc00700 1 -- 172.21.15.129:0/336353550 wait complete. 2024-05-10T04:49:52.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.150+0000 7f677bc00700 1 Processor -- start 2024-05-10T04:49:52.150 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.150+0000 7f677bc00700 1 -- start start 2024-05-10T04:49:52.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.151+0000 7f677bc00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f677406df90 0x7f6774157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.151+0000 7f677bc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f677406e3a0 0x7f6774148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.151+0000 7f677bc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67740cf610 0x7f677415f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.151+0000 7f677bc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6774149e80 con 0x7f67740cf610 2024-05-10T04:49:52.153 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.151+0000 7f677bc00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6774158190 con 0x7f677406df90 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.151+0000 7f677bc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67741f6840 con 0x7f677406e3a0 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.151+0000 7f6779200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f677406df90 0x7f6774157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6773e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f677406e3a0 0x7f6774148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f677406df90 0x7f6774157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58770/0 (socket says 172.21.15.129:58770) 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779200700 1 -- 172.21.15.129:0/1495344474 learned_addr learned my addr 172.21.15.129:0/1495344474 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779c00700 1 --2- 172.21.15.129:0/1495344474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67740cf610 0x7f677415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779200700 1 -- 172.21.15.129:0/1495344474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f677406e3a0 msgr2=0x7f6774148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779200700 1 --2- 172.21.15.129:0/1495344474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f677406e3a0 0x7f6774148190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779200700 1 -- 172.21.15.129:0/1495344474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67740cf610 msgr2=0x7f677415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779200700 1 --2- 172.21.15.129:0/1495344474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67740cf610 0x7f677415f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779200700 1 -- 172.21.15.129:0/1495344474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680094a0 con 0x7f677406df90 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.152+0000 7f6779200700 1 --2- 172.21.15.129:0/1495344474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f677406df90 0x7f6774157b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67680090b0 tx=0x7f6768004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.153+0000 7f6770c00700 1 -- 172.21.15.129:0/1495344474 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67680036a0 con 0x7f677406df90 2024-05-10T04:49:52.154 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.153+0000 7f6770c00700 1 -- 172.21.15.129:0/1495344474 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676801f070 con 0x7f677406df90 2024-05-10T04:49:52.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.153+0000 7f6770c00700 1 -- 172.21.15.129:0/1495344474 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768003a60 con 0x7f677406df90 2024-05-10T04:49:52.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.153+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67740cd500 con 0x7f677406df90 2024-05-10T04:49:52.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.153+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67741486d0 con 0x7f677406df90 2024-05-10T04:49:52.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.153+0000 7f6770c00700 1 -- 172.21.15.129:0/1495344474 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6768026480 con 0x7f677406df90 2024-05-10T04:49:52.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.153+0000 7f6770c00700 1 -- 172.21.15.129:0/1495344474 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6768021070 con 0x7f677406df90 2024-05-10T04:49:52.155 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.154+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67741f69b0 con 0x7f677406df90 2024-05-10T04:49:52.157 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.156+0000 7f6770c00700 1 -- 172.21.15.129:0/1495344474 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f676802b020 con 0x7f677406df90 2024-05-10T04:49:52.243 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.242+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02301f01-ba44-4a50-af7e-51b08f106b42", "id": 3} v 0) v1 -- 0x7f6774074af0 con 0x7f677406df90 2024-05-10T04:49:52.251 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.251+0000 7f6770c00700 1 -- 172.21.15.129:0/1495344474 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02301f01-ba44-4a50-af7e-51b08f106b42", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6768015020 con 0x7f677406df90 2024-05-10T04:49:52.252 INFO:teuthology.orchestra.run.smithi129.stdout:3 2024-05-10T04:49:52.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f677406df90 msgr2=0x7f6774157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 --2- 172.21.15.129:0/1495344474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f677406df90 0x7f6774157b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67680090b0 tx=0x7f6768004750 comp rx=0 tx=0).stop 2024-05-10T04:49:52.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 shutdown_connections 2024-05-10T04:49:52.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 --2- 172.21.15.129:0/1495344474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67740cf610 0x7f677415f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 --2- 172.21.15.129:0/1495344474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f677406df90 0x7f6774157b20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 --2- 172.21.15.129:0/1495344474 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f677406e3a0 0x7f6774148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 >> 172.21.15.129:0/1495344474 conn(0x7f67740b1830 msgr2=0x7f6774155800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:52.253 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 shutdown_connections 2024-05-10T04:49:52.254 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.252+0000 7f677bc00700 1 -- 172.21.15.129:0/1495344474 wait complete. 2024-05-10T04:49:52.277 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new e0dac652-feae-4967-9226-804a125c5611 4 2024-05-10T04:49:52.540 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.540+0000 7f8d0d400700 1 Processor -- start 2024-05-10T04:49:52.541 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.540+0000 7f8d0d400700 1 -- start start 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.541+0000 7f8d0d400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8d08162150 0x7f8d0815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.541+0000 7f8d0d400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d080cf4d0 0x7f8d080b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d0d400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080d2c00 con 0x7f8d080b7910 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d0d400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d08162630 con 0x7f8d080cf4d0 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d0d400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d08162910 con 0x7f8d08162150 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d06800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8d08162150 0x7f8d0815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d06800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8d08162150 0x7f8d0815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58774/0 (socket says 172.21.15.129:58774) 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d06800700 1 -- 172.21.15.129:0/2625601195 learned_addr learned my addr 172.21.15.129:0/2625601195 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d05e00700 1 --2- 172.21.15.129:0/2625601195 >> v2:172.21.15.82:3300/0 conn(0x7f8d080cf4d0 0x7f8d080b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.543 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d06800700 1 -- 172.21.15.129:0/2625601195 >> v2:172.21.15.82:3300/0 conn(0x7f8d080cf4d0 msgr2=0x7f8d080b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:52.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d06800700 1 --2- 172.21.15.129:0/2625601195 >> v2:172.21.15.82:3300/0 conn(0x7f8d080cf4d0 0x7f8d080b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d06800700 1 -- 172.21.15.129:0/2625601195 >> v1:172.21.15.82:6789/0 conn(0x7f8d080b7910 legacy=0x7f8d0806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d06800700 1 -- 172.21.15.129:0/2625601195 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08162bf0 con 0x7f8d08162150 2024-05-10T04:49:52.544 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.542+0000 7f8d06800700 1 --2- 172.21.15.129:0/2625601195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d08162150 0x7f8d0815e610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80098f0 tx=0x7f8cf8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8d27f0a23dee9e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:52.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.543+0000 7f8d05400700 1 -- 172.21.15.129:0/2625601195 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8011830 con 0x7f8d08162150 2024-05-10T04:49:52.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.543+0000 7f8d05400700 1 -- 172.21.15.129:0/2625601195 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf8011990 con 0x7f8d08162150 2024-05-10T04:49:52.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.543+0000 7f8d05400700 1 -- 172.21.15.129:0/2625601195 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8011d20 con 0x7f8d08162150 2024-05-10T04:49:52.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.544+0000 7f8d0d400700 1 -- 172.21.15.129:0/2625601195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d08162150 msgr2=0x7f8d0815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.544+0000 7f8d0d400700 1 --2- 172.21.15.129:0/2625601195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d08162150 0x7f8d0815e610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80098f0 tx=0x7f8cf8009c00 comp rx=0 tx=0).stop 2024-05-10T04:49:52.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.544+0000 7f8d0d400700 1 -- 172.21.15.129:0/2625601195 shutdown_connections 2024-05-10T04:49:52.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.544+0000 7f8d0d400700 1 --2- 172.21.15.129:0/2625601195 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d08162150 0x7f8d0815e610 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.545 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.544+0000 7f8d0d400700 1 --2- 172.21.15.129:0/2625601195 >> v2:172.21.15.82:3300/0 conn(0x7f8d080cf4d0 0x7f8d080b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.544+0000 7f8d0d400700 1 -- 172.21.15.129:0/2625601195 >> 172.21.15.129:0/2625601195 conn(0x7f8d080d3e10 msgr2=0x7f8d080d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:52.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.544+0000 7f8d0d400700 1 -- 172.21.15.129:0/2625601195 shutdown_connections 2024-05-10T04:49:52.546 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.544+0000 7f8d0d400700 1 -- 172.21.15.129:0/2625601195 wait complete. 2024-05-10T04:49:52.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.546+0000 7f8d0d400700 1 Processor -- start 2024-05-10T04:49:52.547 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.546+0000 7f8d0d400700 1 -- start start 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d0d400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d080b7910 0x7f8d080c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d0d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d080cf4d0 0x7f8d0815ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d0d400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d08162150 0x7f8d0815f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d0d400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08143bc0 con 0x7f8d080cf4d0 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d0d400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081e9680 con 0x7f8d080b7910 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d0d400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081ea4e0 con 0x7f8d08162150 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d06800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d080b7910 0x7f8d080c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d07200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d08162150 0x7f8d0815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d06800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d080b7910 0x7f8d080c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58786/0 (socket says 172.21.15.129:58786) 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d06800700 1 -- 172.21.15.129:0/1271268918 learned_addr learned my addr 172.21.15.129:0/1271268918 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d05e00700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d080cf4d0 0x7f8d0815ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.550 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d07200700 1 -- 172.21.15.129:0/1271268918 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d080b7910 msgr2=0x7f8d080c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.548+0000 7f8d07200700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d080b7910 0x7f8d080c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8d07200700 1 -- 172.21.15.129:0/1271268918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d080cf4d0 msgr2=0x7f8d0815ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8d07200700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d080cf4d0 0x7f8d0815ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8d07200700 1 -- 172.21.15.129:0/1271268918 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8009550 con 0x7f8d08162150 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8d06800700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d080b7910 0x7f8d080c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8d05e00700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d080cf4d0 0x7f8d0815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8d07200700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d08162150 0x7f8d0815f150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000cb10 tx=0x7f8d0000ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8cfea00700 1 -- 172.21.15.129:0/1271268918 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00003c00 con 0x7f8d08162150 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8cfea00700 1 -- 172.21.15.129:0/1271268918 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00003d60 con 0x7f8d08162150 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8cfea00700 1 -- 172.21.15.129:0/1271268918 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000a9e0 con 0x7f8d08162150 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d080c6cc0 con 0x7f8d08162150 2024-05-10T04:49:52.551 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d081e9bb0 con 0x7f8d08162150 2024-05-10T04:49:52.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.549+0000 7f8cfea00700 1 -- 172.21.15.129:0/1271268918 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8d000050d0 con 0x7f8d08162150 2024-05-10T04:49:52.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.550+0000 7f8cfea00700 1 -- 172.21.15.129:0/1271268918 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f8d00005890 con 0x7f8d08162150 2024-05-10T04:49:52.552 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.550+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d081ea7c0 con 0x7f8d08162150 2024-05-10T04:49:52.553 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.553+0000 7f8cfea00700 1 -- 172.21.15.129:0/1271268918 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f8d00005380 con 0x7f8d08162150 2024-05-10T04:49:52.636 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:52.635+0000 7f630fe48240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T04:49:52.641 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.641+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e0dac652-feae-4967-9226-804a125c5611", "id": 4} v 0) v1 -- 0x7f8d08074af0 con 0x7f8d08162150 2024-05-10T04:49:52.648 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.647+0000 7f8cfea00700 1 -- 172.21.15.129:0/1271268918 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e0dac652-feae-4967-9226-804a125c5611", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8d000055f0 con 0x7f8d08162150 2024-05-10T04:49:52.648 INFO:teuthology.orchestra.run.smithi129.stdout:4 2024-05-10T04:49:52.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.648+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d08162150 msgr2=0x7f8d0815f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.648+0000 7f8d0d400700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d08162150 0x7f8d0815f150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000cb10 tx=0x7f8d0000ce20 comp rx=0 tx=0).stop 2024-05-10T04:49:52.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.648+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 shutdown_connections 2024-05-10T04:49:52.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.648+0000 7f8d0d400700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d08162150 0x7f8d0815f150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.648+0000 7f8d0d400700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d080b7910 0x7f8d080c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.649 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.648+0000 7f8d0d400700 1 --2- 172.21.15.129:0/1271268918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d080cf4d0 0x7f8d0815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.648+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 >> 172.21.15.129:0/1271268918 conn(0x7f8d080d3e10 msgr2=0x7f8d080b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:52.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.648+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 shutdown_connections 2024-05-10T04:49:52.650 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.649+0000 7f8d0d400700 1 -- 172.21.15.129:0/1271268918 wait complete. 2024-05-10T04:49:52.675 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 92d02439-7a37-4b4f-bba0-c9aa00febacd 5 2024-05-10T04:49:52.732 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:52.731+0000 7f630fe48240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T04:49:52.831 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:52.830+0000 7f16a0a85240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T04:49:52.900 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:52.899+0000 7f630fe48240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T04:49:52.929 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:52.929+0000 7f16a0a85240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T04:49:52.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.935+0000 7fb655800700 1 Processor -- start 2024-05-10T04:49:52.936 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.935+0000 7fb655800700 1 -- start start 2024-05-10T04:49:52.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb655800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb650162150 0x7fb65015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb655800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb655800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb6500b7910 0x7fb65006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb655800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6500d2c00 con 0x7fb650162150 2024-05-10T04:49:52.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb655800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb650162630 con 0x7fb6500b7910 2024-05-10T04:49:52.940 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb655800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb650162910 con 0x7fb6500cf4d0 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb64e000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb64f400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb6500b7910 0x7fb65006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb64e000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:47018/0 (socket says 172.21.15.129:47018) 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb64f400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb6500b7910 0x7fb65006c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58792/0 (socket says 172.21.15.129:58792) 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.937+0000 7fb64e000700 1 -- 172.21.15.129:0/2874790088 learned_addr learned my addr 172.21.15.129:0/2874790088 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64ea00700 1 --2- 172.21.15.129:0/2874790088 >> v2:172.21.15.82:3300/0 conn(0x7fb650162150 0x7fb65015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64e000700 1 -- 172.21.15.129:0/2874790088 >> v2:172.21.15.129:3300/0 conn(0x7fb6500b7910 msgr2=0x7fb65006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64e000700 1 --2- 172.21.15.129:0/2874790088 >> v2:172.21.15.129:3300/0 conn(0x7fb6500b7910 0x7fb65006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64e000700 1 -- 172.21.15.129:0/2874790088 >> v2:172.21.15.82:3300/0 conn(0x7fb650162150 msgr2=0x7fb65015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64e000700 1 --2- 172.21.15.129:0/2874790088 >> v2:172.21.15.82:3300/0 conn(0x7fb650162150 0x7fb65015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64e000700 1 -- 172.21.15.129:0/2874790088 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650162bf0 con 0x7fb6500cf4d0 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64f400700 1 --2- 172.21.15.129:0/2874790088 >> v2:172.21.15.129:3300/0 conn(0x7fb6500b7910 0x7fb65006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64e000700 1 --2- 172.21.15.129:0/2874790088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500b73d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6500b6f10 tx=0x7fb63c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad36e0faa6fff6c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:52.941 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.938+0000 7fb64d600700 1 -- 172.21.15.129:0/2874790088 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c011830 con 0x7fb6500cf4d0 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb64d600700 1 -- 172.21.15.129:0/2874790088 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c011990 con 0x7fb6500cf4d0 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb64d600700 1 -- 172.21.15.129:0/2874790088 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c011d20 con 0x7fb6500cf4d0 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 -- 172.21.15.129:0/2874790088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 msgr2=0x7fb6500b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 --2- 172.21.15.129:0/2874790088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500b73d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6500b6f10 tx=0x7fb63c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 -- 172.21.15.129:0/2874790088 shutdown_connections 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 --2- 172.21.15.129:0/2874790088 >> v2:172.21.15.129:3300/0 conn(0x7fb6500b7910 0x7fb65006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 --2- 172.21.15.129:0/2874790088 >> v2:172.21.15.82:3300/0 conn(0x7fb650162150 0x7fb65015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 --2- 172.21.15.129:0/2874790088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500b73d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 -- 172.21.15.129:0/2874790088 >> 172.21.15.129:0/2874790088 conn(0x7fb6500d3e10 msgr2=0x7fb6500d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 -- 172.21.15.129:0/2874790088 shutdown_connections 2024-05-10T04:49:52.942 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.939+0000 7fb655800700 1 -- 172.21.15.129:0/2874790088 wait complete. 2024-05-10T04:49:52.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.942+0000 7fb655800700 1 Processor -- start 2024-05-10T04:49:52.943 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.942+0000 7fb655800700 1 -- start start 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.943+0000 7fb655800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6500b7910 0x7fb65014b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.943+0000 7fb655800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.943+0000 7fb655800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb650162150 0x7fb6501604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.943+0000 7fb655800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65014cfc0 con 0x7fb6500b7910 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.943+0000 7fb655800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500cd790 con 0x7fb650162150 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.943+0000 7fb655800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6500ce5f0 con 0x7fb6500cf4d0 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6500b7910 0x7fb65014b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64e000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6500b7910 0x7fb65014b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.129:37114/0 (socket says 172.21.15.129:37114) 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 -- 172.21.15.129:0/852745721 learned_addr learned my addr 172.21.15.129:0/852745721 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64f400700 1 --2- 172.21.15.129:0/852745721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb650162150 0x7fb6501604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:52.945 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 -- 172.21.15.129:0/852745721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 msgr2=0x7fb6500ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 --2- 172.21.15.129:0/852745721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 -- 172.21.15.129:0/852745721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb650162150 msgr2=0x7fb6501604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:52.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 --2- 172.21.15.129:0/852745721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb650162150 0x7fb6501604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:52.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 -- 172.21.15.129:0/852745721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb648009a70 con 0x7fb6500b7910 2024-05-10T04:49:52.946 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.944+0000 7fb64ea00700 1 --2- 172.21.15.129:0/852745721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6500b7910 0x7fb65014b200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb64000e870 tx=0x7fb64000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:52.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.945+0000 7fb646a00700 1 -- 172.21.15.129:0/852745721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640009590 con 0x7fb6500b7910 2024-05-10T04:49:52.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.945+0000 7fb646a00700 1 -- 172.21.15.129:0/852745721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb640013680 con 0x7fb6500b7910 2024-05-10T04:49:52.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.945+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c009550 con 0x7fb6500b7910 2024-05-10T04:49:52.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.945+0000 7fb646a00700 1 -- 172.21.15.129:0/852745721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640013a10 con 0x7fb6500b7910 2024-05-10T04:49:52.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.945+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6500cd4d0 con 0x7fb6500b7910 2024-05-10T04:49:52.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.945+0000 7fb646a00700 1 -- 172.21.15.129:0/852745721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb64001c450 con 0x7fb6500b7910 2024-05-10T04:49:52.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.945+0000 7fb646a00700 1 -- 172.21.15.129:0/852745721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb64001cc80 con 0x7fb6500b7910 2024-05-10T04:49:52.947 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.946+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65006c340 con 0x7fb6500b7910 2024-05-10T04:49:52.949 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:52.949+0000 7fb646a00700 1 -- 172.21.15.129:0/852745721 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb640021060 con 0x7fb6500b7910 2024-05-10T04:49:53.035 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.035+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92d02439-7a37-4b4f-bba0-c9aa00febacd", "id": 5} v 0) v1 -- 0x7fb650074af0 con 0x7fb6500b7910 2024-05-10T04:49:53.039 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.038+0000 7fb646a00700 1 -- 172.21.15.129:0/852745721 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92d02439-7a37-4b4f-bba0-c9aa00febacd", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb640017070 con 0x7fb6500b7910 2024-05-10T04:49:53.039 INFO:teuthology.orchestra.run.smithi129.stdout:5 2024-05-10T04:49:53.040 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6500b7910 msgr2=0x7fb65014b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 --2- 172.21.15.129:0/852745721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6500b7910 0x7fb65014b200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb64000e870 tx=0x7fb64000eb80 comp rx=0 tx=0).stop 2024-05-10T04:49:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 shutdown_connections 2024-05-10T04:49:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 --2- 172.21.15.129:0/852745721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb650162150 0x7fb6501604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 --2- 172.21.15.129:0/852745721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6500b7910 0x7fb65014b200 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 --2- 172.21.15.129:0/852745721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb6500cf4d0 0x7fb6500ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 >> 172.21.15.129:0/852745721 conn(0x7fb6500d3e10 msgr2=0x7fb6500b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 shutdown_connections 2024-05-10T04:49:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.040+0000 7fb655800700 1 -- 172.21.15.129:0/852745721 wait complete. 2024-05-10T04:49:53.069 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 9267060d-92da-4bb3-be80-531ce9345ff5 6 2024-05-10T04:49:53.112 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:53.111+0000 7f16a0a85240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T04:49:53.113 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:53.111+0000 7f630fe48240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T04:49:53.208 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:53.207+0000 7f630fe48240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T04:49:53.309 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:53.307+0000 7f630fe48240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T04:49:53.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.333+0000 7fa756e00700 1 Processor -- start 2024-05-10T04:49:53.334 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.333+0000 7fa756e00700 1 -- start start 2024-05-10T04:49:53.339 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.334+0000 7fa756e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa750162150 0x7fa75015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.334+0000 7fa756e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7500cf4d0 0x7fa7500b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa756e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa7500b7910 0x7fa75006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa756e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7500d2c00 con 0x7fa750162150 2024-05-10T04:49:53.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa756e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa750162630 con 0x7fa7500b7910 2024-05-10T04:49:53.340 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa756e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa750162910 con 0x7fa7500cf4d0 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74f400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7500cf4d0 0x7fa7500b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa754e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa7500b7910 0x7fa75006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74f400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7500cf4d0 0x7fa7500b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:47042/0 (socket says 172.21.15.129:47042) 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74f400700 1 -- 172.21.15.129:0/632247109 learned_addr learned my addr 172.21.15.129:0/632247109 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74fe00700 1 --2- 172.21.15.129:0/632247109 >> v2:172.21.15.82:3300/0 conn(0x7fa750162150 0x7fa75015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74f400700 1 -- 172.21.15.129:0/632247109 >> v2:172.21.15.129:3300/0 conn(0x7fa7500b7910 msgr2=0x7fa75006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74f400700 1 --2- 172.21.15.129:0/632247109 >> v2:172.21.15.129:3300/0 conn(0x7fa7500b7910 0x7fa75006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74f400700 1 -- 172.21.15.129:0/632247109 >> v2:172.21.15.82:3300/0 conn(0x7fa750162150 msgr2=0x7fa75015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74f400700 1 --2- 172.21.15.129:0/632247109 >> v2:172.21.15.82:3300/0 conn(0x7fa750162150 0x7fa75015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.335+0000 7fa74f400700 1 -- 172.21.15.129:0/632247109 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750162bf0 con 0x7fa7500cf4d0 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.336+0000 7fa74f400700 1 --2- 172.21.15.129:0/632247109 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7500cf4d0 0x7fa7500b73d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa7500b6f10 tx=0x7fa73c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18a941833d739576 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.336+0000 7fa74ea00700 1 -- 172.21.15.129:0/632247109 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c011830 con 0x7fa7500cf4d0 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.336+0000 7fa74ea00700 1 -- 172.21.15.129:0/632247109 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c011990 con 0x7fa7500cf4d0 2024-05-10T04:49:53.341 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.336+0000 7fa74ea00700 1 -- 172.21.15.129:0/632247109 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c011d20 con 0x7fa7500cf4d0 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 -- 172.21.15.129:0/632247109 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7500cf4d0 msgr2=0x7fa7500b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 --2- 172.21.15.129:0/632247109 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7500cf4d0 0x7fa7500b73d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa7500b6f10 tx=0x7fa73c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 -- 172.21.15.129:0/632247109 shutdown_connections 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 --2- 172.21.15.129:0/632247109 >> v2:172.21.15.129:3300/0 conn(0x7fa7500b7910 0x7fa75006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 --2- 172.21.15.129:0/632247109 >> v2:172.21.15.82:3300/0 conn(0x7fa750162150 0x7fa75015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 --2- 172.21.15.129:0/632247109 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa7500cf4d0 0x7fa7500b73d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 -- 172.21.15.129:0/632247109 >> 172.21.15.129:0/632247109 conn(0x7fa7500d3e10 msgr2=0x7fa7500d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 -- 172.21.15.129:0/632247109 shutdown_connections 2024-05-10T04:49:53.342 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.337+0000 7fa756e00700 1 -- 172.21.15.129:0/632247109 wait complete. 2024-05-10T04:49:53.343 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:53.338+0000 7f16a0a85240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T04:49:53.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.339+0000 7fa756e00700 1 Processor -- start 2024-05-10T04:49:53.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.339+0000 7fa756e00700 1 -- start start 2024-05-10T04:49:53.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa756e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7500b7910 0x7fa750159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa756e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7500cf4d0 0x7fa7500c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.345 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa756e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa750162150 0x7fa7501f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa756e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501f5ed0 con 0x7fa7500cf4d0 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa756e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500c8b40 con 0x7fa7500b7910 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa756e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75015ca00 con 0x7fa750162150 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa74fe00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7500b7910 0x7fa750159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa754e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa750162150 0x7fa7501f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa74fe00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7500b7910 0x7fa750159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58814/0 (socket says 172.21.15.129:58814) 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa754e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa750162150 0x7fa7501f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:47056/0 (socket says 172.21.15.129:47056) 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa74fe00700 1 -- 172.21.15.129:0/1985023898 learned_addr learned my addr 172.21.15.129:0/1985023898 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa74f400700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7500cf4d0 0x7fa7500c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa754e00700 1 -- 172.21.15.129:0/1985023898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7500b7910 msgr2=0x7fa750159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa754e00700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7500b7910 0x7fa750159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.341+0000 7fa754e00700 1 -- 172.21.15.129:0/1985023898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7500cf4d0 msgr2=0x7fa7500c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa754e00700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7500cf4d0 0x7fa7500c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.346 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa754e00700 1 -- 172.21.15.129:0/1985023898 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c009550 con 0x7fa750162150 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa74fe00700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7500b7910 0x7fa750159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa74f400700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7500cf4d0 0x7fa7500c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa754e00700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa750162150 0x7fa7501f4b90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa74800ea80 tx=0x7fa74800ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa747e00700 1 -- 172.21.15.129:0/1985023898 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748010040 con 0x7fa750162150 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa747e00700 1 -- 172.21.15.129:0/1985023898 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74800b930 con 0x7fa750162150 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7500c8d90 con 0x7fa750162150 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa747e00700 1 -- 172.21.15.129:0/1985023898 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748009a80 con 0x7fa750162150 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.342+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7500c9350 con 0x7fa750162150 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.343+0000 7fa747e00700 1 -- 172.21.15.129:0/1985023898 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa74801d400 con 0x7fa750162150 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.343+0000 7fa747e00700 1 -- 172.21.15.129:0/1985023898 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa74801dca0 con 0x7fa750162150 2024-05-10T04:49:53.347 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.343+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7501f4830 con 0x7fa750162150 2024-05-10T04:49:53.348 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.346+0000 7fa747e00700 1 -- 172.21.15.129:0/1985023898 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa74803bdc0 con 0x7fa750162150 2024-05-10T04:49:53.409 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:53.408+0000 7f630fe48240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T04:49:53.435 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.434+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9267060d-92da-4bb3-be80-531ce9345ff5", "id": 6} v 0) v1 -- 0x7fa750074af0 con 0x7fa750162150 2024-05-10T04:49:53.440 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.438+0000 7fa747e00700 1 -- 172.21.15.129:0/1985023898 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9267060d-92da-4bb3-be80-531ce9345ff5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa74802a070 con 0x7fa750162150 2024-05-10T04:49:53.440 INFO:teuthology.orchestra.run.smithi129.stdout:6 2024-05-10T04:49:53.441 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:53.439+0000 7f16a0a85240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T04:49:53.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.439+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa750162150 msgr2=0x7fa7501f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.441 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.439+0000 7fa756e00700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa750162150 0x7fa7501f4b90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa74800ea80 tx=0x7fa74800ed90 comp rx=0 tx=0).stop 2024-05-10T04:49:53.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.440+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 shutdown_connections 2024-05-10T04:49:53.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.440+0000 7fa756e00700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa750162150 0x7fa7501f4b90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.440+0000 7fa756e00700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7500b7910 0x7fa750159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.440+0000 7fa756e00700 1 --2- 172.21.15.129:0/1985023898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7500cf4d0 0x7fa7500c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.440+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 >> 172.21.15.129:0/1985023898 conn(0x7fa7500d3e10 msgr2=0x7fa75015f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:53.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.440+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 shutdown_connections 2024-05-10T04:49:53.442 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.440+0000 7fa756e00700 1 -- 172.21.15.129:0/1985023898 wait complete. 2024-05-10T04:49:53.467 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 71fc5fad-1b18-43d5-8bf4-740e1e069e03 7 2024-05-10T04:49:53.524 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:53.523+0000 7f630fe48240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T04:49:53.550 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:53.548+0000 7f16a0a85240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T04:49:53.655 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:53.653+0000 7f16a0a85240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T04:49:53.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.767+0000 7f5d6a800700 1 Processor -- start 2024-05-10T04:49:53.769 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.767+0000 7f5d6a800700 1 -- start start 2024-05-10T04:49:53.771 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d6a800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d64162150 0x7f5d6415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d6a800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5d640cf4d0 0x7f5d640b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d6a800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640b7910 0x7f5d6406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d6a800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d640d2c00 con 0x7f5d64162150 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d6a800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d64162630 con 0x7f5d640cf4d0 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d6a800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d64162910 con 0x7f5d640b7910 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d63e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640b7910 0x7f5d6406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d62a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5d640cf4d0 0x7f5d640b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d63e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640b7910 0x7f5d6406c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.129:47060/0 (socket says 172.21.15.129:47060) 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d63e00700 1 -- 172.21.15.129:0/2795625771 learned_addr learned my addr 172.21.15.129:0/2795625771 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d62a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5d640cf4d0 0x7f5d640b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58822/0 (socket says 172.21.15.129:58822) 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.769+0000 7f5d63400700 1 --2- 172.21.15.129:0/2795625771 >> v2:172.21.15.82:3300/0 conn(0x7f5d64162150 0x7f5d6415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62a00700 1 -- 172.21.15.129:0/2795625771 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640b7910 msgr2=0x7f5d6406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62a00700 1 --2- 172.21.15.129:0/2795625771 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640b7910 0x7f5d6406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.772 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62a00700 1 -- 172.21.15.129:0/2795625771 >> v2:172.21.15.82:3300/0 conn(0x7f5d64162150 msgr2=0x7f5d6415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:53.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62a00700 1 --2- 172.21.15.129:0/2795625771 >> v2:172.21.15.82:3300/0 conn(0x7f5d64162150 0x7f5d6415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62a00700 1 -- 172.21.15.129:0/2795625771 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64162bf0 con 0x7f5d640cf4d0 2024-05-10T04:49:53.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d63e00700 1 --2- 172.21.15.129:0/2795625771 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640b7910 0x7f5d6406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:53.773 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62a00700 1 --2- 172.21.15.129:0/2795625771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d640cf4d0 0x7f5d640b73d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009840 tx=0x7f5d50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7db664e5ac5ca5ae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62000700 1 -- 172.21.15.129:0/2795625771 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50011830 con 0x7f5d640cf4d0 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62000700 1 -- 172.21.15.129:0/2795625771 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50011990 con 0x7f5d640cf4d0 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.770+0000 7f5d62000700 1 -- 172.21.15.129:0/2795625771 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50011d20 con 0x7f5d640cf4d0 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 -- 172.21.15.129:0/2795625771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d640cf4d0 msgr2=0x7f5d640b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 --2- 172.21.15.129:0/2795625771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d640cf4d0 0x7f5d640b73d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009840 tx=0x7f5d50009b50 comp rx=0 tx=0).stop 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 -- 172.21.15.129:0/2795625771 shutdown_connections 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 --2- 172.21.15.129:0/2795625771 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640b7910 0x7f5d6406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 --2- 172.21.15.129:0/2795625771 >> v2:172.21.15.82:3300/0 conn(0x7f5d64162150 0x7f5d6415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 --2- 172.21.15.129:0/2795625771 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d640cf4d0 0x7f5d640b73d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 -- 172.21.15.129:0/2795625771 >> 172.21.15.129:0/2795625771 conn(0x7f5d640d3e10 msgr2=0x7f5d640d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:53.774 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 -- 172.21.15.129:0/2795625771 shutdown_connections 2024-05-10T04:49:53.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.771+0000 7f5d6a800700 1 -- 172.21.15.129:0/2795625771 wait complete. 2024-05-10T04:49:53.775 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:53.772+0000 7f630fe48240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T04:49:53.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.774+0000 7f5d6a800700 1 Processor -- start 2024-05-10T04:49:53.775 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.774+0000 7f5d6a800700 1 -- start start 2024-05-10T04:49:53.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d6a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d640b7910 0x7f5d640c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.777 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d6a800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640cf4d0 0x7f5d6414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d6a800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d64162150 0x7f5d641ea740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d6a800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6415c520 con 0x7f5d640b7910 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d6a800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d641f5ba0 con 0x7f5d64162150 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d6a800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6415d7d0 con 0x7f5d640cf4d0 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d62a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640cf4d0 0x7f5d6414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d63e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d64162150 0x7f5d641ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d63e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d64162150 0x7f5d641ea740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.129:58836/0 (socket says 172.21.15.129:58836) 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d63e00700 1 -- 172.21.15.129:0/1883643721 learned_addr learned my addr 172.21.15.129:0/1883643721 (peer_addr_for_me v2:172.21.15.129:0/0) 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.775+0000 7f5d63400700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d640b7910 0x7f5d640c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d63e00700 1 -- 172.21.15.129:0/1883643721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640cf4d0 msgr2=0x7f5d6414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d63e00700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640cf4d0 0x7f5d6414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.778 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d63e00700 1 -- 172.21.15.129:0/1883643721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d640b7910 msgr2=0x7f5d640c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d63e00700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d640b7910 0x7f5d640c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d63e00700 1 -- 172.21.15.129:0/1883643721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c009b30 con 0x7f5d64162150 2024-05-10T04:49:53.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d62a00700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640cf4d0 0x7f5d6414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:53.779 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d63e00700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d64162150 0x7f5d641ea740 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00eed0 tx=0x7f5d5c00b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:53.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d5b400700 1 -- 172.21.15.129:0/1883643721 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c018070 con 0x7f5d64162150 2024-05-10T04:49:53.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d5b400700 1 -- 172.21.15.129:0/1883643721 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c003a20 con 0x7f5d64162150 2024-05-10T04:49:53.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d5b400700 1 -- 172.21.15.129:0/1883643721 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c010040 con 0x7f5d64162150 2024-05-10T04:49:53.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.776+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d500094a0 con 0x7f5d64162150 2024-05-10T04:49:53.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.777+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6415c730 con 0x7f5d64162150 2024-05-10T04:49:53.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.777+0000 7f5d5b400700 1 -- 172.21.15.129:0/1883643721 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5d5c00bb70 con 0x7f5d64162150 2024-05-10T04:49:53.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.777+0000 7f5d5b400700 1 -- 172.21.15.129:0/1883643721 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f5d5c01daf0 con 0x7f5d64162150 2024-05-10T04:49:53.780 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.777+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d64074af0 con 0x7f5d64162150 2024-05-10T04:49:53.781 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.780+0000 7f5d5b400700 1 -- 172.21.15.129:0/1883643721 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f5d5c01dd90 con 0x7f5d64162150 2024-05-10T04:49:53.787 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:53.785+0000 7f16a0a85240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T04:49:53.869 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.868+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd new", "uuid": "71fc5fad-1b18-43d5-8bf4-740e1e069e03", "id": 7} v 0) v1 -- 0x7f5d640c7070 con 0x7f5d64162150 2024-05-10T04:49:53.876 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.875+0000 7f5d5b400700 1 -- 172.21.15.129:0/1883643721 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71fc5fad-1b18-43d5-8bf4-740e1e069e03", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d5c02c0b0 con 0x7f5d64162150 2024-05-10T04:49:53.876 INFO:teuthology.orchestra.run.smithi129.stdout:7 2024-05-10T04:49:53.877 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d64162150 msgr2=0x7f5d641ea740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:53.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d64162150 0x7f5d641ea740 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00eed0 tx=0x7f5d5c00b390 comp rx=0 tx=0).stop 2024-05-10T04:49:53.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 shutdown_connections 2024-05-10T04:49:53.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5d64162150 0x7f5d641ea740 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d640b7910 0x7f5d640c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 --2- 172.21.15.129:0/1883643721 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5d640cf4d0 0x7f5d6414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:53.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 >> 172.21.15.129:0/1883643721 conn(0x7f5d640d3e10 msgr2=0x7f5d6406c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:53.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 shutdown_connections 2024-05-10T04:49:53.878 INFO:teuthology.orchestra.run.smithi129.stderr:2024-05-10T04:49:53.876+0000 7f5d6a800700 1 -- 172.21.15.129:0/1883643721 wait complete. 2024-05-10T04:49:53.903 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-10T04:49:53.903 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-10T04:49:53.907 INFO:tasks.ceph.osd.0:Started 2024-05-10T04:49:53.907 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-10T04:49:53.907 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-10T04:49:53.911 INFO:tasks.ceph.osd.1:Started 2024-05-10T04:49:53.911 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-10T04:49:53.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-10T04:49:53.916 INFO:tasks.ceph.osd.2:Started 2024-05-10T04:49:53.916 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-10T04:49:53.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-10T04:49:53.920 INFO:tasks.ceph.osd.3:Started 2024-05-10T04:49:53.920 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T04:49:53.920 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T04:49:53.947 INFO:tasks.ceph.osd.4:Started 2024-05-10T04:49:53.947 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T04:49:53.947 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T04:49:53.952 INFO:tasks.ceph.osd.5:Started 2024-05-10T04:49:53.952 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-10T04:49:53.952 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-10T04:49:53.956 INFO:tasks.ceph.osd.6:Started 2024-05-10T04:49:53.956 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-10T04:49:53.957 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-10T04:49:53.961 INFO:tasks.ceph.osd.7:Started 2024-05-10T04:49:53.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:49:54.087 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:54.085+0000 7f16a0a85240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T04:49:54.087 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:54.086+0000 7f630fe48240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T04:49:54.315 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:54.313+0000 7f630fe48240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T04:49:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.330+0000 7fa4e2000700 1 Processor -- start 2024-05-10T04:49:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.330+0000 7fa4e2000700 1 -- start start 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4e2000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4e2000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa4dc0b5fa0 0x7fa4dc1623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4e2000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc162a70 con 0x7fa4dc161fb0 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4e2000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc15c3f0 con 0x7fa4dc0b5fa0 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4e2000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc162d50 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4daa00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa4dc161fb0 0x7fa4dc0b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50642/0 (socket says 172.21.15.82:50642) 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4daa00700 1 -- 172.21.15.82:0/229490656 learned_addr learned my addr 172.21.15.82:0/229490656 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4db400700 1 --2- 172.21.15.82:0/229490656 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.332+0000 7fa4dbe00700 1 --2- 172.21.15.82:0/229490656 >> v2:172.21.15.129:3300/0 conn(0x7fa4dc0b5fa0 0x7fa4dc1623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4da000700 1 -- 172.21.15.82:0/229490656 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596235420 0 0) 0x7fa4dc162a70 con 0x7fa4dc161fb0 2024-05-10T04:49:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4da000700 1 -- 172.21.15.82:0/229490656 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c00035b0 con 0x7fa4dc161fb0 2024-05-10T04:49:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4db400700 1 -- 172.21.15.82:0/229490656 >> v2:172.21.15.129:3300/0 conn(0x7fa4dc0b5fa0 msgr2=0x7fa4dc1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4db400700 1 --2- 172.21.15.82:0/229490656 >> v2:172.21.15.129:3300/0 conn(0x7fa4dc0b5fa0 0x7fa4dc1623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4db400700 1 -- 172.21.15.82:0/229490656 >> v1:172.21.15.82:6789/0 conn(0x7fa4dc161fb0 legacy=0x7fa4dc0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4db400700 1 -- 172.21.15.82:0/229490656 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc15ecf0 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4dbe00700 1 --2- 172.21.15.82:0/229490656 >> v2:172.21.15.129:3300/0 conn(0x7fa4dc0b5fa0 0x7fa4dc1623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4db400700 1 --2- 172.21.15.82:0/229490656 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc15f4f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009840 tx=0x7fa4cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=236f46a32f507bc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4da000700 1 -- 172.21.15.82:0/229490656 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc011830 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.333+0000 7fa4da000700 1 -- 172.21.15.82:0/229490656 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc011990 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4da000700 1 -- 172.21.15.82:0/229490656 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc011d20 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4e2000700 1 -- 172.21.15.82:0/229490656 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 msgr2=0x7fa4dc15f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4e2000700 1 --2- 172.21.15.82:0/229490656 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc15f4f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009840 tx=0x7fa4cc009b50 comp rx=0 tx=0).stop 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4e2000700 1 -- 172.21.15.82:0/229490656 shutdown_connections 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4e2000700 1 --2- 172.21.15.82:0/229490656 >> v2:172.21.15.129:3300/0 conn(0x7fa4dc0b5fa0 0x7fa4dc1623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4e2000700 1 --2- 172.21.15.82:0/229490656 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc15f4f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4e2000700 1 -- 172.21.15.82:0/229490656 >> 172.21.15.82:0/229490656 conn(0x7fa4dc0d0a70 msgr2=0x7fa4dc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4e2000700 1 -- 172.21.15.82:0/229490656 shutdown_connections 2024-05-10T04:49:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.334+0000 7fa4e2000700 1 -- 172.21.15.82:0/229490656 wait complete. 2024-05-10T04:49:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.337+0000 7fa4e2000700 1 Processor -- start 2024-05-10T04:49:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.337+0000 7fa4e2000700 1 -- start start 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.338+0000 7fa4e2000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc14d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.338+0000 7fa4e2000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4dc161fb0 0x7fa4dc0b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.338+0000 7fa4e2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0b8640 0x7fa4dc0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.338+0000 7fa4e2000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0cdd60 con 0x7fa4dc0b8640 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.338+0000 7fa4e2000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc14e0c0 con 0x7fa4dc161fb0 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.338+0000 7fa4e2000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0cb3c0 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc14d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4dbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0b8640 0x7fa4dc0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc14d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:53262/0 (socket says 172.21.15.82:53262) 2024-05-10T04:49:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 -- 172.21.15.82:0/573768204 learned_addr learned my addr 172.21.15.82:0/573768204 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4daa00700 1 --2- 172.21.15.82:0/573768204 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4dc161fb0 0x7fa4dc0b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 -- 172.21.15.82:0/573768204 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4dc161fb0 msgr2=0x7fa4dc0b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 --2- 172.21.15.82:0/573768204 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4dc161fb0 0x7fa4dc0b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 -- 172.21.15.82:0/573768204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0b8640 msgr2=0x7fa4dc0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 --2- 172.21.15.82:0/573768204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0b8640 0x7fa4dc0cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 -- 172.21.15.82:0/573768204 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4009a70 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.339+0000 7fa4db400700 1 --2- 172.21.15.82:0/573768204 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc14d220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc000c00 tx=0x7fa4cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.340+0000 7fa4d3400700 1 -- 172.21.15.82:0/573768204 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc004550 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.340+0000 7fa4d3400700 1 -- 172.21.15.82:0/573768204 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc01e070 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.340+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc0094a0 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.340+0000 7fa4d3400700 1 -- 172.21.15.82:0/573768204 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0038e0 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.340+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc0b7340 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.340+0000 7fa4d3400700 1 -- 172.21.15.82:0/573768204 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa4cc003d40 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.340+0000 7fa4d3400700 1 -- 172.21.15.82:0/573768204 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa4cc01aaf0 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.341+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc074af0 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.344+0000 7fa4d3400700 1 -- 172.21.15.82:0/573768204 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa4cc020070 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.375 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:54.373+0000 7f16a0a85240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T04:49:54.410 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:54.409+0000 7f630fe48240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T04:49:54.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.416+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4dc0d2210 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.417+0000 7fa4d3400700 1 -- 172.21.15.82:0/573768204 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa4cc015020 con 0x7fa4dc15bfe0 2024-05-10T04:49:54.418 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:49:54.419 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:49:53.870644+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 msgr2=0x7fa4dc14d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 --2- 172.21.15.82:0/573768204 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc14d220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc000c00 tx=0x7fa4cc004750 comp rx=0 tx=0).stop 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 shutdown_connections 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 --2- 172.21.15.82:0/573768204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4dc0b8640 0x7fa4dc0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 --2- 172.21.15.82:0/573768204 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4dc15bfe0 0x7fa4dc14d220 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 --2- 172.21.15.82:0/573768204 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4dc161fb0 0x7fa4dc0b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 >> 172.21.15.82:0/573768204 conn(0x7fa4dc0d0a70 msgr2=0x7fa4dc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 shutdown_connections 2024-05-10T04:49:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:49:54.418+0000 7fa4e2000700 1 -- 172.21.15.82:0/573768204 wait complete. 2024-05-10T04:49:54.444 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-10T04:49:54.444 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-10T04:49:54.579 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:54.578+0000 7f16a0a85240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T04:49:54.672 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:54.670+0000 7f16a0a85240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T04:49:54.700 INFO:tasks.ceph.osd.4.smithi129.stderr:2024-05-10T04:49:54.699+0000 7fa121c25800 -1 Falling back to public interface 2024-05-10T04:49:54.709 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-05-10T04:49:54.708+0000 7fead70fb800 -1 Falling back to public interface 2024-05-10T04:49:54.711 INFO:tasks.ceph.osd.6.smithi129.stderr:2024-05-10T04:49:54.710+0000 7fb4b07dd800 -1 Falling back to public interface 2024-05-10T04:49:54.756 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-05-10T04:49:54.755+0000 7fd418ec2800 -1 Falling back to public interface 2024-05-10T04:49:54.760 INFO:tasks.ceph.osd.2.smithi082.stderr:2024-05-10T04:49:54.759+0000 7f910f441800 -1 Falling back to public interface 2024-05-10T04:49:54.761 INFO:tasks.ceph.osd.3.smithi082.stderr:2024-05-10T04:49:54.760+0000 7f522ba06800 -1 Falling back to public interface 2024-05-10T04:49:54.777 INFO:tasks.ceph.osd.5.smithi129.stderr:2024-05-10T04:49:54.776+0000 7f31a59d5800 -1 Falling back to public interface 2024-05-10T04:49:54.804 INFO:tasks.ceph.osd.7.smithi129.stderr:2024-05-10T04:49:54.803+0000 7f722905e800 -1 Falling back to public interface 2024-05-10T04:49:55.244 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:55.242+0000 7f630fe48240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T04:49:55.250 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T04:49:55.463 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:55.461+0000 7f630fe48240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T04:49:55.497 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.495+0000 7f0d25200700 1 Processor -- start 2024-05-10T04:49:55.497 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.495+0000 7f0d25200700 1 -- start start 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d25200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d20142810 0x7f0d2015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d25200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d25200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2015d800 con 0x7f0d2015fe30 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d25200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d20142c20 con 0x7f0d20142810 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d25200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200b5a80 con 0x7f0d200b5130 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d1de00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d20142810 0x7f0d2015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d1de00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d20142810 0x7f0d2015d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41820/0 (socket says 172.21.15.82:41820) 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d1de00700 1 -- 172.21.15.82:0/1687001690 learned_addr learned my addr 172.21.15.82:0/1687001690 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:49:55.499 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d1e800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0d2015fe30 0x7f0d20160240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50656/0 (socket says 172.21.15.82:50656) 2024-05-10T04:49:55.500 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.497+0000 7f0d17e00700 1 --2- 172.21.15.82:0/1687001690 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:55.501 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.498+0000 7f0d1de00700 1 -- 172.21.15.82:0/1687001690 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 msgr2=0x7f0d200b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:49:55.501 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.498+0000 7f0d1de00700 1 --2- 172.21.15.82:0/1687001690 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:55.501 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.498+0000 7f0d1de00700 1 -- 172.21.15.82:0/1687001690 >> v1:172.21.15.82:6789/0 conn(0x7f0d2015fe30 legacy=0x7f0d20160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:55.501 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.498+0000 7f0d1de00700 1 -- 172.21.15.82:0/1687001690 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2006ec20 con 0x7f0d20142810 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.498+0000 7f0d1d400700 1 -- 172.21.15.82:0/1687001690 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515637207 0 0) 0x7f0d2015d800 con 0x7f0d2015fe30 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.498+0000 7f0d1de00700 1 --2- 172.21.15.82:0/1687001690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d20142810 0x7f0d2015d2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d100098f0 tx=0x7f0d10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4264b4daba18ef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d1d400700 1 -- 172.21.15.82:0/1687001690 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10011830 con 0x7f0d20142810 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d1d400700 1 -- 172.21.15.82:0/1687001690 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10011990 con 0x7f0d20142810 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d1d400700 1 -- 172.21.15.82:0/1687001690 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10011d20 con 0x7f0d20142810 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d25200700 1 -- 172.21.15.82:0/1687001690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d20142810 msgr2=0x7f0d2015d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d25200700 1 --2- 172.21.15.82:0/1687001690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d20142810 0x7f0d2015d2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0d100098f0 tx=0x7f0d10009c00 comp rx=0 tx=0).stop 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d25200700 1 -- 172.21.15.82:0/1687001690 shutdown_connections 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d25200700 1 --2- 172.21.15.82:0/1687001690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d20142810 0x7f0d2015d2c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d25200700 1 --2- 172.21.15.82:0/1687001690 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d25200700 1 -- 172.21.15.82:0/1687001690 >> 172.21.15.82:0/1687001690 conn(0x7f0d200717d0 msgr2=0x7f0d20071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:55.502 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.499+0000 7f0d25200700 1 -- 172.21.15.82:0/1687001690 shutdown_connections 2024-05-10T04:49:55.503 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.500+0000 7f0d25200700 1 -- 172.21.15.82:0/1687001690 wait complete. 2024-05-10T04:49:55.503 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.502+0000 7f0d25200700 1 Processor -- start 2024-05-10T04:49:55.503 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.502+0000 7f0d25200700 1 -- start start 2024-05-10T04:49:55.505 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.503+0000 7f0d25200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:55.505 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.503+0000 7f0d25200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d20142810 0x7f0d2015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d25200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015fe30 0x7f0d201f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d25200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201591c0 con 0x7f0d2015fe30 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d25200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201f3690 con 0x7f0d20142810 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d25200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201582f0 con 0x7f0d200b5130 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015fe30 0x7f0d201f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1de00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015fe30 0x7f0d201f4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41832/0 (socket says 172.21.15.82:41832) 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1e800700 1 -- 172.21.15.82:0/2061503437 learned_addr learned my addr 172.21.15.82:0/2061503437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d17e00700 1 --2- 172.21.15.82:0/2061503437 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d20142810 0x7f0d2015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1de00700 1 -- 172.21.15.82:0/2061503437 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d20142810 msgr2=0x7f0d2015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1de00700 1 --2- 172.21.15.82:0/2061503437 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d20142810 0x7f0d2015ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:55.506 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1de00700 1 -- 172.21.15.82:0/2061503437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015fe30 msgr2=0x7f0d201f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:55.507 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1de00700 1 --2- 172.21.15.82:0/2061503437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015fe30 0x7f0d201f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:55.507 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1de00700 1 -- 172.21.15.82:0/2061503437 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d10009550 con 0x7f0d200b5130 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.504+0000 7f0d1de00700 1 --2- 172.21.15.82:0/2061503437 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200a9e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d10016000 tx=0x7f0d10004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.505+0000 7f0d16000700 1 -- 172.21.15.82:0/2061503437 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10004510 con 0x7f0d200b5130 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.505+0000 7f0d16000700 1 -- 172.21.15.82:0/2061503437 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1001e070 con 0x7f0d200b5130 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.505+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d20158540 con 0x7f0d200b5130 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.505+0000 7f0d16000700 1 -- 172.21.15.82:0/2061503437 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d100038e0 con 0x7f0d200b5130 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.505+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d20158b00 con 0x7f0d200b5130 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.505+0000 7f0d16000700 1 -- 172.21.15.82:0/2061503437 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0d10003d40 con 0x7f0d200b5130 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.505+0000 7f0d16000700 1 -- 172.21.15.82:0/2061503437 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0d1001ac40 con 0x7f0d200b5130 2024-05-10T04:49:55.508 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.506+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d20067ff0 con 0x7f0d200b5130 2024-05-10T04:49:55.510 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.509+0000 7f0d16000700 1 -- 172.21.15.82:0/2061503437 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0d10020070 con 0x7f0d200b5130 2024-05-10T04:49:55.510 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:55.509+0000 7f16a0a85240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T04:49:55.584 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.582+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d20072790 con 0x7f0d200b5130 2024-05-10T04:49:55.585 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.583+0000 7f0d16000700 1 -- 172.21.15.82:0/2061503437 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0d10015020 con 0x7f0d200b5130 2024-05-10T04:49:55.585 INFO:teuthology.misc.health.smithi082.stdout: 2024-05-10T04:49:55.585 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":10,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:49:53.870644+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:49:55.586 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.584+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 msgr2=0x7f0d200a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:49:55.586 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.584+0000 7f0d25200700 1 --2- 172.21.15.82:0/2061503437 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200a9e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d10016000 tx=0x7f0d10004750 comp rx=0 tx=0).stop 2024-05-10T04:49:55.586 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.585+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 shutdown_connections 2024-05-10T04:49:55.586 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.585+0000 7f0d25200700 1 --2- 172.21.15.82:0/2061503437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2015fe30 0x7f0d201f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:55.587 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.585+0000 7f0d25200700 1 --2- 172.21.15.82:0/2061503437 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0d200b5130 0x7f0d200a9e30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:55.587 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.585+0000 7f0d25200700 1 --2- 172.21.15.82:0/2061503437 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0d20142810 0x7f0d2015ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:49:55.587 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.585+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 >> 172.21.15.82:0/2061503437 conn(0x7f0d200717d0 msgr2=0x7f0d200b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:49:55.587 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.585+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 shutdown_connections 2024-05-10T04:49:55.587 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:49:55.585+0000 7f0d25200700 1 -- 172.21.15.82:0/2061503437 wait complete. 2024-05-10T04:49:55.608 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T04:49:55.677 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:55.675+0000 7f630fe48240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:49:55.725 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:55.723+0000 7f16a0a85240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T04:49:55.930 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:55.929+0000 7f16a0a85240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:49:56.175 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:56.173+0000 7f630fe48240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T04:49:56.382 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:56.380+0000 7f630fe48240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:49:56.437 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:56.435+0000 7f16a0a85240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T04:49:56.647 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:56.645+0000 7f16a0a85240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:49:56.823 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:56.821+0000 7f630fe48240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T04:49:56.951 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:56.950+0000 7f630fe48240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T04:49:57.107 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:57.106+0000 7f16a0a85240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T04:49:57.239 INFO:tasks.ceph.mgr.x.smithi129.stderr:2024-05-10T04:49:57.238+0000 7f16a0a85240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T04:49:57.973 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:57.971+0000 7f62c6200700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T04:49:57.973 INFO:tasks.ceph.mgr.y.smithi082.stderr:2024-05-10T04:49:57.972+0000 7f62c6200700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-10T04:49:58.275 INFO:tasks.ceph.osd.4.smithi129.stderr:2024-05-10T04:49:58.273+0000 7fa121c25800 -1 osd.4 0 log_to_monitors true 2024-05-10T04:49:58.305 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-05-10T04:49:58.304+0000 7fead70fb800 -1 osd.1 0 log_to_monitors true 2024-05-10T04:49:58.344 INFO:tasks.ceph.osd.3.smithi082.stderr:2024-05-10T04:49:58.343+0000 7f522ba06800 -1 osd.3 0 log_to_monitors true 2024-05-10T04:49:58.441 INFO:tasks.ceph.osd.7.smithi129.stderr:2024-05-10T04:49:58.439+0000 7f722905e800 -1 osd.7 0 log_to_monitors true 2024-05-10T04:49:58.546 INFO:tasks.ceph.osd.6.smithi129.stderr:2024-05-10T04:49:58.544+0000 7fb4b07dd800 -1 osd.6 0 log_to_monitors true 2024-05-10T04:49:58.605 INFO:tasks.ceph.osd.2.smithi082.stderr:2024-05-10T04:49:58.603+0000 7f910f441800 -1 osd.2 0 log_to_monitors true 2024-05-10T04:49:58.606 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-05-10T04:49:58.605+0000 7fd418ec2800 -1 osd.0 0 log_to_monitors true 2024-05-10T04:49:58.636 INFO:tasks.ceph.osd.5.smithi129.stderr:2024-05-10T04:49:58.634+0000 7f31a59d5800 -1 osd.5 0 log_to_monitors true 2024-05-10T04:50:02.216 INFO:tasks.ceph.osd.7.smithi129.stderr:2024-05-10T04:50:02.215+0000 7f7216400700 -1 osd.7 0 waiting for initial osdmap 2024-05-10T04:50:02.232 INFO:tasks.ceph.osd.7.smithi129.stderr:2024-05-10T04:50:02.230+0000 7f720c600700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:50:02.331 INFO:tasks.ceph.osd.3.smithi082.stderr:2024-05-10T04:50:02.330+0000 7f5218c00700 -1 osd.3 0 waiting for initial osdmap 2024-05-10T04:50:02.341 INFO:tasks.ceph.osd.3.smithi082.stderr:2024-05-10T04:50:02.339+0000 7f520ee00700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:50:02.367 INFO:tasks.ceph.osd.4.smithi129.stderr:2024-05-10T04:50:02.365+0000 7fa10f000700 -1 osd.4 0 waiting for initial osdmap 2024-05-10T04:50:02.377 INFO:tasks.ceph.osd.4.smithi129.stderr:2024-05-10T04:50:02.372+0000 7fa105200700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:50:02.398 INFO:tasks.ceph.osd.5.smithi129.stderr:2024-05-10T04:50:02.397+0000 7f3192c00700 -1 osd.5 0 waiting for initial osdmap 2024-05-10T04:50:02.406 INFO:tasks.ceph.osd.5.smithi129.stderr:2024-05-10T04:50:02.404+0000 7f3188e00700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:50:02.415 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:02.417 INFO:tasks.ceph.osd.6.smithi129.stderr:2024-05-10T04:50:02.415+0000 7fb49da00700 -1 osd.6 0 waiting for initial osdmap 2024-05-10T04:50:02.427 INFO:tasks.ceph.osd.6.smithi129.stderr:2024-05-10T04:50:02.425+0000 7fb493c00700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:50:02.440 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-05-10T04:50:02.439+0000 7feac4400700 -1 osd.1 0 waiting for initial osdmap 2024-05-10T04:50:02.449 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-05-10T04:50:02.448+0000 7feaba600700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:50:02.461 INFO:tasks.ceph.osd.2.smithi082.stderr:2024-05-10T04:50:02.460+0000 7f90fc800700 -1 osd.2 0 waiting for initial osdmap 2024-05-10T04:50:02.463 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-05-10T04:50:02.462+0000 7fd406200700 -1 osd.0 0 waiting for initial osdmap 2024-05-10T04:50:02.473 INFO:tasks.ceph.osd.2.smithi082.stderr:2024-05-10T04:50:02.472+0000 7f90f2a00700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:50:02.474 INFO:tasks.ceph.osd.0.smithi082.stderr:2024-05-10T04:50:02.473+0000 7fd3fc400700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:50:02.672 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.671+0000 7f66d0800700 1 Processor -- start 2024-05-10T04:50:02.672 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.671+0000 7f66d0800700 1 -- start start 2024-05-10T04:50:02.675 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.672+0000 7f66d0800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f66c80ce930 0x7f66c815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:02.675 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.672+0000 7f66d0800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f66c80b6530 0x7f66c806c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:02.675 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.672+0000 7f66d0800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c8162970 con 0x7f66c80b3340 2024-05-10T04:50:02.675 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.672+0000 7f66d0800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c80b3750 con 0x7f66c80b6530 2024-05-10T04:50:02.675 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.672+0000 7f66d0800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c8162e00 con 0x7f66c80ce930 2024-05-10T04:50:02.675 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66ce800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f66c80b6530 0x7f66c806c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66cd400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f66c80b3340 0x7f66c80b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57368/0 (socket says 172.21.15.82:57368) 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66ce800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f66c80b6530 0x7f66c806c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38966/0 (socket says 172.21.15.82:38966) 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66cd400700 1 -- 172.21.15.82:0/3749223811 learned_addr learned my addr 172.21.15.82:0/3749223811 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66cde00700 1 --2- 172.21.15.82:0/3749223811 >> v2:172.21.15.129:3300/0 conn(0x7f66c80ce930 0x7f66c815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66ce800700 1 -- 172.21.15.82:0/3749223811 >> v2:172.21.15.129:3300/0 conn(0x7f66c80ce930 msgr2=0x7f66c815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66ce800700 1 --2- 172.21.15.82:0/3749223811 >> v2:172.21.15.129:3300/0 conn(0x7f66c80ce930 0x7f66c815e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66ce800700 1 -- 172.21.15.82:0/3749223811 >> v1:172.21.15.82:6789/0 conn(0x7f66c80b3340 legacy=0x7f66c80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66ce800700 1 -- 172.21.15.82:0/3749223811 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c80b30f0 con 0x7f66c80b6530 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.673+0000 7f66cca00700 1 -- 172.21.15.82:0/3749223811 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258465648 0 0) 0x7f66c8162970 con 0x7f66c80b3340 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.674+0000 7f66ce800700 1 --2- 172.21.15.82:0/3749223811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80b6530 0x7f66c806c2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66c80d1bc0 tx=0x7f66c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435bf3cc065728a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.674+0000 7f66cca00700 1 -- 172.21.15.82:0/3749223811 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400e070 con 0x7f66c80b6530 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.674+0000 7f66cca00700 1 -- 172.21.15.82:0/3749223811 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400bb20 con 0x7f66c80b6530 2024-05-10T04:50:02.676 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.674+0000 7f66cca00700 1 -- 172.21.15.82:0/3749223811 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4012430 con 0x7f66c80b6530 2024-05-10T04:50:02.677 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.674+0000 7f66d0800700 1 -- 172.21.15.82:0/3749223811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80b6530 msgr2=0x7f66c806c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:02.677 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.674+0000 7f66d0800700 1 --2- 172.21.15.82:0/3749223811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80b6530 0x7f66c806c2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66c80d1bc0 tx=0x7f66c400b330 comp rx=0 tx=0).stop 2024-05-10T04:50:02.677 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.674+0000 7f66d0800700 1 -- 172.21.15.82:0/3749223811 shutdown_connections 2024-05-10T04:50:02.677 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.674+0000 7f66d0800700 1 --2- 172.21.15.82:0/3749223811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80b6530 0x7f66c806c2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.678 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.675+0000 7f66d0800700 1 --2- 172.21.15.82:0/3749223811 >> v2:172.21.15.129:3300/0 conn(0x7f66c80ce930 0x7f66c815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.678 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.675+0000 7f66d0800700 1 -- 172.21.15.82:0/3749223811 >> 172.21.15.82:0/3749223811 conn(0x7f66c80d4260 msgr2=0x7f66c80d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:02.678 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.675+0000 7f66d0800700 1 -- 172.21.15.82:0/3749223811 shutdown_connections 2024-05-10T04:50:02.678 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.675+0000 7f66d0800700 1 -- 172.21.15.82:0/3749223811 wait complete. 2024-05-10T04:50:02.679 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.677+0000 7f66d0800700 1 Processor -- start 2024-05-10T04:50:02.679 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.677+0000 7f66d0800700 1 -- start start 2024-05-10T04:50:02.681 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.678+0000 7f66d0800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66c80b3340 0x7f66c8150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:02.681 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.678+0000 7f66d0800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80ce930 0x7f66c80cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:02.681 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.678+0000 7f66d0800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f66c81f4320 0x7f66c80cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:02.681 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.678+0000 7f66d0800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80c9720 con 0x7f66c80ce930 2024-05-10T04:50:02.681 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.678+0000 7f66d0800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80c8890 con 0x7f66c80b3340 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.678+0000 7f66d0800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81f4ac0 con 0x7f66c81f4320 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80ce930 0x7f66c80cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80ce930 0x7f66c80cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38970/0 (socket says 172.21.15.82:38970) 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 -- 172.21.15.82:0/3537126296 learned_addr learned my addr 172.21.15.82:0/3537126296 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cde00700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66c80b3340 0x7f66c8150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66ce800700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f66c81f4320 0x7f66c80cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 -- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f66c81f4320 msgr2=0x7f66c80cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f66c81f4320 0x7f66c80cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 -- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66c80b3340 msgr2=0x7f66c8150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66c80b3340 0x7f66c8150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.682 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 -- 172.21.15.82:0/3537126296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4009a70 con 0x7f66c80ce930 2024-05-10T04:50:02.683 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66ce800700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f66c81f4320 0x7f66c80cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:02.683 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66cd400700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80ce930 0x7f66c80cb6e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c550 tx=0x7f66b800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:02.683 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66c2000700 1 -- 172.21.15.82:0/3537126296 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8004c80 con 0x7f66c80ce930 2024-05-10T04:50:02.683 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66c2000700 1 -- 172.21.15.82:0/3537126296 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b8004e00 con 0x7f66c80ce930 2024-05-10T04:50:02.683 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.679+0000 7f66c2000700 1 -- 172.21.15.82:0/3537126296 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8007310 con 0x7f66c80ce930 2024-05-10T04:50:02.683 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.680+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c80c8aa0 con 0x7f66c80ce930 2024-05-10T04:50:02.683 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.680+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c80c9060 con 0x7f66c80ce930 2024-05-10T04:50:02.684 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.681+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c8067ff0 con 0x7f66c80ce930 2024-05-10T04:50:02.684 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.682+0000 7f66c2000700 1 -- 172.21.15.82:0/3537126296 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f66b8007470 con 0x7f66c80ce930 2024-05-10T04:50:02.684 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.682+0000 7f66c2000700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f66ac06ac00 0x7f66ac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:02.684 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.683+0000 7f66c2000700 1 -- 172.21.15.82:0/3537126296 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f66b8088160 con 0x7f66c80ce930 2024-05-10T04:50:02.684 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.683+0000 7f66cde00700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f66ac06ac00 0x7f66ac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:02.685 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.683+0000 7f66cde00700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f66ac06ac00 0x7f66ac06d110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009b40 tx=0x7f66bc009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:02.689 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.688+0000 7f66c2000700 1 -- 172.21.15.82:0/3537126296 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f66b8054110 con 0x7f66c80ce930 2024-05-10T04:50:02.893 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.892+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c80cfd30 con 0x7f66c80ce930 2024-05-10T04:50:02.894 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.892+0000 7f66c2000700 1 -- 172.21.15.82:0/3537126296 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f66b8057730 con 0x7f66c80ce930 2024-05-10T04:50:02.894 INFO:teuthology.misc.health.smithi082.stdout: 2024-05-10T04:50:02.894 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":12,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:00.020696+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:02.896 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f66ac06ac00 msgr2=0x7f66ac06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:02.896 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f66ac06ac00 0x7f66ac06d110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009b40 tx=0x7f66bc009210 comp rx=0 tx=0).stop 2024-05-10T04:50:02.896 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80ce930 msgr2=0x7f66c80cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80ce930 0x7f66c80cb6e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c550 tx=0x7f66b800c860 comp rx=0 tx=0).stop 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 shutdown_connections 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f66ac06ac00 0x7f66ac06d110 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f66c81f4320 0x7f66c80cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f66c80b3340 0x7f66c8150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 --2- 172.21.15.82:0/3537126296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c80ce930 0x7f66c80cb6e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 >> 172.21.15.82:0/3537126296 conn(0x7f66c80d4260 msgr2=0x7f66c80b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 shutdown_connections 2024-05-10T04:50:02.897 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:02.895+0000 7f66d0800700 1 -- 172.21.15.82:0/3537126296 wait complete. 2024-05-10T04:50:02.920 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T04:50:05.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:50:05.195 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:50:09.727 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:09.977 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.975+0000 7f3615200700 1 Processor -- start 2024-05-10T04:50:09.977 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.975+0000 7f3615200700 1 -- start start 2024-05-10T04:50:09.979 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.977+0000 7f3615200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f361009ade0 0x7f3610099db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:09.979 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.977+0000 7f3615200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36100cdcd0 0x7f36100d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:09.979 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.977+0000 7f3615200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361015e990 con 0x7f361009a2f0 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.977+0000 7f3615200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361009a700 con 0x7f36100cdcd0 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.977+0000 7f3615200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361006bf50 con 0x7f361009ade0 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.977+0000 7f360fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36100cdcd0 0x7f36100d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36100cdcd0 0x7f36100d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52460/0 (socket says 172.21.15.82:52460) 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360fe00700 1 -- 172.21.15.82:0/1175970507 learned_addr learned my addr 172.21.15.82:0/1175970507 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360f400700 1 --2- 172.21.15.82:0/1175970507 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f361009ade0 0x7f3610099db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360fe00700 1 -- 172.21.15.82:0/1175970507 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f361009ade0 msgr2=0x7f3610099db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360fe00700 1 --2- 172.21.15.82:0/1175970507 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f361009ade0 0x7f3610099db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360fe00700 1 -- 172.21.15.82:0/1175970507 >> v1:172.21.15.129:6789/0 conn(0x7f361009a2f0 legacy=0x7f36100cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360fe00700 1 -- 172.21.15.82:0/1175970507 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361006c4f0 con 0x7f36100cdcd0 2024-05-10T04:50:09.980 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360fe00700 1 --2- 172.21.15.82:0/1175970507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100cdcd0 0x7f36100d0390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3608009e50 tx=0x7f360800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5d6b2654d66fe6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:09.981 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.978+0000 7f360ea00700 1 -- 172.21.15.82:0/1175970507 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360800e070 con 0x7f36100cdcd0 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f360ea00700 1 -- 172.21.15.82:0/1175970507 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360800b9c0 con 0x7f36100cdcd0 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f360ea00700 1 -- 172.21.15.82:0/1175970507 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360800bd70 con 0x7f36100cdcd0 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f3615200700 1 -- 172.21.15.82:0/1175970507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100cdcd0 msgr2=0x7f36100d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f3615200700 1 --2- 172.21.15.82:0/1175970507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100cdcd0 0x7f36100d0390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3608009e50 tx=0x7f360800b330 comp rx=0 tx=0).stop 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f3615200700 1 -- 172.21.15.82:0/1175970507 shutdown_connections 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f3615200700 1 --2- 172.21.15.82:0/1175970507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36100cdcd0 0x7f36100d0390 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f3615200700 1 --2- 172.21.15.82:0/1175970507 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f361009ade0 0x7f3610099db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f3615200700 1 -- 172.21.15.82:0/1175970507 >> 172.21.15.82:0/1175970507 conn(0x7f36100d1af0 msgr2=0x7f36100d1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f3615200700 1 -- 172.21.15.82:0/1175970507 shutdown_connections 2024-05-10T04:50:09.982 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.979+0000 7f3615200700 1 -- 172.21.15.82:0/1175970507 wait complete. 2024-05-10T04:50:09.983 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.982+0000 7f3615200700 1 Processor -- start 2024-05-10T04:50:09.983 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.982+0000 7f3615200700 1 -- start start 2024-05-10T04:50:09.986 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3615200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f361009a2f0 0x7f36101e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:09.986 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3615200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361009ade0 0x7f361009f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:09.986 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3615200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36100cdcd0 0x7f3610149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:09.986 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3615200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361009f700 con 0x7f361009ade0 2024-05-10T04:50:09.986 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3615200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36101e73b0 con 0x7f361009a2f0 2024-05-10T04:50:09.986 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3615200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361009f8a0 con 0x7f36100cdcd0 2024-05-10T04:50:09.986 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3607e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361009ade0 0x7f361009f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:09.986 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3607e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361009ade0 0x7f361009f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52474/0 (socket says 172.21.15.82:52474) 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.983+0000 7f3607e00700 1 -- 172.21.15.82:0/1120842659 learned_addr learned my addr 172.21.15.82:0/1120842659 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f360fe00700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36100cdcd0 0x7f3610149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f360f400700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f361009a2f0 0x7f36101e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607e00700 1 -- 172.21.15.82:0/1120842659 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36100cdcd0 msgr2=0x7f3610149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607e00700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36100cdcd0 0x7f3610149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607e00700 1 -- 172.21.15.82:0/1120842659 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f361009a2f0 msgr2=0x7f36101e6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607e00700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f361009a2f0 0x7f36101e6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607e00700 1 -- 172.21.15.82:0/1120842659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3608009b30 con 0x7f361009ade0 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607e00700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361009ade0 0x7f361009f1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c460 tx=0x7f35f800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607400700 1 -- 172.21.15.82:0/1120842659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f80052d0 con 0x7f361009ade0 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607400700 1 -- 172.21.15.82:0/1120842659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f8005430 con 0x7f361009ade0 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3607400700 1 -- 172.21.15.82:0/1120842659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f80038c0 con 0x7f361009ade0 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361014a4a0 con 0x7f361009ade0 2024-05-10T04:50:09.987 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.984+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361009c650 con 0x7f361009ade0 2024-05-10T04:50:09.988 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.985+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361009bab0 con 0x7f361009ade0 2024-05-10T04:50:09.988 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.987+0000 7f3607400700 1 -- 172.21.15.82:0/1120842659 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f35f8003a20 con 0x7f361009ade0 2024-05-10T04:50:09.989 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.988+0000 7f3607400700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f35ec06ac90 0x7f35ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:09.989 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.988+0000 7f3607400700 1 -- 172.21.15.82:0/1120842659 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35f8088b40 con 0x7f361009ade0 2024-05-10T04:50:09.989 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.988+0000 7f360f400700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f35ec06ac90 0x7f35ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:09.990 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.988+0000 7f360f400700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f35ec06ac90 0x7f35ec06d1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36100cf9f0 tx=0x7f3600008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:09.993 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:09.992+0000 7f3607400700 1 -- 172.21.15.82:0/1120842659 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f35f80540c0 con 0x7f361009ade0 2024-05-10T04:50:10.197 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.196+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f361009c7e0 con 0x7f361009ade0 2024-05-10T04:50:10.198 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.197+0000 7f3607400700 1 -- 172.21.15.82:0/1120842659 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f35f8017020 con 0x7f361009ade0 2024-05-10T04:50:10.199 INFO:teuthology.misc.health.smithi082.stdout: 2024-05-10T04:50:10.199 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":17,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:07.257557+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:10.201 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f35ec06ac90 msgr2=0x7f35ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:10.201 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f35ec06ac90 0x7f35ec06d1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36100cf9f0 tx=0x7f3600008040 comp rx=0 tx=0).stop 2024-05-10T04:50:10.201 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361009ade0 msgr2=0x7f361009f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:10.201 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361009ade0 0x7f361009f1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c460 tx=0x7f35f800c820 comp rx=0 tx=0).stop 2024-05-10T04:50:10.201 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 shutdown_connections 2024-05-10T04:50:10.201 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f35ec06ac90 0x7f35ec06d1a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.202 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f36100cdcd0 0x7f3610149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.202 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f361009a2f0 0x7f36101e6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.202 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 --2- 172.21.15.82:0/1120842659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f361009ade0 0x7f361009f1c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.202 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 >> 172.21.15.82:0/1120842659 conn(0x7f36100d1af0 msgr2=0x7f36100b66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:10.202 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 shutdown_connections 2024-05-10T04:50:10.202 INFO:teuthology.misc.health.smithi082.stderr:2024-05-10T04:50:10.199+0000 7f3615200700 1 -- 172.21.15.82:0/1120842659 wait complete. 2024-05-10T04:50:10.225 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-10T04:50:10.225 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-10T04:50:10.225 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T04:50:10.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T04:50:10.230 INFO:tasks.ceph.mds.a:Started 2024-05-10T04:50:10.231 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T04:50:10.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T04:50:10.234 INFO:tasks.ceph.mds.c:Started 2024-05-10T04:50:10.234 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T04:50:10.235 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T04:50:10.239 INFO:tasks.ceph.mds.b:Started 2024-05-10T04:50:10.239 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T04:50:10.239 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T04:50:10.243 INFO:tasks.ceph.mds.d:Started 2024-05-10T04:50:10.243 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-10T04:50:10.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:10.448 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2024-05-10T04:50:10.452 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2024-05-10T04:50:10.465 INFO:tasks.ceph.mds.d.smithi129.stdout:starting mds.d at 2024-05-10T04:50:10.465 INFO:tasks.ceph.mds.b.smithi129.stdout:starting mds.b at 2024-05-10T04:50:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.522+0000 7feaa8000700 1 Processor -- start 2024-05-10T04:50:10.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.522+0000 7feaa8000700 1 -- start start 2024-05-10T04:50:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa8000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7feaa015bfe0 0x7feaa015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa8000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feaa0161fb0 0x7feaa01623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa8000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 0x7feaa00b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa8000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa015c3f0 con 0x7feaa0161fb0 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa8000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa00b61e0 con 0x7feaa015bfe0 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa8000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0162a70 con 0x7feaa00b5890 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa4c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feaa0161fb0 0x7feaa01623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa4c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feaa0161fb0 0x7feaa01623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52504/0 (socket says 172.21.15.82:52504) 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.524+0000 7feaa4c00700 1 -- 172.21.15.82:0/1697729038 learned_addr learned my addr 172.21.15.82:0/1697729038 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7feaa5600700 1 --2- 172.21.15.82:0/1697729038 >> v2:172.21.15.129:3300/0 conn(0x7feaa015bfe0 0x7feaa015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7feaa6000700 1 --2- 172.21.15.82:0/1697729038 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 0x7feaa00b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7feaa4c00700 1 -- 172.21.15.82:0/1697729038 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 msgr2=0x7feaa00b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7feaa4c00700 1 --2- 172.21.15.82:0/1697729038 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 0x7feaa00b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7feaa4c00700 1 -- 172.21.15.82:0/1697729038 >> v2:172.21.15.129:3300/0 conn(0x7feaa015bfe0 msgr2=0x7feaa015f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7feaa4c00700 1 --2- 172.21.15.82:0/1697729038 >> v2:172.21.15.129:3300/0 conn(0x7feaa015bfe0 0x7feaa015f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7feaa4c00700 1 -- 172.21.15.82:0/1697729038 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0162d50 con 0x7feaa0161fb0 2024-05-10T04:50:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7feaa4c00700 1 --2- 172.21.15.82:0/1697729038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa01623c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feaa008c860 tx=0x7fea8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c7c01ccb0fdfac server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7fea9fe00700 1 -- 172.21.15.82:0/1697729038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c00b870 con 0x7feaa0161fb0 2024-05-10T04:50:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7fea9fe00700 1 -- 172.21.15.82:0/1697729038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c00b9d0 con 0x7feaa0161fb0 2024-05-10T04:50:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.525+0000 7fea9fe00700 1 -- 172.21.15.82:0/1697729038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c00bd60 con 0x7feaa0161fb0 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 -- 172.21.15.82:0/1697729038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 msgr2=0x7feaa01623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 --2- 172.21.15.82:0/1697729038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa01623c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feaa008c860 tx=0x7fea8c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 -- 172.21.15.82:0/1697729038 shutdown_connections 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 --2- 172.21.15.82:0/1697729038 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 0x7feaa00b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 --2- 172.21.15.82:0/1697729038 >> v2:172.21.15.129:3300/0 conn(0x7feaa015bfe0 0x7feaa015f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 --2- 172.21.15.82:0/1697729038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa01623c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 -- 172.21.15.82:0/1697729038 >> 172.21.15.82:0/1697729038 conn(0x7feaa00d0a70 msgr2=0x7feaa00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 -- 172.21.15.82:0/1697729038 shutdown_connections 2024-05-10T04:50:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.526+0000 7feaa8000700 1 -- 172.21.15.82:0/1697729038 wait complete. 2024-05-10T04:50:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.528+0000 7feaa8000700 1 Processor -- start 2024-05-10T04:50:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.528+0000 7feaa8000700 1 -- start start 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa8000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 0x7feaa015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa8000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feaa015bfe0 0x7feaa00cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa8000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa00c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa8000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa01f5810 con 0x7feaa0161fb0 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa8000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00b2700 con 0x7feaa015bfe0 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa8000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00cc330 con 0x7feaa00b5890 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa00c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa00c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52512/0 (socket says 172.21.15.82:52512) 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa6000700 1 -- 172.21.15.82:0/2532697768 learned_addr learned my addr 172.21.15.82:0/2532697768 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa5600700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 0x7feaa015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.530+0000 7feaa4c00700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feaa015bfe0 0x7feaa00cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7feaa6000700 1 -- 172.21.15.82:0/2532697768 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 msgr2=0x7feaa015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7feaa6000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 0x7feaa015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7feaa6000700 1 -- 172.21.15.82:0/2532697768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feaa015bfe0 msgr2=0x7feaa00cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7feaa6000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feaa015bfe0 0x7feaa00cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7feaa6000700 1 -- 172.21.15.82:0/2532697768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c009550 con 0x7feaa0161fb0 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7feaa6000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa00c9a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea9800d600 tx=0x7fea9800d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7fea9d600700 1 -- 172.21.15.82:0/2532697768 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98018070 con 0x7feaa0161fb0 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7fea9d600700 1 -- 172.21.15.82:0/2532697768 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea980125f0 con 0x7feaa0161fb0 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7fea9d600700 1 -- 172.21.15.82:0/2532697768 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980127a0 con 0x7feaa0161fb0 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa00b2950 con 0x7feaa0161fb0 2024-05-10T04:50:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.531+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa00cba00 con 0x7feaa0161fb0 2024-05-10T04:50:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.532+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa00cc610 con 0x7feaa0161fb0 2024-05-10T04:50:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.533+0000 7fea9d600700 1 -- 172.21.15.82:0/2532697768 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea98012900 con 0x7feaa0161fb0 2024-05-10T04:50:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.534+0000 7fea9d600700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fea8006ac90 0x7fea8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.534+0000 7fea9d600700 1 -- 172.21.15.82:0/2532697768 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea98088bc0 con 0x7feaa0161fb0 2024-05-10T04:50:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.535+0000 7feaa5600700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fea8006ac90 0x7fea8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.535+0000 7feaa5600700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fea8006ac90 0x7fea8006d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fea94003b30 tx=0x7fea94009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.539+0000 7fea9d600700 1 -- 172.21.15.82:0/2532697768 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fea980540e0 con 0x7feaa0161fb0 2024-05-10T04:50:10.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.743+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaa0074af0 con 0x7feaa0161fb0 2024-05-10T04:50:10.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.744+0000 7fea9d600700 1 -- 172.21.15.82:0/2532697768 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fea98057700 con 0x7feaa0161fb0 2024-05-10T04:50:10.746 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:10.746 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:07.257557+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fea8006ac90 msgr2=0x7fea8006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fea8006ac90 0x7fea8006d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fea94003b30 tx=0x7fea94009830 comp rx=0 tx=0).stop 2024-05-10T04:50:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 msgr2=0x7feaa00c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa00c9a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea9800d600 tx=0x7fea9800d910 comp rx=0 tx=0).stop 2024-05-10T04:50:10.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 shutdown_connections 2024-05-10T04:50:10.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fea8006ac90 0x7fea8006d1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaa0161fb0 0x7feaa00c9a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feaa00b5890 0x7feaa015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 --2- 172.21.15.82:0/2532697768 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feaa015bfe0 0x7feaa00cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:10.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 >> 172.21.15.82:0/2532697768 conn(0x7feaa00d0a70 msgr2=0x7feaa0161250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:10.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.746+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 shutdown_connections 2024-05-10T04:50:10.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:10.747+0000 7feaa8000700 1 -- 172.21.15.82:0/2532697768 wait complete. 2024-05-10T04:50:10.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:10.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.038+0000 7f4fb2000700 1 Processor -- start 2024-05-10T04:50:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.039+0000 7f4fb2000700 1 -- start start 2024-05-10T04:50:11.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.040+0000 7f4fb2000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4fac15beb0 0x7f4fac15f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.040+0000 7f4fb2000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac0d2590 con 0x7f4fac06c1a0 2024-05-10T04:50:11.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.040+0000 7f4fb2000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac15fe90 con 0x7f4fac15e790 2024-05-10T04:50:11.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.040+0000 7f4fb2000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac0cec30 con 0x7f4fac15beb0 2024-05-10T04:50:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.041+0000 7f4fb0c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4fac15beb0 0x7f4fac15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.041+0000 7f4fabe00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4fac06c1a0 0x7f4fac06c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60794/0 (socket says 172.21.15.82:60794) 2024-05-10T04:50:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.041+0000 7f4fabe00700 1 -- 172.21.15.82:0/188446186 learned_addr learned my addr 172.21.15.82:0/188446186 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.041+0000 7f4fb0c00700 1 -- 172.21.15.82:0/188446186 >> v1:172.21.15.129:6789/0 conn(0x7f4fac15e790 legacy=0x7f4fac15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.041+0000 7f4fb0c00700 1 -- 172.21.15.82:0/188446186 >> v1:172.21.15.82:6789/0 conn(0x7f4fac06c1a0 legacy=0x7f4fac06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.041+0000 7f4fb0c00700 1 -- 172.21.15.82:0/188446186 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac15f730 con 0x7f4fac15beb0 2024-05-10T04:50:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.041+0000 7f4fab400700 1 -- 172.21.15.82:0/188446186 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659304701 0 0) 0x7f4fac0d2590 con 0x7f4fac06c1a0 2024-05-10T04:50:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.041+0000 7f4fb0c00700 1 --2- 172.21.15.82:0/188446186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac15f950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009d90 tx=0x7f4fa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1db11f5239b6b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fab400700 1 -- 172.21.15.82:0/188446186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000e070 con 0x7f4fac15beb0 2024-05-10T04:50:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fab400700 1 -- 172.21.15.82:0/188446186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000bbd0 con 0x7f4fac15beb0 2024-05-10T04:50:11.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fab400700 1 -- 172.21.15.82:0/188446186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0012430 con 0x7f4fac15beb0 2024-05-10T04:50:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fb2000700 1 -- 172.21.15.82:0/188446186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 msgr2=0x7f4fac15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fb2000700 1 --2- 172.21.15.82:0/188446186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac15f950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009d90 tx=0x7f4fa000b330 comp rx=0 tx=0).stop 2024-05-10T04:50:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fb2000700 1 -- 172.21.15.82:0/188446186 shutdown_connections 2024-05-10T04:50:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fb2000700 1 --2- 172.21.15.82:0/188446186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac15f950 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fb2000700 1 -- 172.21.15.82:0/188446186 >> 172.21.15.82:0/188446186 conn(0x7f4fac0d3be0 msgr2=0x7f4fac0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fb2000700 1 -- 172.21.15.82:0/188446186 shutdown_connections 2024-05-10T04:50:11.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.042+0000 7f4fb2000700 1 -- 172.21.15.82:0/188446186 wait complete. 2024-05-10T04:50:11.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.045+0000 7f4fb2000700 1 Processor -- start 2024-05-10T04:50:11.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.045+0000 7f4fb2000700 1 -- start start 2024-05-10T04:50:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.046+0000 7f4fb2000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fac06c1a0 0x7f4fac1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.046+0000 7f4fb2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.046+0000 7f4fb2000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4fac15e790 0x7f4fac0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.046+0000 7f4fb2000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0ca5c0 con 0x7f4fac15beb0 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.046+0000 7f4fb2000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0b4270 con 0x7f4fac06c1a0 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.046+0000 7f4fb2000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac159e10 con 0x7f4fac15e790 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.046+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac0b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.046+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac0b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52534/0 (socket says 172.21.15.82:52534) 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fabe00700 1 -- 172.21.15.82:0/1240696914 learned_addr learned my addr 172.21.15.82:0/1240696914 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fb0c00700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fac06c1a0 0x7f4fac1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fb1600700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4fac15e790 0x7f4fac0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fabe00700 1 -- 172.21.15.82:0/1240696914 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4fac15e790 msgr2=0x7f4fac0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fabe00700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4fac15e790 0x7f4fac0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fabe00700 1 -- 172.21.15.82:0/1240696914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fac06c1a0 msgr2=0x7f4fac1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fabe00700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fac06c1a0 0x7f4fac1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fabe00700 1 -- 172.21.15.82:0/1240696914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa0009a70 con 0x7f4fac15beb0 2024-05-10T04:50:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fabe00700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac0b5e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800c520 tx=0x7f4f9800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1240696914 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98004c80 con 0x7f4fac15beb0 2024-05-10T04:50:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1240696914 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f98004de0 con 0x7f4fac15beb0 2024-05-10T04:50:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1240696914 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98007310 con 0x7f4fac15beb0 2024-05-10T04:50:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.047+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac0b44c0 con 0x7f4fac15beb0 2024-05-10T04:50:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.048+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac0c87a0 con 0x7f4fac15beb0 2024-05-10T04:50:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.049+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac0c90d0 con 0x7f4fac15beb0 2024-05-10T04:50:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.050+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1240696914 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4f98007470 con 0x7f4fac15beb0 2024-05-10T04:50:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.051+0000 7f4fa8c00700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f4f8c06acc0 0x7f4f8c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.051+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1240696914 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f98088ab0 con 0x7f4fac15beb0 2024-05-10T04:50:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.051+0000 7f4fb0c00700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f4f8c06acc0 0x7f4f8c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.051+0000 7f4fb0c00700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f4f8c06acc0 0x7f4f8c06d1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009d90 tx=0x7f4fa001e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:11.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.055+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1240696914 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4f98053fe0 con 0x7f4fac15beb0 2024-05-10T04:50:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.255+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fac074af0 con 0x7f4fac15beb0 2024-05-10T04:50:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.256+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1240696914 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f98057600 con 0x7f4fac15beb0 2024-05-10T04:50:11.258 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.258+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f4f8c06acc0 msgr2=0x7f4f8c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.258+0000 7f4fb2000700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f4f8c06acc0 0x7f4f8c06d1d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009d90 tx=0x7f4fa001e040 comp rx=0 tx=0).stop 2024-05-10T04:50:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.258+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 msgr2=0x7f4fac0b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.258+0000 7f4fb2000700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac0b5e80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800c520 tx=0x7f4f9800c830 comp rx=0 tx=0).stop 2024-05-10T04:50:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.259+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 shutdown_connections 2024-05-10T04:50:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.259+0000 7f4fb2000700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f4f8c06acc0 0x7f4f8c06d1d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.259+0000 7f4fb2000700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4fac15e790 0x7f4fac0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.259+0000 7f4fb2000700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4fac06c1a0 0x7f4fac1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.259+0000 7f4fb2000700 1 --2- 172.21.15.82:0/1240696914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac15beb0 0x7f4fac0b5e80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.259+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 >> 172.21.15.82:0/1240696914 conn(0x7f4fac0d3be0 msgr2=0x7f4fac0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.259+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 shutdown_connections 2024-05-10T04:50:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.259+0000 7f4fb2000700 1 -- 172.21.15.82:0/1240696914 wait complete. 2024-05-10T04:50:11.285 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:50:11.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.549+0000 7fdf07e00700 1 Processor -- start 2024-05-10T04:50:11.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.549+0000 7fdf07e00700 1 -- start start 2024-05-10T04:50:11.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.551+0000 7fdf07e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdf0815bdb0 0x7fdf0815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.551+0000 7fdf07e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf080d09d0 0x7fdf080d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.551+0000 7fdf07e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0815c1c0 con 0x7fdf080ce7a0 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.551+0000 7fdf07e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf080d1320 con 0x7fdf080d09d0 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.551+0000 7fdf07e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0815e760 con 0x7fdf0815bdb0 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf07400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf080d09d0 0x7fdf080d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf07400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf080d09d0 0x7fdf080d0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52542/0 (socket says 172.21.15.82:52542) 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf07400700 1 -- 172.21.15.82:0/2391291053 learned_addr learned my addr 172.21.15.82:0/2391291053 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf06000700 1 --2- 172.21.15.82:0/2391291053 >> v2:172.21.15.129:3300/0 conn(0x7fdf0815bdb0 0x7fdf0815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf07400700 1 -- 172.21.15.82:0/2391291053 >> v2:172.21.15.129:3300/0 conn(0x7fdf0815bdb0 msgr2=0x7fdf0815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf07400700 1 --2- 172.21.15.82:0/2391291053 >> v2:172.21.15.129:3300/0 conn(0x7fdf0815bdb0 0x7fdf0815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf07400700 1 -- 172.21.15.82:0/2391291053 >> v1:172.21.15.129:6789/0 conn(0x7fdf080ce7a0 legacy=0x7fdf080b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf07400700 1 -- 172.21.15.82:0/2391291053 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf080b5e80 con 0x7fdf080d09d0 2024-05-10T04:50:11.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.552+0000 7fdf07400700 1 --2- 172.21.15.82:0/2391291053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf080d09d0 0x7fdf080d0de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdf080ce200 tx=0x7fdf0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9743a41d568aefbb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:11.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf05600700 1 -- 172.21.15.82:0/2391291053 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000e070 con 0x7fdf080d09d0 2024-05-10T04:50:11.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf05600700 1 -- 172.21.15.82:0/2391291053 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0000b910 con 0x7fdf080d09d0 2024-05-10T04:50:11.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf05600700 1 -- 172.21.15.82:0/2391291053 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000bcc0 con 0x7fdf080d09d0 2024-05-10T04:50:11.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf07e00700 1 -- 172.21.15.82:0/2391291053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf080d09d0 msgr2=0x7fdf080d0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf07e00700 1 --2- 172.21.15.82:0/2391291053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf080d09d0 0x7fdf080d0de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdf080ce200 tx=0x7fdf0000b330 comp rx=0 tx=0).stop 2024-05-10T04:50:11.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf07e00700 1 -- 172.21.15.82:0/2391291053 shutdown_connections 2024-05-10T04:50:11.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf07e00700 1 --2- 172.21.15.82:0/2391291053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf080d09d0 0x7fdf080d0de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf07e00700 1 --2- 172.21.15.82:0/2391291053 >> v2:172.21.15.129:3300/0 conn(0x7fdf0815bdb0 0x7fdf0815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf07e00700 1 -- 172.21.15.82:0/2391291053 >> 172.21.15.82:0/2391291053 conn(0x7fdf0806c540 msgr2=0x7fdf0806c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:11.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf07e00700 1 -- 172.21.15.82:0/2391291053 shutdown_connections 2024-05-10T04:50:11.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.553+0000 7fdf07e00700 1 -- 172.21.15.82:0/2391291053 wait complete. 2024-05-10T04:50:11.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.556+0000 7fdf07e00700 1 Processor -- start 2024-05-10T04:50:11.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.556+0000 7fdf07e00700 1 -- start start 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.557+0000 7fdf07e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdf080ce7a0 0x7fdf081e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.557+0000 7fdf07e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf080d09d0 0x7fdf0814e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.557+0000 7fdf07e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf0815bdb0 0x7fdf080b8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.557+0000 7fdf07e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0814e610 con 0x7fdf0815bdb0 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.557+0000 7fdf07e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081f5830 con 0x7fdf080d09d0 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.557+0000 7fdf07e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081e99d0 con 0x7fdf080ce7a0 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf0815bdb0 0x7fdf080b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf0815bdb0 0x7fdf080b8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52556/0 (socket says 172.21.15.82:52556) 2024-05-10T04:50:11.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 -- 172.21.15.82:0/65569866 learned_addr learned my addr 172.21.15.82:0/65569866 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf06000700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf080d09d0 0x7fdf0814e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf06a00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdf080ce7a0 0x7fdf081e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 -- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdf080ce7a0 msgr2=0x7fdf081e92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdf080ce7a0 0x7fdf081e92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 -- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf080d09d0 msgr2=0x7fdf0814e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf080d09d0 0x7fdf0814e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 -- 172.21.15.82:0/65569866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00009b30 con 0x7fdf0815bdb0 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf06000700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf080d09d0 0x7fdf0814e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf06a00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdf080ce7a0 0x7fdf081e92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdf07400700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf0815bdb0 0x7fdf080b8100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf00012000 tx=0x7fdf00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.558+0000 7fdefea00700 1 -- 172.21.15.82:0/65569866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000092e0 con 0x7fdf0815bdb0 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.559+0000 7fdefea00700 1 -- 172.21.15.82:0/65569866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0001b430 con 0x7fdf0815bdb0 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.559+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf081ea830 con 0x7fdf0815bdb0 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.559+0000 7fdefea00700 1 -- 172.21.15.82:0/65569866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0001b7e0 con 0x7fdf0815bdb0 2024-05-10T04:50:11.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.559+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf081e9c20 con 0x7fdf0815bdb0 2024-05-10T04:50:11.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.560+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf08074af0 con 0x7fdf0815bdb0 2024-05-10T04:50:11.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.561+0000 7fdefea00700 1 -- 172.21.15.82:0/65569866 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdf0001b940 con 0x7fdf0815bdb0 2024-05-10T04:50:11.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.562+0000 7fdefea00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdee806ac90 0x7fdee806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:11.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.562+0000 7fdefea00700 1 -- 172.21.15.82:0/65569866 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf0008a6a0 con 0x7fdf0815bdb0 2024-05-10T04:50:11.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.562+0000 7fdf06a00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdee806ac90 0x7fdee806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:11.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.563+0000 7fdf06a00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdee806ac90 0x7fdee806d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdef8000f60 tx=0x7fdef8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:11.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.567+0000 7fdefea00700 1 -- 172.21.15.82:0/65569866 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdf00055bc0 con 0x7fdf0815bdb0 2024-05-10T04:50:11.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.812+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf0815e9f0 con 0x7fdf0815bdb0 2024-05-10T04:50:11.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.813+0000 7fdefea00700 1 -- 172.21.15.82:0/65569866 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fdf0001fde0 con 0x7fdf0815bdb0 2024-05-10T04:50:11.814 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:11.815 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-10T04:50:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdee806ac90 msgr2=0x7fdee806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdee806ac90 0x7fdee806d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdef8000f60 tx=0x7fdef8009040 comp rx=0 tx=0).stop 2024-05-10T04:50:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf0815bdb0 msgr2=0x7fdf080b8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf0815bdb0 0x7fdf080b8100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf00012000 tx=0x7fdf00004ad0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 shutdown_connections 2024-05-10T04:50:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdee806ac90 0x7fdee806d1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf0815bdb0 0x7fdf080b8100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdf080ce7a0 0x7fdf081e92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 --2- 172.21.15.82:0/65569866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf080d09d0 0x7fdf0814e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 >> 172.21.15.82:0/65569866 conn(0x7fdf0806c540 msgr2=0x7fdf081610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.815+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 shutdown_connections 2024-05-10T04:50:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:11.816+0000 7fdf07e00700 1 -- 172.21.15.82:0/65569866 wait complete. 2024-05-10T04:50:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-05-10T04:50:11.842 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:12.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.104+0000 7f4299000700 1 Processor -- start 2024-05-10T04:50:12.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.104+0000 7f4299000700 1 -- start start 2024-05-10T04:50:12.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.105+0000 7f4299000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f4294070640 0x7f42940b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.105+0000 7f4299000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940b31c0 0x7f42940cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.105+0000 7f4299000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42940d02d0 0x7f42940cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.105+0000 7f4299000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429406b8e0 con 0x7f42940d02d0 2024-05-10T04:50:12.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.105+0000 7f4299000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429406acd0 con 0x7f4294070640 2024-05-10T04:50:12.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.105+0000 7f4299000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429406afb0 con 0x7f42940b31c0 2024-05-10T04:50:12.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4292800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42940d02d0 0x7f42940cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4292800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f42940d02d0 0x7f42940cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52572/0 (socket says 172.21.15.82:52572) 2024-05-10T04:50:12.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4292800700 1 -- 172.21.15.82:0/1346489008 learned_addr learned my addr 172.21.15.82:0/1346489008 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:12.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4291e00700 1 --2- 172.21.15.82:0/1346489008 >> v2:172.21.15.129:3300/0 conn(0x7f4294070640 0x7f42940b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4291400700 1 --2- 172.21.15.82:0/1346489008 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940b31c0 0x7f42940cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4292800700 1 -- 172.21.15.82:0/1346489008 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940b31c0 msgr2=0x7f42940cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4292800700 1 --2- 172.21.15.82:0/1346489008 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940b31c0 0x7f42940cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4292800700 1 -- 172.21.15.82:0/1346489008 >> v2:172.21.15.129:3300/0 conn(0x7f4294070640 msgr2=0x7f42940b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4292800700 1 --2- 172.21.15.82:0/1346489008 >> v2:172.21.15.129:3300/0 conn(0x7f4294070640 0x7f42940b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.106+0000 7f4292800700 1 -- 172.21.15.82:0/1346489008 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429406b290 con 0x7f42940d02d0 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.107+0000 7f4292800700 1 --2- 172.21.15.82:0/1346489008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940d02d0 0x7f42940cd540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42940b6410 tx=0x7f428c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d097c059f34f91d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.107+0000 7f4290a00700 1 -- 172.21.15.82:0/1346489008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00e070 con 0x7f42940d02d0 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.107+0000 7f4290a00700 1 -- 172.21.15.82:0/1346489008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c00b910 con 0x7f42940d02d0 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.107+0000 7f4290a00700 1 -- 172.21.15.82:0/1346489008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00bcc0 con 0x7f42940d02d0 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 -- 172.21.15.82:0/1346489008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940d02d0 msgr2=0x7f42940cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 --2- 172.21.15.82:0/1346489008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940d02d0 0x7f42940cd540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42940b6410 tx=0x7f428c00b330 comp rx=0 tx=0).stop 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 -- 172.21.15.82:0/1346489008 shutdown_connections 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 --2- 172.21.15.82:0/1346489008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940d02d0 0x7f42940cd540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 --2- 172.21.15.82:0/1346489008 >> v2:172.21.15.129:3300/0 conn(0x7f4294070640 0x7f42940b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 --2- 172.21.15.82:0/1346489008 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940b31c0 0x7f42940cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 -- 172.21.15.82:0/1346489008 >> 172.21.15.82:0/1346489008 conn(0x7f42940b26a0 msgr2=0x7f42940b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 -- 172.21.15.82:0/1346489008 shutdown_connections 2024-05-10T04:50:12.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.108+0000 7f4299000700 1 -- 172.21.15.82:0/1346489008 wait complete. 2024-05-10T04:50:12.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.110+0000 7f4299000700 1 Processor -- start 2024-05-10T04:50:12.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.110+0000 7f4299000700 1 -- start start 2024-05-10T04:50:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4299000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4294070640 0x7f42941500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4299000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940b31c0 0x7f429415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4299000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940d02d0 0x7f42940ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4299000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294151930 con 0x7f42940b31c0 2024-05-10T04:50:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4299000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294160300 con 0x7f4294070640 2024-05-10T04:50:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4299000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4294160040 con 0x7f42940d02d0 2024-05-10T04:50:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4291400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940b31c0 0x7f429415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4291400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940b31c0 0x7f429415fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52584/0 (socket says 172.21.15.82:52584) 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4291400700 1 -- 172.21.15.82:0/356176165 learned_addr learned my addr 172.21.15.82:0/356176165 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4291e00700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4294070640 0x7f42941500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.112+0000 7f4292800700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940d02d0 0x7f42940ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f4291400700 1 -- 172.21.15.82:0/356176165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940d02d0 msgr2=0x7f42940ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f4291400700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940d02d0 0x7f42940ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f4291400700 1 -- 172.21.15.82:0/356176165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4294070640 msgr2=0x7f42941500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f4291400700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4294070640 0x7f42941500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f4291400700 1 -- 172.21.15.82:0/356176165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009b30 con 0x7f42940b31c0 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f4291400700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940b31c0 0x7f429415fb00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f428000e870 tx=0x7f428000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f428a000700 1 -- 172.21.15.82:0/356176165 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280009590 con 0x7f42940b31c0 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f428a000700 1 -- 172.21.15.82:0/356176165 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280013680 con 0x7f42940b31c0 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42940c5df0 con 0x7f42940b31c0 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f428a000700 1 -- 172.21.15.82:0/356176165 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800139f0 con 0x7f42940b31c0 2024-05-10T04:50:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.113+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42940c63b0 con 0x7f42940b31c0 2024-05-10T04:50:12.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.114+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4294074af0 con 0x7f42940b31c0 2024-05-10T04:50:12.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.115+0000 7f428a000700 1 -- 172.21.15.82:0/356176165 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4280013b50 con 0x7f42940b31c0 2024-05-10T04:50:12.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.116+0000 7f428a000700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f427406acc0 0x7f427406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.116+0000 7f428a000700 1 -- 172.21.15.82:0/356176165 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4280088f20 con 0x7f42940b31c0 2024-05-10T04:50:12.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.116+0000 7f4291e00700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f427406acc0 0x7f427406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.117+0000 7f4291e00700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f427406acc0 0x7f427406d1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42940d0b00 tx=0x7f4284009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:12.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.121+0000 7f428a000700 1 -- 172.21.15.82:0/356176165 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4280054320 con 0x7f42940b31c0 2024-05-10T04:50:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.323+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f429406d780 con 0x7f42940b31c0 2024-05-10T04:50:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.324+0000 7f428a000700 1 -- 172.21.15.82:0/356176165 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f4280021090 con 0x7f42940b31c0 2024-05-10T04:50:12.326 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:12.326 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:07.257557+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f427406acc0 msgr2=0x7f427406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f427406acc0 0x7f427406d1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42940d0b00 tx=0x7f4284009210 comp rx=0 tx=0).stop 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940b31c0 msgr2=0x7f429415fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940b31c0 0x7f429415fb00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f428000e870 tx=0x7f428000eb80 comp rx=0 tx=0).stop 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 shutdown_connections 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f427406acc0 0x7f427406d1d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f42940d02d0 0x7f42940ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4294070640 0x7f42941500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 --2- 172.21.15.82:0/356176165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42940b31c0 0x7f429415fb00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 >> 172.21.15.82:0/356176165 conn(0x7f42940b26a0 msgr2=0x7f42940cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 shutdown_connections 2024-05-10T04:50:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.327+0000 7f4299000700 1 -- 172.21.15.82:0/356176165 wait complete. 2024-05-10T04:50:12.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:12.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:12.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.622+0000 7f98fca00700 1 Processor -- start 2024-05-10T04:50:12.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.622+0000 7f98fca00700 1 -- start start 2024-05-10T04:50:12.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.624+0000 7f98fca00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98f80d0cb0 0x7f98f80d2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.624+0000 7f98fca00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f98f80d2a70 0x7f98f80d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.624+0000 7f98fca00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f8161d20 con 0x7f98f80b2f80 2024-05-10T04:50:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.624+0000 7f98fca00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f81625c0 con 0x7f98f80d0cb0 2024-05-10T04:50:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.624+0000 7f98fca00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f815f4f0 con 0x7f98f80d2a70 2024-05-10T04:50:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.624+0000 7f98efe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98f80d0cb0 0x7f98f80d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.624+0000 7f98efe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98f80d0cb0 0x7f98f80d2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52586/0 (socket says 172.21.15.82:52586) 2024-05-10T04:50:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.624+0000 7f98efe00700 1 -- 172.21.15.82:0/3722267015 learned_addr learned my addr 172.21.15.82:0/3722267015 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98f7e00700 1 --2- 172.21.15.82:0/3722267015 >> v2:172.21.15.129:3300/0 conn(0x7f98f80d2a70 0x7f98f80d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98efe00700 1 -- 172.21.15.82:0/3722267015 >> v2:172.21.15.129:3300/0 conn(0x7f98f80d2a70 msgr2=0x7f98f80d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:12.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98efe00700 1 --2- 172.21.15.82:0/3722267015 >> v2:172.21.15.129:3300/0 conn(0x7f98f80d2a70 0x7f98f80d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98efe00700 1 -- 172.21.15.82:0/3722267015 >> v1:172.21.15.129:6789/0 conn(0x7f98f80b2f80 legacy=0x7f98f80d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98efe00700 1 -- 172.21.15.82:0/3722267015 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f8161f70 con 0x7f98f80d0cb0 2024-05-10T04:50:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98f6a00700 1 -- 172.21.15.82:0/3722267015 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174599296 0 0) 0x7f98f8161d20 con 0x7f98f80b2f80 2024-05-10T04:50:12.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98efe00700 1 --2- 172.21.15.82:0/3722267015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d0cb0 0x7f98f80d2530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98f80ce160 tx=0x7f98e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804e25d513f4fc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98f6a00700 1 -- 172.21.15.82:0/3722267015 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0011830 con 0x7f98f80d0cb0 2024-05-10T04:50:12.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98f6a00700 1 -- 172.21.15.82:0/3722267015 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0011990 con 0x7f98f80d0cb0 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.625+0000 7f98f6a00700 1 -- 172.21.15.82:0/3722267015 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0011d20 con 0x7f98f80d0cb0 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.626+0000 7f98fca00700 1 -- 172.21.15.82:0/3722267015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d0cb0 msgr2=0x7f98f80d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.626+0000 7f98fca00700 1 --2- 172.21.15.82:0/3722267015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d0cb0 0x7f98f80d2530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98f80ce160 tx=0x7f98e0009bd0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.626+0000 7f98fca00700 1 -- 172.21.15.82:0/3722267015 shutdown_connections 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.626+0000 7f98fca00700 1 --2- 172.21.15.82:0/3722267015 >> v2:172.21.15.129:3300/0 conn(0x7f98f80d2a70 0x7f98f80d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.626+0000 7f98fca00700 1 --2- 172.21.15.82:0/3722267015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d0cb0 0x7f98f80d2530 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.626+0000 7f98fca00700 1 -- 172.21.15.82:0/3722267015 >> 172.21.15.82:0/3722267015 conn(0x7f98f806c250 msgr2=0x7f98f806c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.626+0000 7f98fca00700 1 -- 172.21.15.82:0/3722267015 shutdown_connections 2024-05-10T04:50:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.626+0000 7f98fca00700 1 -- 172.21.15.82:0/3722267015 wait complete. 2024-05-10T04:50:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.629+0000 7f98fca00700 1 Processor -- start 2024-05-10T04:50:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.629+0000 7f98fca00700 1 -- start start 2024-05-10T04:50:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98fca00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98f80b2f80 0x7f98f80c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98fca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d2a70 0x7f98f8159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98fca00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98f8159540 0x7f98f815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98fca00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80c6fa0 con 0x7f98f80d2a70 2024-05-10T04:50:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98fca00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8154af0 con 0x7f98f80b2f80 2024-05-10T04:50:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98fca00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80b48b0 con 0x7f98f8159540 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98efe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d2a70 0x7f98f8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98efe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d2a70 0x7f98f8159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52596/0 (socket says 172.21.15.82:52596) 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.630+0000 7f98efe00700 1 -- 172.21.15.82:0/3503378298 learned_addr learned my addr 172.21.15.82:0/3503378298 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98f7e00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98f8159540 0x7f98f815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98f7400700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98f80b2f80 0x7f98f80c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98efe00700 1 -- 172.21.15.82:0/3503378298 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98f8159540 msgr2=0x7f98f815c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98efe00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98f8159540 0x7f98f815c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98efe00700 1 -- 172.21.15.82:0/3503378298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98f80b2f80 msgr2=0x7f98f80c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98efe00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98f80b2f80 0x7f98f80c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98efe00700 1 -- 172.21.15.82:0/3503378298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009550 con 0x7f98f80d2a70 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98efe00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d2a70 0x7f98f8159000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009130 tx=0x7f98e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98ef400700 1 -- 172.21.15.82:0/3503378298 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00036a0 con 0x7f98f80d2a70 2024-05-10T04:50:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98ef400700 1 -- 172.21.15.82:0/3503378298 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e001e070 con 0x7f98f80d2a70 2024-05-10T04:50:12.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f8162bd0 con 0x7f98f80d2a70 2024-05-10T04:50:12.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98ef400700 1 -- 172.21.15.82:0/3503378298 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0003a60 con 0x7f98f80d2a70 2024-05-10T04:50:12.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.631+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f80b4b00 con 0x7f98f80d2a70 2024-05-10T04:50:12.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.633+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8074af0 con 0x7f98f80d2a70 2024-05-10T04:50:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.633+0000 7f98ef400700 1 -- 172.21.15.82:0/3503378298 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f98e0003bc0 con 0x7f98f80d2a70 2024-05-10T04:50:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.635+0000 7f98ef400700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98d406ac90 0x7f98d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.635+0000 7f98ef400700 1 -- 172.21.15.82:0/3503378298 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98e0089ed0 con 0x7f98f80d2a70 2024-05-10T04:50:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.635+0000 7f98f7400700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98d406ac90 0x7f98d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:12.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.636+0000 7f98f7400700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98d406ac90 0x7f98d406d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98e8000f60 tx=0x7f98e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:12.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.640+0000 7f98ef400700 1 -- 172.21.15.82:0/3503378298 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f98e0055490 con 0x7f98f80d2a70 2024-05-10T04:50:12.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.841+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98f80d1fe0 con 0x7f98f80d2a70 2024-05-10T04:50:12.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.841+0000 7f98ef400700 1 -- 172.21.15.82:0/3503378298 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98e0058ab0 con 0x7f98f80d2a70 2024-05-10T04:50:12.843 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:12.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98d406ac90 msgr2=0x7f98d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98d406ac90 0x7f98d406d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98e8000f60 tx=0x7f98e8009040 comp rx=0 tx=0).stop 2024-05-10T04:50:12.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d2a70 msgr2=0x7f98f8159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:12.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d2a70 0x7f98f8159000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009130 tx=0x7f98e0004750 comp rx=0 tx=0).stop 2024-05-10T04:50:12.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 shutdown_connections 2024-05-10T04:50:12.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98d406ac90 0x7f98d406d1a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98f8159540 0x7f98f815c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98f80b2f80 0x7f98f80c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 --2- 172.21.15.82:0/3503378298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d2a70 0x7f98f8159000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:12.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 >> 172.21.15.82:0/3503378298 conn(0x7f98f806c250 msgr2=0x7f98f80d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:12.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 shutdown_connections 2024-05-10T04:50:12.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:12.844+0000 7f98fca00700 1 -- 172.21.15.82:0/3503378298 wait complete. 2024-05-10T04:50:12.873 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T04:50:13.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.134+0000 7f258e600700 1 Processor -- start 2024-05-10T04:50:13.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.134+0000 7f258e600700 1 -- start start 2024-05-10T04:50:13.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f258e600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f258806dc60 0x7f258815c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f258e600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25880ceed0 0x7f25880cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f258e600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2588071690 0x7f2588071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f258e600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2588072770 con 0x7f25880ceed0 2024-05-10T04:50:13.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f258e600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25880cea40 con 0x7f258806dc60 2024-05-10T04:50:13.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f258e600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2588071fe0 con 0x7f2588071690 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f2586a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25880ceed0 0x7f25880cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f2586a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f25880ceed0 0x7f25880cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52602/0 (socket says 172.21.15.82:52602) 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f2586a00700 1 -- 172.21.15.82:0/2379621867 learned_addr learned my addr 172.21.15.82:0/2379621867 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f2587e00700 1 --2- 172.21.15.82:0/2379621867 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2588071690 0x7f2588071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.136+0000 7f2587400700 1 --2- 172.21.15.82:0/2379621867 >> v2:172.21.15.129:3300/0 conn(0x7f258806dc60 0x7f258815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586a00700 1 -- 172.21.15.82:0/2379621867 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2588071690 msgr2=0x7f2588071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586a00700 1 --2- 172.21.15.82:0/2379621867 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2588071690 0x7f2588071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586a00700 1 -- 172.21.15.82:0/2379621867 >> v2:172.21.15.129:3300/0 conn(0x7f258806dc60 msgr2=0x7f258815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586a00700 1 --2- 172.21.15.82:0/2379621867 >> v2:172.21.15.129:3300/0 conn(0x7f258806dc60 0x7f258815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586a00700 1 -- 172.21.15.82:0/2379621867 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25880cdb90 con 0x7f25880ceed0 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2587e00700 1 --2- 172.21.15.82:0/2379621867 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2588071690 0x7f2588071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:13.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586a00700 1 --2- 172.21.15.82:0/2379621867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f25880cd650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25880d0930 tx=0x7f2574009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fc3dc91c8962d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:13.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586000700 1 -- 172.21.15.82:0/2379621867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400b870 con 0x7f25880ceed0 2024-05-10T04:50:13.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586000700 1 -- 172.21.15.82:0/2379621867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257400b9d0 con 0x7f25880ceed0 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.137+0000 7f2586000700 1 -- 172.21.15.82:0/2379621867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400bd60 con 0x7f25880ceed0 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 -- 172.21.15.82:0/2379621867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 msgr2=0x7f25880cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 --2- 172.21.15.82:0/2379621867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f25880cd650 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25880d0930 tx=0x7f2574009bd0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 -- 172.21.15.82:0/2379621867 shutdown_connections 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 --2- 172.21.15.82:0/2379621867 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2588071690 0x7f2588071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 --2- 172.21.15.82:0/2379621867 >> v2:172.21.15.129:3300/0 conn(0x7f258806dc60 0x7f258815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 --2- 172.21.15.82:0/2379621867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f25880cd650 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 -- 172.21.15.82:0/2379621867 >> 172.21.15.82:0/2379621867 conn(0x7f25880cfa80 msgr2=0x7f25880cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 -- 172.21.15.82:0/2379621867 shutdown_connections 2024-05-10T04:50:13.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.138+0000 7f258e600700 1 -- 172.21.15.82:0/2379621867 wait complete. 2024-05-10T04:50:13.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.141+0000 7f258e600700 1 Processor -- start 2024-05-10T04:50:13.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.141+0000 7f258e600700 1 -- start start 2024-05-10T04:50:13.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.143+0000 7f258e600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f258806dc60 0x7f258815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.143+0000 7f258e600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2588071690 0x7f258815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.143+0000 7f258e600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f258815e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.143+0000 7f258e600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2588158810 con 0x7f25880ceed0 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.143+0000 7f258e600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2588153160 con 0x7f2588071690 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.143+0000 7f258e600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25881f5a80 con 0x7f258806dc60 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.143+0000 7f2587e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f258815e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f258815e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52604/0 (socket says 172.21.15.82:52604) 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f258806dc60 0x7f258815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587e00700 1 -- 172.21.15.82:0/4162697332 learned_addr learned my addr 172.21.15.82:0/4162697332 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2586a00700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2588071690 0x7f258815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587e00700 1 -- 172.21.15.82:0/4162697332 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f258806dc60 msgr2=0x7f258815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587e00700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f258806dc60 0x7f258815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587e00700 1 -- 172.21.15.82:0/4162697332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2588071690 msgr2=0x7f258815e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587e00700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2588071690 0x7f258815e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587e00700 1 -- 172.21.15.82:0/4162697332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574009550 con 0x7f25880ceed0 2024-05-10T04:50:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f2587e00700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f258815e6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2580007ea0 tx=0x7f258000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.144+0000 7f257f400700 1 -- 172.21.15.82:0/4162697332 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258000dd20 con 0x7f25880ceed0 2024-05-10T04:50:13.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.145+0000 7f257f400700 1 -- 172.21.15.82:0/4162697332 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258000f040 con 0x7f25880ceed0 2024-05-10T04:50:13.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.145+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25881f8070 con 0x7f25880ceed0 2024-05-10T04:50:13.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.145+0000 7f257f400700 1 -- 172.21.15.82:0/4162697332 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580003c60 con 0x7f25880ceed0 2024-05-10T04:50:13.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.145+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25881f8910 con 0x7f25880ceed0 2024-05-10T04:50:13.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.146+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258806f430 con 0x7f25880ceed0 2024-05-10T04:50:13.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.148+0000 7f257f400700 1 -- 172.21.15.82:0/4162697332 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2580004030 con 0x7f25880ceed0 2024-05-10T04:50:13.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.149+0000 7f257f400700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f256806ac90 0x7f256806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.149+0000 7f257f400700 1 -- 172.21.15.82:0/4162697332 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2580089160 con 0x7f25880ceed0 2024-05-10T04:50:13.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.149+0000 7f2587400700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f256806ac90 0x7f256806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.149+0000 7f2587400700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f256806ac90 0x7f256806d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f25780045f0 tx=0x7f2578008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:13.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.153+0000 7f257f400700 1 -- 172.21.15.82:0/4162697332 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f25800545f0 con 0x7f25880ceed0 2024-05-10T04:50:13.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.361+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2588074af0 con 0x7f25880ceed0 2024-05-10T04:50:13.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.362+0000 7f257f400700 1 -- 172.21.15.82:0/4162697332 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f258000dea0 con 0x7f25880ceed0 2024-05-10T04:50:13.363 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:13.364 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-05-10T04:50:13.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:50:13.364 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-05-10T04:50:13.364 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-05-10T04:50:13.364 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:50:13.364 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-05-10T04:50:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f256806ac90 msgr2=0x7f256806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f256806ac90 0x7f256806d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f25780045f0 tx=0x7f2578008040 comp rx=0 tx=0).stop 2024-05-10T04:50:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 msgr2=0x7f258815e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f258815e6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2580007ea0 tx=0x7f258000d3b0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 shutdown_connections 2024-05-10T04:50:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f256806ac90 0x7f256806d1a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25880ceed0 0x7f258815e6f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f258806dc60 0x7f258815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 --2- 172.21.15.82:0/4162697332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2588071690 0x7f258815e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 >> 172.21.15.82:0/4162697332 conn(0x7f25880cfa80 msgr2=0x7f25880b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 shutdown_connections 2024-05-10T04:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.364+0000 7f258e600700 1 -- 172.21.15.82:0/4162697332 wait complete. 2024-05-10T04:50:13.392 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T04:50:13.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T04:50:13.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.657+0000 7fb41b600700 1 Processor -- start 2024-05-10T04:50:13.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.657+0000 7fb41b600700 1 -- start start 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.659+0000 7fb41b600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 0x7fb414161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.659+0000 7fb41b600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb4140b5c10 0x7fb4140b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.659+0000 7fb41b600700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4140b6560 con 0x7fb4140cea50 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.659+0000 7fb41b600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4140cada0 con 0x7fb4140b5c10 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.659+0000 7fb41b600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4141624a0 con 0x7fb41415e5e0 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.659+0000 7fb419600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb4140b5c10 0x7fb4140b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.660+0000 7fb419600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb4140b5c10 0x7fb4140b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:40104/0 (socket says 172.21.15.82:40104) 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.660+0000 7fb419600700 1 -- 172.21.15.82:0/3652391244 learned_addr learned my addr 172.21.15.82:0/3652391244 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:13.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.660+0000 7fb418c00700 1 --2- 172.21.15.82:0/3652391244 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 0x7fb414161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.660+0000 7fb419600700 1 -- 172.21.15.82:0/3652391244 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 msgr2=0x7fb414161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.660+0000 7fb419600700 1 --2- 172.21.15.82:0/3652391244 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 0x7fb414161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.660+0000 7fb419600700 1 -- 172.21.15.82:0/3652391244 >> v1:172.21.15.129:6789/0 conn(0x7fb4140cea50 legacy=0x7fb4140b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.660+0000 7fb419600700 1 -- 172.21.15.82:0/3652391244 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4141626b0 con 0x7fb4140b5c10 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.660+0000 7fb419600700 1 --2- 172.21.15.82:0/3652391244 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140b5c10 0x7fb4140b6020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009e50 tx=0x7fb40c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf47ec5318d1a83 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb413400700 1 -- 172.21.15.82:0/3652391244 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00e070 con 0x7fb4140b5c10 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb413400700 1 -- 172.21.15.82:0/3652391244 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c00b910 con 0x7fb4140b5c10 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb413400700 1 -- 172.21.15.82:0/3652391244 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00bcc0 con 0x7fb4140b5c10 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb41b600700 1 -- 172.21.15.82:0/3652391244 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140b5c10 msgr2=0x7fb4140b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb41b600700 1 --2- 172.21.15.82:0/3652391244 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140b5c10 0x7fb4140b6020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009e50 tx=0x7fb40c00b330 comp rx=0 tx=0).stop 2024-05-10T04:50:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb41b600700 1 -- 172.21.15.82:0/3652391244 shutdown_connections 2024-05-10T04:50:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb41b600700 1 --2- 172.21.15.82:0/3652391244 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140b5c10 0x7fb4140b6020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb41b600700 1 --2- 172.21.15.82:0/3652391244 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 0x7fb414161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb41b600700 1 -- 172.21.15.82:0/3652391244 >> 172.21.15.82:0/3652391244 conn(0x7fb4140d0cd0 msgr2=0x7fb4140d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb41b600700 1 -- 172.21.15.82:0/3652391244 shutdown_connections 2024-05-10T04:50:13.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.661+0000 7fb41b600700 1 -- 172.21.15.82:0/3652391244 wait complete. 2024-05-10T04:50:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.664+0000 7fb41b600700 1 Processor -- start 2024-05-10T04:50:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.664+0000 7fb41b600700 1 -- start start 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.665+0000 7fb41b600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4140b5c10 0x7fb41415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.665+0000 7fb41b600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140cea50 0x7fb4140cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.665+0000 7fb41b600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 0x7fb4140cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.665+0000 7fb41b600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140cbc90 con 0x7fb4140b5c10 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.665+0000 7fb41b600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41415b090 con 0x7fb4140cea50 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.665+0000 7fb41b600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140cb010 con 0x7fb41415e5e0 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.665+0000 7fb418c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4140b5c10 0x7fb41415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb418c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4140b5c10 0x7fb41415a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52606/0 (socket says 172.21.15.82:52606) 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb418c00700 1 -- 172.21.15.82:0/1369395251 learned_addr learned my addr 172.21.15.82:0/1369395251 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb419600700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 0x7fb4140cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb413e00700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140cea50 0x7fb4140cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb418c00700 1 -- 172.21.15.82:0/1369395251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 msgr2=0x7fb4140cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb418c00700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 0x7fb4140cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb418c00700 1 -- 172.21.15.82:0/1369395251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140cea50 msgr2=0x7fb4140cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb418c00700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140cea50 0x7fb4140cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb418c00700 1 -- 172.21.15.82:0/1369395251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c009b30 con 0x7fb4140b5c10 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb418c00700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4140b5c10 0x7fb41415a800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb40800e870 tx=0x7fb40800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb410c00700 1 -- 172.21.15.82:0/1369395251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408009590 con 0x7fb4140b5c10 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb410c00700 1 -- 172.21.15.82:0/1369395251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40800ee70 con 0x7fb4140b5c10 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.666+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4140cb2f0 con 0x7fb4140b5c10 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.667+0000 7fb410c00700 1 -- 172.21.15.82:0/1369395251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40800ca70 con 0x7fb4140b5c10 2024-05-10T04:50:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.667+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4140cb8b0 con 0x7fb4140b5c10 2024-05-10T04:50:13.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.668+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb414074af0 con 0x7fb4140b5c10 2024-05-10T04:50:13.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.668+0000 7fb410c00700 1 -- 172.21.15.82:0/1369395251 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb40800cbd0 con 0x7fb4140b5c10 2024-05-10T04:50:13.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.669+0000 7fb410c00700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3f406acc0 0x7fb3f406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:13.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.669+0000 7fb410c00700 1 -- 172.21.15.82:0/1369395251 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb4080893a0 con 0x7fb4140b5c10 2024-05-10T04:50:13.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.670+0000 7fb413e00700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3f406acc0 0x7fb3f406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:13.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.670+0000 7fb413e00700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3f406acc0 0x7fb3f406d1d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4140cdf00 tx=0x7fb400009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.674+0000 7fb410c00700 1 -- 172.21.15.82:0/1369395251 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb4080547a0 con 0x7fb4140b5c10 2024-05-10T04:50:13.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:13.877+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb4140cbdd0 con 0x7fb4140b5c10 2024-05-10T04:50:14.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.479+0000 7fb410c00700 1 -- 172.21.15.82:0/1369395251 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb4140cbdd0 con 0x7fb4140b5c10 2024-05-10T04:50:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3f406acc0 msgr2=0x7fb3f406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3f406acc0 0x7fb3f406d1d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4140cdf00 tx=0x7fb400009040 comp rx=0 tx=0).stop 2024-05-10T04:50:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4140b5c10 msgr2=0x7fb41415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4140b5c10 0x7fb41415a800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb40800e870 tx=0x7fb40800ec30 comp rx=0 tx=0).stop 2024-05-10T04:50:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 shutdown_connections 2024-05-10T04:50:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3f406acc0 0x7fb3f406d1d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb41415e5e0 0x7fb4140cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4140b5c10 0x7fb41415a800 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 --2- 172.21.15.82:0/1369395251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb4140cea50 0x7fb4140cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.483+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 >> 172.21.15.82:0/1369395251 conn(0x7fb4140d0cd0 msgr2=0x7fb4140b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.484+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 shutdown_connections 2024-05-10T04:50:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.484+0000 7fb41b600700 1 -- 172.21.15.82:0/1369395251 wait complete. 2024-05-10T04:50:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-05-10T04:50:14.516 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T04:50:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.783+0000 7f1114600700 1 Processor -- start 2024-05-10T04:50:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.783+0000 7f1114600700 1 -- start start 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1114600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f110c162c10 0x7f110c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1114600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0d12a0 0x7f110c0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1114600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c15c420 con 0x7f110c0cebe0 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1114600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c15fa20 con 0x7f110c162c10 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1114600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0cf660 con 0x7f110c0d12a0 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1111200700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f110c0cebe0 0x7f110c0d0b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60804/0 (socket says 172.21.15.82:60804) 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1111200700 1 -- 172.21.15.82:0/2599392233 learned_addr learned my addr 172.21.15.82:0/2599392233 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1111c00700 1 --2- 172.21.15.82:0/2599392233 >> v2:172.21.15.129:3300/0 conn(0x7f110c162c10 0x7f110c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1112600700 1 --2- 172.21.15.82:0/2599392233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0d12a0 0x7f110c0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f110be00700 1 -- 172.21.15.82:0/2599392233 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406704968 0 0) 0x7f110c15c420 con 0x7f110c0cebe0 2024-05-10T04:50:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f110be00700 1 -- 172.21.15.82:0/2599392233 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f40035b0 con 0x7f110c0cebe0 2024-05-10T04:50:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1111c00700 1 -- 172.21.15.82:0/2599392233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0d12a0 msgr2=0x7f110c0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1111c00700 1 --2- 172.21.15.82:0/2599392233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0d12a0 0x7f110c0ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1111c00700 1 -- 172.21.15.82:0/2599392233 >> v1:172.21.15.82:6789/0 conn(0x7f110c0cebe0 legacy=0x7f110c0d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.785+0000 7f1111c00700 1 -- 172.21.15.82:0/2599392233 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c162130 con 0x7f110c162c10 2024-05-10T04:50:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.786+0000 7f1111c00700 1 --2- 172.21.15.82:0/2599392233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c162c10 0x7f110c15bee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1100009840 tx=0x7f1100009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70c50c75ee57b807 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.786+0000 7f110be00700 1 -- 172.21.15.82:0/2599392233 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100011830 con 0x7f110c162c10 2024-05-10T04:50:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.786+0000 7f110be00700 1 -- 172.21.15.82:0/2599392233 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100011990 con 0x7f110c162c10 2024-05-10T04:50:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.786+0000 7f110be00700 1 -- 172.21.15.82:0/2599392233 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100011d20 con 0x7f110c162c10 2024-05-10T04:50:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.787+0000 7f1114600700 1 -- 172.21.15.82:0/2599392233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c162c10 msgr2=0x7f110c15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:14.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.787+0000 7f1114600700 1 --2- 172.21.15.82:0/2599392233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c162c10 0x7f110c15bee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1100009840 tx=0x7f1100009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.787+0000 7f1114600700 1 -- 172.21.15.82:0/2599392233 shutdown_connections 2024-05-10T04:50:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.787+0000 7f1114600700 1 --2- 172.21.15.82:0/2599392233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0d12a0 0x7f110c0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.787+0000 7f1114600700 1 --2- 172.21.15.82:0/2599392233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c162c10 0x7f110c15bee0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.787+0000 7f1114600700 1 -- 172.21.15.82:0/2599392233 >> 172.21.15.82:0/2599392233 conn(0x7f110c06c680 msgr2=0x7f110c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.787+0000 7f1114600700 1 -- 172.21.15.82:0/2599392233 shutdown_connections 2024-05-10T04:50:14.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.787+0000 7f1114600700 1 -- 172.21.15.82:0/2599392233 wait complete. 2024-05-10T04:50:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.790+0000 7f1114600700 1 Processor -- start 2024-05-10T04:50:14.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.790+0000 7f1114600700 1 -- start start 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1114600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0cebe0 0x7f110c14c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1114600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f110c162c10 0x7f110c0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1114600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c0d0b90 0x7f110c0d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1114600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c14af20 con 0x7f110c162c10 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1114600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b4be0 con 0x7f110c0d0b90 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1114600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c14cbc0 con 0x7f110c0cebe0 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f110c162c10 0x7f110c0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f110c162c10 0x7f110c0b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52622/0 (socket says 172.21.15.82:52622) 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111200700 1 -- 172.21.15.82:0/463902088 learned_addr learned my addr 172.21.15.82:0/463902088 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111c00700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0cebe0 0x7f110c14c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:14.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1112600700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c0d0b90 0x7f110c0d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111200700 1 -- 172.21.15.82:0/463902088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0cebe0 msgr2=0x7f110c14c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111200700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0cebe0 0x7f110c14c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111200700 1 -- 172.21.15.82:0/463902088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c0d0b90 msgr2=0x7f110c0d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111200700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c0d0b90 0x7f110c0d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.792+0000 7f1111200700 1 -- 172.21.15.82:0/463902088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000094a0 con 0x7f110c162c10 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.793+0000 7f1111200700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f110c162c10 0x7f110c0b42e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005910 tx=0x7f10f800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.793+0000 7f1109600700 1 -- 172.21.15.82:0/463902088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8005d70 con 0x7f110c162c10 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.793+0000 7f1109600700 1 -- 172.21.15.82:0/463902088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f800ce80 con 0x7f110c162c10 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.793+0000 7f1109600700 1 -- 172.21.15.82:0/463902088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80072f0 con 0x7f110c162c10 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.793+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c0d14e0 con 0x7f110c162c10 2024-05-10T04:50:14.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.793+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0b4e30 con 0x7f110c162c10 2024-05-10T04:50:14.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.794+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c06cf80 con 0x7f110c162c10 2024-05-10T04:50:14.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.795+0000 7f1109600700 1 -- 172.21.15.82:0/463902088 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10f8007450 con 0x7f110c162c10 2024-05-10T04:50:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.797+0000 7f1109600700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f10ec06acc0 0x7f10ec06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.797+0000 7f1109600700 1 -- 172.21.15.82:0/463902088 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f10f8088630 con 0x7f110c162c10 2024-05-10T04:50:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.797+0000 7f1111c00700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f10ec06acc0 0x7f10ec06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:14.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.798+0000 7f1111c00700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f10ec06acc0 0x7f10ec06d1d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1100009840 tx=0x7f1100008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:14.802+0000 7f1109600700 1 -- 172.21.15.82:0/463902088 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f10f80538c0 con 0x7f110c162c10 2024-05-10T04:50:15.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.004+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f110c074af0 con 0x7f110c162c10 2024-05-10T04:50:15.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.488+0000 7f1109600700 1 -- 172.21.15.82:0/463902088 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f10f80170d0 con 0x7f110c162c10 2024-05-10T04:50:15.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.493+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f10ec06acc0 msgr2=0x7f10ec06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:15.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.493+0000 7f1114600700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f10ec06acc0 0x7f10ec06d1d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1100009840 tx=0x7f1100008030 comp rx=0 tx=0).stop 2024-05-10T04:50:15.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.493+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f110c162c10 msgr2=0x7f110c0b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:15.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.493+0000 7f1114600700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f110c162c10 0x7f110c0b42e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005910 tx=0x7f10f800c7b0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.495+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 shutdown_connections 2024-05-10T04:50:15.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.495+0000 7f1114600700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f10ec06acc0 0x7f10ec06d1d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.495+0000 7f1114600700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f110c0d0b90 0x7f110c0d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.495+0000 7f1114600700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f110c0cebe0 0x7f110c14c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.495+0000 7f1114600700 1 --2- 172.21.15.82:0/463902088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f110c162c10 0x7f110c0b42e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.495+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 >> 172.21.15.82:0/463902088 conn(0x7f110c06c680 msgr2=0x7f110c15d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:15.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.497+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 shutdown_connections 2024-05-10T04:50:15.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.497+0000 7f1114600700 1 -- 172.21.15.82:0/463902088 wait complete. 2024-05-10T04:50:15.502 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-05-10T04:50:15.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T04:50:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.802+0000 7f81a5e00700 1 Processor -- start 2024-05-10T04:50:15.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.802+0000 7f81a5e00700 1 -- start start 2024-05-10T04:50:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f81a5e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a0162150 0x7f81a015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f81a5e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81a00cf4d0 0x7f81a00b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f81a5e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a00d2c00 con 0x7f81a00b7910 2024-05-10T04:50:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f81a5e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a0162630 con 0x7f81a00cf4d0 2024-05-10T04:50:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f81a5e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a0162910 con 0x7f81a0162150 2024-05-10T04:50:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f819e000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81a00cf4d0 0x7f81a00b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f819e000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81a00cf4d0 0x7f81a00b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55820/0 (socket says 172.21.15.82:55820) 2024-05-10T04:50:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f819e000700 1 -- 172.21.15.82:0/4056589064 learned_addr learned my addr 172.21.15.82:0/4056589064 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.804+0000 7f819ea00700 1 --2- 172.21.15.82:0/4056589064 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a0162150 0x7f81a015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.805+0000 7f819e000700 1 -- 172.21.15.82:0/4056589064 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a0162150 msgr2=0x7f81a015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.805+0000 7f819e000700 1 --2- 172.21.15.82:0/4056589064 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a0162150 0x7f81a015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.805+0000 7f819e000700 1 -- 172.21.15.82:0/4056589064 >> v1:172.21.15.129:6789/0 conn(0x7f81a00b7910 legacy=0x7f81a006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.805+0000 7f819e000700 1 -- 172.21.15.82:0/4056589064 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a0162bf0 con 0x7f81a00cf4d0 2024-05-10T04:50:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.805+0000 7f819e000700 1 --2- 172.21.15.82:0/4056589064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00cf4d0 0x7f81a00b73d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f818c0098f0 tx=0x7f818c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b0f720e99f648b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.805+0000 7f819d600700 1 -- 172.21.15.82:0/4056589064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c011830 con 0x7f81a00cf4d0 2024-05-10T04:50:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.805+0000 7f819d600700 1 -- 172.21.15.82:0/4056589064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c011990 con 0x7f81a00cf4d0 2024-05-10T04:50:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.805+0000 7f819d600700 1 -- 172.21.15.82:0/4056589064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c011d20 con 0x7f81a00cf4d0 2024-05-10T04:50:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.806+0000 7f81a5e00700 1 -- 172.21.15.82:0/4056589064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00cf4d0 msgr2=0x7f81a00b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.806+0000 7f81a5e00700 1 --2- 172.21.15.82:0/4056589064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00cf4d0 0x7f81a00b73d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f818c0098f0 tx=0x7f818c009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.806+0000 7f81a5e00700 1 -- 172.21.15.82:0/4056589064 shutdown_connections 2024-05-10T04:50:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.806+0000 7f81a5e00700 1 --2- 172.21.15.82:0/4056589064 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a0162150 0x7f81a015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.806+0000 7f81a5e00700 1 --2- 172.21.15.82:0/4056589064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a00cf4d0 0x7f81a00b73d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.806+0000 7f81a5e00700 1 -- 172.21.15.82:0/4056589064 >> 172.21.15.82:0/4056589064 conn(0x7f81a00d3e10 msgr2=0x7f81a00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.806+0000 7f81a5e00700 1 -- 172.21.15.82:0/4056589064 shutdown_connections 2024-05-10T04:50:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.806+0000 7f81a5e00700 1 -- 172.21.15.82:0/4056589064 wait complete. 2024-05-10T04:50:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.808+0000 7f81a5e00700 1 Processor -- start 2024-05-10T04:50:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.808+0000 7f81a5e00700 1 -- start start 2024-05-10T04:50:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f81a5e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a00b7910 0x7f81a01f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f81a5e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81a00cf4d0 0x7f81a014b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f81a5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a0162150 0x7f81a00c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f81a5e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a01f7d70 con 0x7f81a0162150 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f81a5e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00c7270 con 0x7f81a00cf4d0 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f81a5e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a01f5a70 con 0x7f81a00b7910 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f819f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a0162150 0x7f81a00c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f819f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a0162150 0x7f81a00c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55828/0 (socket says 172.21.15.82:55828) 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f819f400700 1 -- 172.21.15.82:0/3638152941 learned_addr learned my addr 172.21.15.82:0/3638152941 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f819e000700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81a00cf4d0 0x7f81a014b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.810+0000 7f819ea00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a00b7910 0x7f81a01f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f819f400700 1 -- 172.21.15.82:0/3638152941 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a00b7910 msgr2=0x7f81a01f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f819f400700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a00b7910 0x7f81a01f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f819f400700 1 -- 172.21.15.82:0/3638152941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81a00cf4d0 msgr2=0x7f81a014b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f819f400700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81a00cf4d0 0x7f81a014b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f819f400700 1 -- 172.21.15.82:0/3638152941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c009550 con 0x7f81a0162150 2024-05-10T04:50:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f819f400700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a0162150 0x7f81a00c7db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f819800cb50 tx=0x7f819800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f8197400700 1 -- 172.21.15.82:0/3638152941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198003c00 con 0x7f81a0162150 2024-05-10T04:50:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f8197400700 1 -- 172.21.15.82:0/3638152941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198003d60 con 0x7f81a0162150 2024-05-10T04:50:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a00c74c0 con 0x7f81a0162150 2024-05-10T04:50:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f8197400700 1 -- 172.21.15.82:0/3638152941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800aa20 con 0x7f81a0162150 2024-05-10T04:50:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.811+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a01f5f50 con 0x7f81a0162150 2024-05-10T04:50:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.812+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a0074af0 con 0x7f81a0162150 2024-05-10T04:50:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.814+0000 7f8197400700 1 -- 172.21.15.82:0/3638152941 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f819800ab80 con 0x7f81a0162150 2024-05-10T04:50:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.815+0000 7f8197400700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f818006ac90 0x7f818006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.815+0000 7f8197400700 1 -- 172.21.15.82:0/3638152941 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f81980893a0 con 0x7f81a0162150 2024-05-10T04:50:15.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.815+0000 7f819ea00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f818006ac90 0x7f818006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.816+0000 7f819ea00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f818006ac90 0x7f818006d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f81a00d1920 tx=0x7f8190009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:15.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:15.820+0000 7f8197400700 1 -- 172.21.15.82:0/3638152941 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8198054550 con 0x7f81a0162150 2024-05-10T04:50:16.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.067+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f81a0161ec0 con 0x7f81a0162150 2024-05-10T04:50:16.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.076+0000 7f8197400700 1 -- 172.21.15.82:0/3638152941 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8198057b70 con 0x7f81a0162150 2024-05-10T04:50:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.082+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f818006ac90 msgr2=0x7f818006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.082+0000 7f81a5e00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f818006ac90 0x7f818006d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f81a00d1920 tx=0x7f8190009210 comp rx=0 tx=0).stop 2024-05-10T04:50:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.082+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a0162150 msgr2=0x7f81a00c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.082+0000 7f81a5e00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a0162150 0x7f81a00c7db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f819800cb50 tx=0x7f819800ce60 comp rx=0 tx=0).stop 2024-05-10T04:50:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.083+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 shutdown_connections 2024-05-10T04:50:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.083+0000 7f81a5e00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f818006ac90 0x7f818006d1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.083+0000 7f81a5e00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81a0162150 0x7f81a00c7db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.083+0000 7f81a5e00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f81a00b7910 0x7f81a01f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.083+0000 7f81a5e00700 1 --2- 172.21.15.82:0/3638152941 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f81a00cf4d0 0x7f81a014b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.083+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 >> 172.21.15.82:0/3638152941 conn(0x7f81a00d3e10 msgr2=0x7f81a00b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:16.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.084+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 shutdown_connections 2024-05-10T04:50:16.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.086+0000 7f81a5e00700 1 -- 172.21.15.82:0/3638152941 wait complete. 2024-05-10T04:50:16.089 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2024-05-10T04:50:16.125 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:16.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.388+0000 7f40fda00700 1 Processor -- start 2024-05-10T04:50:16.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.388+0000 7f40fda00700 1 -- start start 2024-05-10T04:50:16.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.390+0000 7f40fda00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40f80d2e60 0x7f40f81693d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.390+0000 7f40fda00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f81627a0 con 0x7f40f80b60b0 2024-05-10T04:50:16.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.390+0000 7f40fda00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f815f4e0 con 0x7f40f8162c30 2024-05-10T04:50:16.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.390+0000 7f40fda00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f8163040 con 0x7f40f80d2e60 2024-05-10T04:50:16.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.390+0000 7f40efe00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f40f80b60b0 0x7f40f80d2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43182/0 (socket says 172.21.15.82:43182) 2024-05-10T04:50:16.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.390+0000 7f40efe00700 1 -- 172.21.15.82:0/2903715282 learned_addr learned my addr 172.21.15.82:0/2903715282 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.390+0000 7f40f7400700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40f80d2e60 0x7f40f81693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647179685 0 0) 0x7f40f81627a0 con 0x7f40f80b60b0 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40dc0035b0 con 0x7f40f80b60b0 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985360089 0 0) 0x7f40f815f4e0 con 0x7f40f8162c30 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f81627a0 con 0x7f40f8162c30 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3078517057 0 0) 0x7f40dc0035b0 con 0x7f40f80b60b0 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40f80d2e60 msgr2=0x7f40f81693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40f80d2e60 0x7f40f81693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 >> v1:172.21.15.129:6789/0 conn(0x7f40f8162c30 legacy=0x7f40f80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f815fa20 con 0x7f40f80b60b0 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f40e0001670 con 0x7f40f80b60b0 2024-05-10T04:50:16.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 >> v1:172.21.15.82:6789/0 conn(0x7f40f80b60b0 legacy=0x7f40f80d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc003bc0 0x7f40dc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40f80d2e60 0x7f40dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40dc004d90 0x7f40dc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc00bb40 con 0x7f40dc003bc0 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc00bcb0 con 0x7f40dc004d90 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc00be70 con 0x7f40f80d2e60 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.391+0000 7f40f6a00700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc003bc0 0x7f40dc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40efe00700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40f80d2e60 0x7f40dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f7400700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40dc004d90 0x7f40dc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6a00700 1 -- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40f80d2e60 msgr2=0x7f40dc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6a00700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40f80d2e60 0x7f40dc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6a00700 1 -- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40dc004d90 msgr2=0x7f40dc0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6a00700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40dc004d90 0x7f40dc0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6a00700 1 -- 172.21.15.82:0/2903715282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc0035b0 con 0x7f40dc003bc0 2024-05-10T04:50:16.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f7400700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40dc004d90 0x7f40dc0051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:16.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6a00700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc003bc0 0x7f40dc004030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f40e8001940 tx=0x7f40dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0ee7c5a8e9ad9e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:16.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8001430 con 0x7f40dc003bc0 2024-05-10T04:50:16.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e80050d0 con 0x7f40dc003bc0 2024-05-10T04:50:16.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.392+0000 7f40f6000700 1 -- 172.21.15.82:0/2903715282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8005480 con 0x7f40dc003bc0 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.393+0000 7f40fda00700 1 -- 172.21.15.82:0/2903715282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc003bc0 msgr2=0x7f40dc004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.393+0000 7f40fda00700 1 --2- 172.21.15.82:0/2903715282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc003bc0 0x7f40dc004030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f40e8001940 tx=0x7f40dc005880 comp rx=0 tx=0).stop 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.393+0000 7f40f7400700 1 -- 172.21.15.82:0/2903715282 reap_dead start 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.393+0000 7f40fda00700 1 -- 172.21.15.82:0/2903715282 shutdown_connections 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.393+0000 7f40fda00700 1 -- 172.21.15.82:0/2903715282 >> 172.21.15.82:0/2903715282 conn(0x7f40f80d0b80 msgr2=0x7f40f80d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.393+0000 7f40fda00700 1 -- 172.21.15.82:0/2903715282 shutdown_connections 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.393+0000 7f40fda00700 1 -- 172.21.15.82:0/2903715282 wait complete. 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.395+0000 7f40fda00700 1 Processor -- start 2024-05-10T04:50:16.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.396+0000 7f40fda00700 1 -- start start 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40fda00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40dc003bc0 0x7f40f80cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40fda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40f80ccbe0 0x7f40f80c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40fda00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40f81f43e0 0x7f40f81f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40fda00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f81f5300 con 0x7f40f80ccbe0 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40fda00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80cb8f0 con 0x7f40f81f43e0 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40fda00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80cbb40 con 0x7f40dc003bc0 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40efe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40f80ccbe0 0x7f40f80c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40efe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40f80ccbe0 0x7f40f80c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55840/0 (socket says 172.21.15.82:55840) 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40efe00700 1 -- 172.21.15.82:0/1898744779 learned_addr learned my addr 172.21.15.82:0/1898744779 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40f6a00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40dc003bc0 0x7f40f80cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.397+0000 7f40f7400700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40f81f43e0 0x7f40f81f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40efe00700 1 -- 172.21.15.82:0/1898744779 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40dc003bc0 msgr2=0x7f40f80cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40efe00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40dc003bc0 0x7f40f80cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40efe00700 1 -- 172.21.15.82:0/1898744779 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40f81f43e0 msgr2=0x7f40f81f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40efe00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40f81f43e0 0x7f40f81f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40efe00700 1 -- 172.21.15.82:0/1898744779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80cbe20 con 0x7f40f80ccbe0 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40efe00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40f80ccbe0 0x7f40f80c69e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f40e000e800 tx=0x7f40e000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40eea00700 1 -- 172.21.15.82:0/1898744779 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0012590 con 0x7f40f80ccbe0 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40eea00700 1 -- 172.21.15.82:0/1898744779 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00126f0 con 0x7f40f80ccbe0 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f80cc100 con 0x7f40f80ccbe0 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40eea00700 1 -- 172.21.15.82:0/1898744779 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0012aa0 con 0x7f40f80ccbe0 2024-05-10T04:50:16.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.398+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f80cc6c0 con 0x7f40f80ccbe0 2024-05-10T04:50:16.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.399+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f80732b0 con 0x7f40f80ccbe0 2024-05-10T04:50:16.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.400+0000 7f40eea00700 1 -- 172.21.15.82:0/1898744779 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40e0012c00 con 0x7f40f80ccbe0 2024-05-10T04:50:16.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.401+0000 7f40eea00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40d406ac90 0x7f40d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.401+0000 7f40eea00700 1 -- 172.21.15.82:0/1898744779 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40e0089170 con 0x7f40f80ccbe0 2024-05-10T04:50:16.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.402+0000 7f40f6a00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40d406ac90 0x7f40d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.402+0000 7f40f6a00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40d406ac90 0x7f40d406d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40e8000c00 tx=0x7f40e800a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:16.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.406+0000 7f40eea00700 1 -- 172.21.15.82:0/1898744779 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f40e0054220 con 0x7f40f80ccbe0 2024-05-10T04:50:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.618+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40f8074af0 con 0x7f40f80ccbe0 2024-05-10T04:50:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.619+0000 7f40eea00700 1 -- 172.21.15.82:0/1898744779 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16050 (secure 0 0 0) 0x7f40e0057840 con 0x7f40f80ccbe0 2024-05-10T04:50:16.620 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:16.620 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:16.068078+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40d406ac90 msgr2=0x7f40d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40d406ac90 0x7f40d406d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40e8000c00 tx=0x7f40e800a000 comp rx=0 tx=0).stop 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40f80ccbe0 msgr2=0x7f40f80c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40f80ccbe0 0x7f40f80c69e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f40e000e800 tx=0x7f40e000eb10 comp rx=0 tx=0).stop 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 shutdown_connections 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40d406ac90 0x7f40d406d1a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40f81f43e0 0x7f40f81f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40dc003bc0 0x7f40f80cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 --2- 172.21.15.82:0/1898744779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40f80ccbe0 0x7f40f80c69e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 >> 172.21.15.82:0/1898744779 conn(0x7f40f80d0b80 msgr2=0x7f40f81609f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 shutdown_connections 2024-05-10T04:50:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.621+0000 7f40fda00700 1 -- 172.21.15.82:0/1898744779 wait complete. 2024-05-10T04:50:16.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.907+0000 7f18b9a00700 1 Processor -- start 2024-05-10T04:50:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.907+0000 7f18b9a00700 1 -- start start 2024-05-10T04:50:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b9a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f18b40b6020 0x7f18b40d3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b9a00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b4162ef0 con 0x7f18b40d3060 2024-05-10T04:50:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b9a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b41626d0 con 0x7f18b40b9500 2024-05-10T04:50:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b9a00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b4162930 con 0x7f18b40b6020 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b2000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f18b40d3060 0x7f18b40b5910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43198/0 (socket says 172.21.15.82:43198) 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b2000700 1 -- 172.21.15.82:0/3231808906 learned_addr learned my addr 172.21.15.82:0/3231808906 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b3400700 1 --2- 172.21.15.82:0/3231808906 >> v2:172.21.15.129:3300/0 conn(0x7f18b40b6020 0x7f18b40d3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b1600700 1 -- 172.21.15.82:0/3231808906 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922150712 0 0) 0x7f18b4162ef0 con 0x7f18b40d3060 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.909+0000 7f18b1600700 1 -- 172.21.15.82:0/3231808906 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18980035b0 con 0x7f18b40d3060 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.910+0000 7f18b3400700 1 -- 172.21.15.82:0/3231808906 >> v1:172.21.15.129:6789/0 conn(0x7f18b40b9500 legacy=0x7f18b4161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.910+0000 7f18b3400700 1 -- 172.21.15.82:0/3231808906 >> v1:172.21.15.82:6789/0 conn(0x7f18b40d3060 legacy=0x7f18b40b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.910+0000 7f18b1600700 1 -- 172.21.15.82:0/3231808906 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1849128400 0 0) 0x7f18980035b0 con 0x7f18b40d3060 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.910+0000 7f18b3400700 1 -- 172.21.15.82:0/3231808906 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4162c10 con 0x7f18b40b6020 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.910+0000 7f18b3400700 1 --2- 172.21.15.82:0/3231808906 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b40b6020 0x7f18b40d3470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009d90 tx=0x7f18ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8335b39668984d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.910+0000 7f18b1600700 1 -- 172.21.15.82:0/3231808906 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00e070 con 0x7f18b40b6020 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.910+0000 7f18b1600700 1 -- 172.21.15.82:0/3231808906 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac003a20 con 0x7f18b40b6020 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.910+0000 7f18b1600700 1 -- 172.21.15.82:0/3231808906 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0001670 con 0x7f18b40b6020 2024-05-10T04:50:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.911+0000 7f18b9a00700 1 -- 172.21.15.82:0/3231808906 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b40b6020 msgr2=0x7f18b40d3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.911+0000 7f18b9a00700 1 --2- 172.21.15.82:0/3231808906 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b40b6020 0x7f18b40d3470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009d90 tx=0x7f18ac00b330 comp rx=0 tx=0).stop 2024-05-10T04:50:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.911+0000 7f18b9a00700 1 -- 172.21.15.82:0/3231808906 shutdown_connections 2024-05-10T04:50:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.911+0000 7f18b9a00700 1 --2- 172.21.15.82:0/3231808906 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b40b6020 0x7f18b40d3470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.911+0000 7f18b9a00700 1 -- 172.21.15.82:0/3231808906 >> 172.21.15.82:0/3231808906 conn(0x7f18b40d0af0 msgr2=0x7f18b40d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.911+0000 7f18b9a00700 1 -- 172.21.15.82:0/3231808906 shutdown_connections 2024-05-10T04:50:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.911+0000 7f18b9a00700 1 -- 172.21.15.82:0/3231808906 wait complete. 2024-05-10T04:50:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.913+0000 7f18b9a00700 1 Processor -- start 2024-05-10T04:50:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.913+0000 7f18b9a00700 1 -- start start 2024-05-10T04:50:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b9a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b40b9500 0x7f18b40b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b9a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18b40d3060 0x7f18b40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b9a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b4152380 0x7f18b4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b9a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4153b10 con 0x7f18b40b9500 2024-05-10T04:50:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b9a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40b0a00 con 0x7f18b4152380 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b9a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40b1860 con 0x7f18b40d3060 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b40b9500 0x7f18b40b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b40b9500 0x7f18b40b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55856/0 (socket says 172.21.15.82:55856) 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b2a00700 1 -- 172.21.15.82:0/385896817 learned_addr learned my addr 172.21.15.82:0/385896817 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b2000700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18b40d3060 0x7f18b40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b3400700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b4152380 0x7f18b4152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b2a00700 1 -- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18b40d3060 msgr2=0x7f18b40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b2a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18b40d3060 0x7f18b40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b2a00700 1 -- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b4152380 msgr2=0x7f18b4152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.915+0000 7f18b2a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b4152380 0x7f18b4152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.916+0000 7f18b2a00700 1 -- 172.21.15.82:0/385896817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac009a70 con 0x7f18b40b9500 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.916+0000 7f18b3400700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b4152380 0x7f18b4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.916+0000 7f18b2a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b40b9500 0x7f18b40b2480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18a400c500 tx=0x7f18a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.916+0000 7f18aaa00700 1 -- 172.21.15.82:0/385896817 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a40052d0 con 0x7f18b40b9500 2024-05-10T04:50:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.916+0000 7f18aaa00700 1 -- 172.21.15.82:0/385896817 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4005430 con 0x7f18b40b9500 2024-05-10T04:50:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.916+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b40b0c50 con 0x7f18b40b9500 2024-05-10T04:50:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.916+0000 7f18aaa00700 1 -- 172.21.15.82:0/385896817 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4003880 con 0x7f18b40b9500 2024-05-10T04:50:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.916+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b40b1210 con 0x7f18b40b9500 2024-05-10T04:50:16.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.917+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b40732b0 con 0x7f18b40b9500 2024-05-10T04:50:16.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.918+0000 7f18aaa00700 1 -- 172.21.15.82:0/385896817 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18a40039e0 con 0x7f18b40b9500 2024-05-10T04:50:16.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.919+0000 7f18aaa00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f189406ac90 0x7f189406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:16.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.919+0000 7f18aaa00700 1 -- 172.21.15.82:0/385896817 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18a40887a0 con 0x7f18b40b9500 2024-05-10T04:50:16.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.919+0000 7f18b2000700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f189406ac90 0x7f189406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:16.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.920+0000 7f18b2000700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f189406ac90 0x7f189406d1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f18b40cd4a0 tx=0x7f18a0001bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:16.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:16.923+0000 7f18aaa00700 1 -- 172.21.15.82:0/385896817 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f18a4053a20 con 0x7f18b40b9500 2024-05-10T04:50:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.135+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b4074af0 con 0x7f18b40b9500 2024-05-10T04:50:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.136+0000 7f18aaa00700 1 -- 172.21.15.82:0/385896817 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f18a4057040 con 0x7f18b40b9500 2024-05-10T04:50:17.137 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:17.137 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f189406ac90 msgr2=0x7f189406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f189406ac90 0x7f189406d1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f18b40cd4a0 tx=0x7f18a0001bc0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b40b9500 msgr2=0x7f18b40b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b40b9500 0x7f18b40b2480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18a400c500 tx=0x7f18a400c8c0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 shutdown_connections 2024-05-10T04:50:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f189406ac90 0x7f189406d1a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f18b4152380 0x7f18b4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b40b9500 0x7f18b40b2480 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 --2- 172.21.15.82:0/385896817 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18b40d3060 0x7f18b40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 >> 172.21.15.82:0/385896817 conn(0x7f18b40d0af0 msgr2=0x7f18b40b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.138+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 shutdown_connections 2024-05-10T04:50:17.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.139+0000 7f18b9a00700 1 -- 172.21.15.82:0/385896817 wait complete. 2024-05-10T04:50:17.165 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T04:50:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.432+0000 7ff5cb200700 1 Processor -- start 2024-05-10T04:50:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.432+0000 7ff5cb200700 1 -- start start 2024-05-10T04:50:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.434+0000 7ff5cb200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff5c4162150 0x7ff5c415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.434+0000 7ff5cb200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c40d2c00 con 0x7ff5c40cf4d0 2024-05-10T04:50:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.434+0000 7ff5cb200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c4162630 con 0x7ff5c406c160 2024-05-10T04:50:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.434+0000 7ff5cb200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c4162910 con 0x7ff5c4162150 2024-05-10T04:50:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.434+0000 7ff5c3400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff5c40cf4d0 0x7ff5c40b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43206/0 (socket says 172.21.15.82:43206) 2024-05-10T04:50:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.434+0000 7ff5c3400700 1 -- 172.21.15.82:0/2852167204 learned_addr learned my addr 172.21.15.82:0/2852167204 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.434+0000 7ff5c3e00700 1 --2- 172.21.15.82:0/2852167204 >> v2:172.21.15.129:3300/0 conn(0x7ff5c4162150 0x7ff5c415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213396952 0 0) 0x7ff5c40d2c00 con 0x7ff5c40cf4d0 2024-05-10T04:50:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a80035b0 con 0x7ff5c40cf4d0 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 439844432 0 0) 0x7ff5a80035b0 con 0x7ff5c40cf4d0 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 >> v2:172.21.15.129:3300/0 conn(0x7ff5c4162150 msgr2=0x7ff5c415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 --2- 172.21.15.82:0/2852167204 >> v2:172.21.15.129:3300/0 conn(0x7ff5c4162150 0x7ff5c415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 >> v1:172.21.15.129:6789/0 conn(0x7ff5c406c160 legacy=0x7ff5c406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c4162bf0 con 0x7ff5c40cf4d0 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7ff5b0001670 con 0x7ff5c40cf4d0 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 >> v1:172.21.15.82:6789/0 conn(0x7ff5c40cf4d0 legacy=0x7ff5c40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5a8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5a8004850 0x7ff5a8004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5a80053a0 0x7ff5a800ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4162910 con 0x7ff5a8003a50 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a800c330 con 0x7ff5a80053a0 2024-05-10T04:50:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a800c4f0 con 0x7ff5a8004850 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.435+0000 7ff5c3e00700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5a8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c3400700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5a8004850 0x7ff5a8004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c9200700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5a80053a0 0x7ff5a800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c3e00700 1 -- 172.21.15.82:0/2852167204 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5a8004850 msgr2=0x7ff5a8004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c3e00700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5a8004850 0x7ff5a8004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c3e00700 1 -- 172.21.15.82:0/2852167204 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5a80053a0 msgr2=0x7ff5a800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c3e00700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5a80053a0 0x7ff5a800ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c3e00700 1 -- 172.21.15.82:0/2852167204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80035b0 con 0x7ff5a8003a50 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c9200700 1 -- 172.21.15.82:0/2852167204 reap_dead start 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c3e00700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5a8003ec0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009b30 tx=0x7ff5a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a7184e7bbe7c22 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400e6c0 con 0x7ff5a8003a50 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b400e820 con 0x7ff5a8003a50 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.436+0000 7ff5c2a00700 1 -- 172.21.15.82:0/2852167204 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400eb90 con 0x7ff5a8003a50 2024-05-10T04:50:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.437+0000 7ff5cb200700 1 -- 172.21.15.82:0/2852167204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 msgr2=0x7ff5a8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.437+0000 7ff5cb200700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5a8003ec0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009b30 tx=0x7ff5a8005880 comp rx=0 tx=0).stop 2024-05-10T04:50:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.437+0000 7ff5cb200700 1 -- 172.21.15.82:0/2852167204 shutdown_connections 2024-05-10T04:50:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.437+0000 7ff5cb200700 1 --2- 172.21.15.82:0/2852167204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5a8003ec0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.437+0000 7ff5cb200700 1 -- 172.21.15.82:0/2852167204 >> 172.21.15.82:0/2852167204 conn(0x7ff5c40d3e10 msgr2=0x7ff5c40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.437+0000 7ff5cb200700 1 -- 172.21.15.82:0/2852167204 shutdown_connections 2024-05-10T04:50:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.437+0000 7ff5cb200700 1 -- 172.21.15.82:0/2852167204 wait complete. 2024-05-10T04:50:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.439+0000 7ff5cb200700 1 Processor -- start 2024-05-10T04:50:17.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.440+0000 7ff5cb200700 1 -- start start 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5cb200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5c4148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5cb200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5c4157e90 0x7ff5c41582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5cb200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5c40b58e0 0x7ff5c40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5cb200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c41f8c60 con 0x7ff5a8003a50 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5cb200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c415b910 con 0x7ff5c4157e90 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5cb200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4158930 con 0x7ff5c40b58e0 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5c3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5c4148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5c3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5c4148f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55882/0 (socket says 172.21.15.82:55882) 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5c3e00700 1 -- 172.21.15.82:0/1189818804 learned_addr learned my addr 172.21.15.82:0/1189818804 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5c3400700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5c4157e90 0x7ff5c41582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.441+0000 7ff5c9200700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5c40b58e0 0x7ff5c40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5c3e00700 1 -- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5c40b58e0 msgr2=0x7ff5c40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5c3e00700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5c40b58e0 0x7ff5c40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5c3e00700 1 -- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5c4157e90 msgr2=0x7ff5c41582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5c3e00700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5c4157e90 0x7ff5c41582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5c3e00700 1 -- 172.21.15.82:0/1189818804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40b6230 con 0x7ff5a8003a50 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5c9200700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5c40b58e0 0x7ff5c40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5c3400700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5c4157e90 0x7ff5c41582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5c3e00700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5c4148f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800c300 tx=0x7ff5b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5bbe00700 1 -- 172.21.15.82:0/1189818804 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400e6c0 con 0x7ff5a8003a50 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5bbe00700 1 -- 172.21.15.82:0/1189818804 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b4013c00 con 0x7ff5a8003a50 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c41f8020 con 0x7ff5a8003a50 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5bbe00700 1 -- 172.21.15.82:0/1189818804 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b401c450 con 0x7ff5a8003a50 2024-05-10T04:50:17.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.442+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c41f85a0 con 0x7ff5a8003a50 2024-05-10T04:50:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.443+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c4074af0 con 0x7ff5a8003a50 2024-05-10T04:50:17.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.444+0000 7ff5bbe00700 1 -- 172.21.15.82:0/1189818804 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff5b4024070 con 0x7ff5a8003a50 2024-05-10T04:50:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.445+0000 7ff5bbe00700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff5a406acc0 0x7ff5a406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.445+0000 7ff5bbe00700 1 -- 172.21.15.82:0/1189818804 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5b408aaf0 con 0x7ff5a8003a50 2024-05-10T04:50:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.446+0000 7ff5c3400700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff5a406acc0 0x7ff5a406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.446+0000 7ff5c3400700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff5a406acc0 0x7ff5a406d1d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40b42f0 tx=0x7ff5b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:17.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.450+0000 7ff5bbe00700 1 -- 172.21.15.82:0/1189818804 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff5b4055e20 con 0x7ff5a8003a50 2024-05-10T04:50:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:17.704+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff5c4161ec0 con 0x7ff5a8003a50 2024-05-10T04:50:18.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.502+0000 7ff5bbe00700 1 -- 172.21.15.82:0/1189818804 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff5b4059400 con 0x7ff5a8003a50 2024-05-10T04:50:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff5a406acc0 msgr2=0x7ff5a406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff5a406acc0 0x7ff5a406d1d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40b42f0 tx=0x7ff5b0009040 comp rx=0 tx=0).stop 2024-05-10T04:50:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 msgr2=0x7ff5c4148f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5c4148f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800c300 tx=0x7ff5b40047c0 comp rx=0 tx=0).stop 2024-05-10T04:50:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 shutdown_connections 2024-05-10T04:50:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff5a406acc0 0x7ff5a406d1d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff5c40b58e0 0x7ff5c40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:18.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5a8003a50 0x7ff5c4148f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:18.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 --2- 172.21.15.82:0/1189818804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff5c4157e90 0x7ff5c41582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:18.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.505+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 >> 172.21.15.82:0/1189818804 conn(0x7ff5c40d3e10 msgr2=0x7ff5c415eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:18.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.506+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 shutdown_connections 2024-05-10T04:50:18.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.506+0000 7ff5cb200700 1 -- 172.21.15.82:0/1189818804 wait complete. 2024-05-10T04:50:18.533 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T04:50:18.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T04:50:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.802+0000 7f4735400700 1 Processor -- start 2024-05-10T04:50:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.803+0000 7f4735400700 1 -- start start 2024-05-10T04:50:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.804+0000 7f4735400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f47300b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.804+0000 7f4735400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47300d2c00 con 0x7f4730162150 2024-05-10T04:50:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.804+0000 7f4735400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473015ea20 con 0x7f47300b7910 2024-05-10T04:50:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.804+0000 7f4735400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4730162630 con 0x7f473015e610 2024-05-10T04:50:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.804+0000 7f472e800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4730162150 0x7f47300cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43208/0 (socket says 172.21.15.82:43208) 2024-05-10T04:50:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.804+0000 7f472e800700 1 -- 172.21.15.82:0/1237416411 learned_addr learned my addr 172.21.15.82:0/1237416411 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:18.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472de00700 1 --2- 172.21.15.82:0/1237416411 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f47300b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:18.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472d400700 1 -- 172.21.15.82:0/1237416411 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124996651 0 0) 0x7f47300d2c00 con 0x7f4730162150 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472d400700 1 -- 172.21.15.82:0/1237416411 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47140035b0 con 0x7f4730162150 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472d400700 1 -- 172.21.15.82:0/1237416411 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258767695 0 0) 0x7f473015ea20 con 0x7f47300b7910 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472d400700 1 -- 172.21.15.82:0/1237416411 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47300d2c00 con 0x7f47300b7910 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472d400700 1 -- 172.21.15.82:0/1237416411 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2510184922 0 0) 0x7f47140035b0 con 0x7f4730162150 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472de00700 1 -- 172.21.15.82:0/1237416411 >> v1:172.21.15.129:6789/0 conn(0x7f47300b7910 legacy=0x7f473006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472de00700 1 -- 172.21.15.82:0/1237416411 >> v1:172.21.15.82:6789/0 conn(0x7f4730162150 legacy=0x7f47300cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.805+0000 7f472de00700 1 -- 172.21.15.82:0/1237416411 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4730162910 con 0x7f473015e610 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.806+0000 7f472de00700 1 --2- 172.21.15.82:0/1237416411 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f47300b73d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f471c009870 tx=0x7f471c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=885828648629720 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.806+0000 7f472d400700 1 -- 172.21.15.82:0/1237416411 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720001670 con 0x7f473015e610 2024-05-10T04:50:18.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.806+0000 7f472d400700 1 -- 172.21.15.82:0/1237416411 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c004030 con 0x7f473015e610 2024-05-10T04:50:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.806+0000 7f472d400700 1 -- 172.21.15.82:0/1237416411 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0043c0 con 0x7f473015e610 2024-05-10T04:50:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.807+0000 7f4735400700 1 -- 172.21.15.82:0/1237416411 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 msgr2=0x7f47300b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.807+0000 7f4735400700 1 --2- 172.21.15.82:0/1237416411 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f47300b73d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f471c009870 tx=0x7f471c009b80 comp rx=0 tx=0).stop 2024-05-10T04:50:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.807+0000 7f4735400700 1 -- 172.21.15.82:0/1237416411 shutdown_connections 2024-05-10T04:50:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.807+0000 7f4735400700 1 --2- 172.21.15.82:0/1237416411 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f47300b73d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.807+0000 7f4735400700 1 -- 172.21.15.82:0/1237416411 >> 172.21.15.82:0/1237416411 conn(0x7f47300d3e10 msgr2=0x7f47300d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.807+0000 7f4735400700 1 -- 172.21.15.82:0/1237416411 shutdown_connections 2024-05-10T04:50:18.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.807+0000 7f4735400700 1 -- 172.21.15.82:0/1237416411 wait complete. 2024-05-10T04:50:18.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.809+0000 7f4735400700 1 Processor -- start 2024-05-10T04:50:18.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.809+0000 7f4735400700 1 -- start start 2024-05-10T04:50:18.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.810+0000 7f4735400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47300b7910 0x7f473014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f4735400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f4730151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f4735400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4730162150 0x7f4730161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f4735400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47301f66c0 con 0x7f4730162150 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f4735400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4730152470 con 0x7f47300b7910 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f4735400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473014fb30 con 0x7f473015e610 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4730162150 0x7f4730161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4730162150 0x7f4730161020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55892/0 (socket says 172.21.15.82:55892) 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472f200700 1 -- 172.21.15.82:0/47343927 learned_addr learned my addr 172.21.15.82:0/47343927 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472e800700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47300b7910 0x7f473014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472de00700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f4730151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:18.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472f200700 1 -- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 msgr2=0x7f4730151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472f200700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f4730151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472f200700 1 -- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47300b7910 msgr2=0x7f473014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472f200700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47300b7910 0x7f473014f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472f200700 1 -- 172.21.15.82:0/47343927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0094a0 con 0x7f4730162150 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472e800700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47300b7910 0x7f473014f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.811+0000 7f472de00700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f4730151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.812+0000 7f472f200700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4730162150 0x7f4730161020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f472800cbc0 tx=0x7f472800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.812+0000 7f4726a00700 1 -- 172.21.15.82:0/47343927 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728003c00 con 0x7f4730162150 2024-05-10T04:50:18.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.812+0000 7f4726a00700 1 -- 172.21.15.82:0/47343927 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4728003d60 con 0x7f4730162150 2024-05-10T04:50:18.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.812+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473015f8c0 con 0x7f4730162150 2024-05-10T04:50:18.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.812+0000 7f4726a00700 1 -- 172.21.15.82:0/47343927 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472800ab50 con 0x7f4730162150 2024-05-10T04:50:18.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.812+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473015ef90 con 0x7f4730162150 2024-05-10T04:50:18.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.813+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4730161ec0 con 0x7f4730162150 2024-05-10T04:50:18.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.814+0000 7f4726a00700 1 -- 172.21.15.82:0/47343927 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f472800acb0 con 0x7f4730162150 2024-05-10T04:50:18.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.815+0000 7f4726a00700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f471006acc0 0x7f471006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:18.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.815+0000 7f4726a00700 1 -- 172.21.15.82:0/47343927 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4728089390 con 0x7f4730162150 2024-05-10T04:50:18.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.815+0000 7f472e800700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f471006acc0 0x7f471006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:18.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.816+0000 7f472e800700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f471006acc0 0x7f471006d1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47200017a0 tx=0x7f4720001550 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:18.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:18.820+0000 7f4726a00700 1 -- 172.21.15.82:0/47343927 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4728054560 con 0x7f4730162150 2024-05-10T04:50:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.068+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f47300b3550 con 0x7f4730162150 2024-05-10T04:50:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.508+0000 7f4726a00700 1 -- 172.21.15.82:0/47343927 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4728057b80 con 0x7f4730162150 2024-05-10T04:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f471006acc0 msgr2=0x7f471006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f471006acc0 0x7f471006d1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47200017a0 tx=0x7f4720001550 comp rx=0 tx=0).stop 2024-05-10T04:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4730162150 msgr2=0x7f4730161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4730162150 0x7f4730161020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f472800cbc0 tx=0x7f472800cf80 comp rx=0 tx=0).stop 2024-05-10T04:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 shutdown_connections 2024-05-10T04:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f471006acc0 0x7f471006d1d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4730162150 0x7f4730161020 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f47300b7910 0x7f473014f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 --2- 172.21.15.82:0/47343927 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f473015e610 0x7f4730151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 >> 172.21.15.82:0/47343927 conn(0x7f47300d3e10 msgr2=0x7f47300cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 shutdown_connections 2024-05-10T04:50:19.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.511+0000 7f4735400700 1 -- 172.21.15.82:0/47343927 wait complete. 2024-05-10T04:50:19.537 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T04:50:19.537 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:50:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.798+0000 7f3acbe00700 1 Processor -- start 2024-05-10T04:50:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.798+0000 7f3acbe00700 1 -- start start 2024-05-10T04:50:19.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.799+0000 7f3acbe00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f3ac415bfe0 0x7f3ac415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ac40b5fa0 0x7f3ac41623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3acbe00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac4162a70 con 0x7f3ac4161fb0 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3acbe00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac415c3f0 con 0x7f3ac415bfe0 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3acbe00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4162d50 con 0x7f3ac40b5fa0 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3ac8a00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3ac4161fb0 0x7f3ac40b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43224/0 (socket says 172.21.15.82:43224) 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3ac8a00700 1 -- 172.21.15.82:0/2337059217 learned_addr learned my addr 172.21.15.82:0/2337059217 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3ac9e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ac40b5fa0 0x7f3ac41623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3ac9400700 1 --2- 172.21.15.82:0/2337059217 >> v2:172.21.15.129:3300/0 conn(0x7f3ac415bfe0 0x7f3ac415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291504498 0 0) 0x7f3ac4162a70 con 0x7f3ac4161fb0 2024-05-10T04:50:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.800+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aac0035b0 con 0x7f3ac4161fb0 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 51617251 0 0) 0x7f3aac0035b0 con 0x7f3ac4161fb0 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ac40b5fa0 msgr2=0x7f3ac41623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3ac40b5fa0 0x7f3ac41623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 >> v2:172.21.15.129:3300/0 conn(0x7f3ac415bfe0 msgr2=0x7f3ac415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 --2- 172.21.15.82:0/2337059217 >> v2:172.21.15.129:3300/0 conn(0x7f3ac415bfe0 0x7f3ac415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac415ecf0 con 0x7f3ac4161fb0 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f3ab0001670 con 0x7f3ac4161fb0 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac9400700 1 --2- 172.21.15.82:0/2337059217 >> v2:172.21.15.129:3300/0 conn(0x7f3ac415bfe0 0x7f3ac415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 >> v1:172.21.15.82:6789/0 conn(0x7f3ac4161fb0 legacy=0x7f3ac40b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3aac003a00 0x7f3aac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac004850 0x7f3aac004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3aac0051a0 0x7f3aac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac415c3f0 con 0x7f3aac0051a0 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4162d50 con 0x7f3aac003a00 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac005700 con 0x7f3aac004850 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac9e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3aac0051a0 0x7f3aac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac9400700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3aac003a00 0x7f3aac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac8a00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac004850 0x7f3aac004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac9e00700 1 -- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac004850 msgr2=0x7f3aac004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac9e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac004850 0x7f3aac004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac9e00700 1 -- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3aac003a00 msgr2=0x7f3aac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac9e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3aac003a00 0x7f3aac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.801+0000 7f3ac9e00700 1 -- 172.21.15.82:0/2337059217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0035b0 con 0x7f3aac0051a0 2024-05-10T04:50:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.802+0000 7f3ac9e00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3aac0051a0 0x7f3aac00ba10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40cae90 tx=0x7f3aac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fef98fbf6a43df server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.802+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00ebd0 con 0x7f3aac0051a0 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.802+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc00f040 con 0x7f3aac0051a0 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.802+0000 7f3ac3e00700 1 -- 172.21.15.82:0/2337059217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc014480 con 0x7f3aac0051a0 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.803+0000 7f3acbe00700 1 -- 172.21.15.82:0/2337059217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3aac0051a0 msgr2=0x7f3aac00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.803+0000 7f3acbe00700 1 --2- 172.21.15.82:0/2337059217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3aac0051a0 0x7f3aac00ba10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40cae90 tx=0x7f3aac005880 comp rx=0 tx=0).stop 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.803+0000 7f3ac9e00700 1 -- 172.21.15.82:0/2337059217 reap_dead start 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.803+0000 7f3acbe00700 1 -- 172.21.15.82:0/2337059217 shutdown_connections 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.803+0000 7f3acbe00700 1 -- 172.21.15.82:0/2337059217 >> 172.21.15.82:0/2337059217 conn(0x7f3ac40d0a70 msgr2=0x7f3ac40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.803+0000 7f3acbe00700 1 -- 172.21.15.82:0/2337059217 shutdown_connections 2024-05-10T04:50:19.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.803+0000 7f3acbe00700 1 -- 172.21.15.82:0/2337059217 wait complete. 2024-05-10T04:50:19.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.806+0000 7f3acbe00700 1 Processor -- start 2024-05-10T04:50:19.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.806+0000 7f3acbe00700 1 -- start start 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac0051a0 0x7f3ac40b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ac40cbac0 0x7f3ac40cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3acbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40b4d60 0x7f3ac40b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3acbe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40cc410 con 0x7f3ac40b4d60 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3acbe00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40ca4d0 con 0x7f3ac40cbac0 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3acbe00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40c7a40 con 0x7f3aac0051a0 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40b4d60 0x7f3ac40b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40b4d60 0x7f3ac40b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55908/0 (socket says 172.21.15.82:55908) 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9e00700 1 -- 172.21.15.82:0/202086499 learned_addr learned my addr 172.21.15.82:0/202086499 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac8a00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ac40cbac0 0x7f3ac40cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9400700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac0051a0 0x7f3ac40b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9e00700 1 -- 172.21.15.82:0/202086499 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac0051a0 msgr2=0x7f3ac40b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9e00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac0051a0 0x7f3ac40b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9e00700 1 -- 172.21.15.82:0/202086499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ac40cbac0 msgr2=0x7f3ac40cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9e00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ac40cbac0 0x7f3ac40cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.808+0000 7f3ac9e00700 1 -- 172.21.15.82:0/202086499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40c88a0 con 0x7f3ac40b4d60 2024-05-10T04:50:19.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.809+0000 7f3ac9e00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40b4d60 0x7f3ac40b5170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3abc015000 tx=0x7f3abc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.809+0000 7f3ac1600700 1 -- 172.21.15.82:0/202086499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc007000 con 0x7f3ac40b4d60 2024-05-10T04:50:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.809+0000 7f3ac1600700 1 -- 172.21.15.82:0/202086499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc003e50 con 0x7f3ac40b4d60 2024-05-10T04:50:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.809+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac40b56b0 con 0x7f3ac40b4d60 2024-05-10T04:50:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.809+0000 7f3ac1600700 1 -- 172.21.15.82:0/202086499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc014970 con 0x7f3ac40b4d60 2024-05-10T04:50:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.809+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac40c7f70 con 0x7f3ac40b4d60 2024-05-10T04:50:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.810+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac4074af0 con 0x7f3ac40b4d60 2024-05-10T04:50:19.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.811+0000 7f3ac1600700 1 -- 172.21.15.82:0/202086499 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3abc024070 con 0x7f3ac40b4d60 2024-05-10T04:50:19.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.812+0000 7f3ac1600700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3aa406acc0 0x7f3aa406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:19.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.812+0000 7f3ac1600700 1 -- 172.21.15.82:0/202086499 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3abc08b4b0 con 0x7f3ac40b4d60 2024-05-10T04:50:19.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.812+0000 7f3ac9400700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3aa406acc0 0x7f3aa406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:19.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.813+0000 7f3ac9400700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3aa406acc0 0x7f3aa406d1d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009e60 tx=0x7f3ab8009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:19.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:19.817+0000 7f3ac1600700 1 -- 172.21.15.82:0/202086499 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3abc056680 con 0x7f3ac40b4d60 2024-05-10T04:50:20.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.063+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ac40cf230 con 0x7f3ac40b4d60 2024-05-10T04:50:20.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.063+0000 7f3ac1600700 1 -- 172.21.15.82:0/202086499 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f3abc009c10 con 0x7f3ac40b4d60 2024-05-10T04:50:20.064 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:20.064 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:50:16.068598+0000","modified":"2024-05-10T04:50:19.501679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:50:20.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3aa406acc0 msgr2=0x7f3aa406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3aa406acc0 0x7f3aa406d1d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009e60 tx=0x7f3ab8009210 comp rx=0 tx=0).stop 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40b4d60 msgr2=0x7f3ac40b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40b4d60 0x7f3ac40b5170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3abc015000 tx=0x7f3abc009750 comp rx=0 tx=0).stop 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 shutdown_connections 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3aa406acc0 0x7f3aa406d1d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40b4d60 0x7f3ac40b5170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3aac0051a0 0x7f3ac40b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 --2- 172.21.15.82:0/202086499 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3ac40cbac0 0x7f3ac40cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 >> 172.21.15.82:0/202086499 conn(0x7f3ac40d0a70 msgr2=0x7f3ac40d3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 shutdown_connections 2024-05-10T04:50:20.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.066+0000 7f3acbe00700 1 -- 172.21.15.82:0/202086499 wait complete. 2024-05-10T04:50:20.068 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-10T04:50:20.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:20.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.354+0000 7ff274200700 1 Processor -- start 2024-05-10T04:50:20.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.354+0000 7ff274200700 1 -- start start 2024-05-10T04:50:20.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.355+0000 7ff274200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff26c070640 0x7ff26c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff274200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff274200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c06b8e0 con 0x7ff26c0b31c0 2024-05-10T04:50:20.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff274200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c06acd0 con 0x7ff26c070640 2024-05-10T04:50:20.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff274200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c06afb0 con 0x7ff26c0d04a0 2024-05-10T04:50:20.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff271800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff26c070640 0x7ff26c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff271800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff26c070640 0x7ff26c0b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55920/0 (socket says 172.21.15.82:55920) 2024-05-10T04:50:20.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff271800700 1 -- 172.21.15.82:0/659016759 learned_addr learned my addr 172.21.15.82:0/659016759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:20.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff271800700 1 -- 172.21.15.82:0/659016759 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 msgr2=0x7ff26c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:20.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff272200700 1 --2- 172.21.15.82:0/659016759 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff271800700 1 --2- 172.21.15.82:0/659016759 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff271800700 1 -- 172.21.15.82:0/659016759 >> v1:172.21.15.82:6789/0 conn(0x7ff26c0b31c0 legacy=0x7ff26c0cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff271800700 1 -- 172.21.15.82:0/659016759 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c06b290 con 0x7ff26c070640 2024-05-10T04:50:20.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.356+0000 7ff272200700 1 --2- 172.21.15.82:0/659016759 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.357+0000 7ff271800700 1 --2- 172.21.15.82:0/659016759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0b5ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff2600098f0 tx=0x7ff260009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77eea46b49204cd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.357+0000 7ff26be00700 1 -- 172.21.15.82:0/659016759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000b8a0 con 0x7ff26c070640 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.357+0000 7ff26be00700 1 -- 172.21.15.82:0/659016759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26000ba00 con 0x7ff26c070640 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.357+0000 7ff26be00700 1 -- 172.21.15.82:0/659016759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000bd90 con 0x7ff26c070640 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.357+0000 7ff274200700 1 -- 172.21.15.82:0/659016759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 msgr2=0x7ff26c0b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.357+0000 7ff274200700 1 --2- 172.21.15.82:0/659016759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0b5ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff2600098f0 tx=0x7ff260009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.358+0000 7ff274200700 1 -- 172.21.15.82:0/659016759 shutdown_connections 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.358+0000 7ff274200700 1 --2- 172.21.15.82:0/659016759 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.358+0000 7ff274200700 1 --2- 172.21.15.82:0/659016759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0b5ed0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.358+0000 7ff274200700 1 -- 172.21.15.82:0/659016759 >> 172.21.15.82:0/659016759 conn(0x7ff26c0b26a0 msgr2=0x7ff26c0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.358+0000 7ff274200700 1 -- 172.21.15.82:0/659016759 shutdown_connections 2024-05-10T04:50:20.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.358+0000 7ff274200700 1 -- 172.21.15.82:0/659016759 wait complete. 2024-05-10T04:50:20.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.360+0000 7ff274200700 1 Processor -- start 2024-05-10T04:50:20.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.360+0000 7ff274200700 1 -- start start 2024-05-10T04:50:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff274200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff274200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff26c0b31c0 0x7ff26c153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff274200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c0c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff274200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0c8e60 con 0x7ff26c070640 2024-05-10T04:50:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff274200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0c8370 con 0x7ff26c0b31c0 2024-05-10T04:50:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff274200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0c8120 con 0x7ff26c0d04a0 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff271800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff271800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55932/0 (socket says 172.21.15.82:55932) 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff271800700 1 -- 172.21.15.82:0/4161065370 learned_addr learned my addr 172.21.15.82:0/4161065370 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff270e00700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff26c0b31c0 0x7ff26c153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff272200700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c0c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff271800700 1 -- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 msgr2=0x7ff26c0c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff271800700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c0c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff271800700 1 -- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff26c0b31c0 msgr2=0x7ff26c153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff271800700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff26c0b31c0 0x7ff26c153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff271800700 1 -- 172.21.15.82:0/4161065370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff260009550 con 0x7ff26c070640 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff270e00700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff26c0b31c0 0x7ff26c153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.362+0000 7ff272200700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c0c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.363+0000 7ff271800700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0c7be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff260009130 tx=0x7ff260004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.363+0000 7ff269600700 1 -- 172.21.15.82:0/4161065370 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2600036a0 con 0x7ff26c070640 2024-05-10T04:50:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.363+0000 7ff269600700 1 -- 172.21.15.82:0/4161065370 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26001e070 con 0x7ff26c070640 2024-05-10T04:50:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.363+0000 7ff269600700 1 -- 172.21.15.82:0/4161065370 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260003a60 con 0x7ff26c070640 2024-05-10T04:50:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.363+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c154420 con 0x7ff26c070640 2024-05-10T04:50:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.363+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c0c88a0 con 0x7ff26c070640 2024-05-10T04:50:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.364+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c074af0 con 0x7ff26c070640 2024-05-10T04:50:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.365+0000 7ff269600700 1 -- 172.21.15.82:0/4161065370 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff260003bc0 con 0x7ff26c070640 2024-05-10T04:50:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.366+0000 7ff269600700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff24c06ac90 0x7ff24c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.366+0000 7ff269600700 1 -- 172.21.15.82:0/4161065370 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff260020070 con 0x7ff26c070640 2024-05-10T04:50:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.366+0000 7ff270e00700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff24c06ac90 0x7ff24c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.366+0000 7ff270e00700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff24c06ac90 0x7ff24c06d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff26c1f7650 tx=0x7ff258009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.370+0000 7ff269600700 1 -- 172.21.15.82:0/4161065370 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff260055b70 con 0x7ff26c070640 2024-05-10T04:50:20.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.577+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff26c0cb8d0 con 0x7ff26c070640 2024-05-10T04:50:20.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.578+0000 7ff269600700 1 -- 172.21.15.82:0/4161065370 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7ff260015090 con 0x7ff26c070640 2024-05-10T04:50:20.579 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:20.579 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff24c06ac90 msgr2=0x7ff24c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff24c06ac90 0x7ff24c06d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff26c1f7650 tx=0x7ff258009040 comp rx=0 tx=0).stop 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 msgr2=0x7ff26c0c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0c7be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff260009130 tx=0x7ff260004750 comp rx=0 tx=0).stop 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 shutdown_connections 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff24c06ac90 0x7ff24c06d1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff26c0d04a0 0x7ff26c0c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff26c070640 0x7ff26c0c7be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 --2- 172.21.15.82:0/4161065370 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff26c0b31c0 0x7ff26c153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 >> 172.21.15.82:0/4161065370 conn(0x7ff26c0b26a0 msgr2=0x7ff26c0cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 shutdown_connections 2024-05-10T04:50:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.581+0000 7ff274200700 1 -- 172.21.15.82:0/4161065370 wait complete. 2024-05-10T04:50:20.609 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-10T04:50:20.610 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:50:20.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.871+0000 7fc783c00700 1 Processor -- start 2024-05-10T04:50:20.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.871+0000 7fc783c00700 1 -- start start 2024-05-10T04:50:20.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc783c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc77c15bfe0 0x7fc77c15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc783c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c161fb0 0x7fc77c1623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc783c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c162a70 con 0x7fc77c0b5890 2024-05-10T04:50:20.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc783c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c15c3f0 con 0x7fc77c15bfe0 2024-05-10T04:50:20.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc783c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c162d50 con 0x7fc77c161fb0 2024-05-10T04:50:20.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc781200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc77c15bfe0 0x7fc77c15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc781c00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc77c0b5890 0x7fc77c0b5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43246/0 (socket says 172.21.15.82:43246) 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc781c00700 1 -- 172.21.15.82:0/1528134072 learned_addr learned my addr 172.21.15.82:0/1528134072 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.873+0000 7fc77be00700 1 --2- 172.21.15.82:0/1528134072 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c161fb0 0x7fc77c1623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc77b400700 1 -- 172.21.15.82:0/1528134072 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812391453 0 0) 0x7fc77c162a70 con 0x7fc77c0b5890 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc77b400700 1 -- 172.21.15.82:0/1528134072 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7640035b0 con 0x7fc77c0b5890 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc781200700 1 -- 172.21.15.82:0/1528134072 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c161fb0 msgr2=0x7fc77c1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc781200700 1 --2- 172.21.15.82:0/1528134072 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c161fb0 0x7fc77c1623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc781200700 1 -- 172.21.15.82:0/1528134072 >> v1:172.21.15.82:6789/0 conn(0x7fc77c0b5890 legacy=0x7fc77c0b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc781200700 1 -- 172.21.15.82:0/1528134072 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c15ecf0 con 0x7fc77c15bfe0 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc77be00700 1 --2- 172.21.15.82:0/1528134072 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c161fb0 0x7fc77c1623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:20.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc781200700 1 --2- 172.21.15.82:0/1528134072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c15bfe0 0x7fc77c15f4f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc770009840 tx=0x7fc770009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7591b8af8fe266 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:20.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc77b400700 1 -- 172.21.15.82:0/1528134072 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770011830 con 0x7fc77c15bfe0 2024-05-10T04:50:20.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc77b400700 1 -- 172.21.15.82:0/1528134072 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc770011990 con 0x7fc77c15bfe0 2024-05-10T04:50:20.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.874+0000 7fc77b400700 1 -- 172.21.15.82:0/1528134072 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770011d20 con 0x7fc77c15bfe0 2024-05-10T04:50:20.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.875+0000 7fc783c00700 1 -- 172.21.15.82:0/1528134072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c15bfe0 msgr2=0x7fc77c15f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.875+0000 7fc783c00700 1 --2- 172.21.15.82:0/1528134072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c15bfe0 0x7fc77c15f4f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc770009840 tx=0x7fc770009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:20.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.875+0000 7fc783c00700 1 -- 172.21.15.82:0/1528134072 shutdown_connections 2024-05-10T04:50:20.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.875+0000 7fc783c00700 1 --2- 172.21.15.82:0/1528134072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c15bfe0 0x7fc77c15f4f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.875+0000 7fc783c00700 1 --2- 172.21.15.82:0/1528134072 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c161fb0 0x7fc77c1623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.875+0000 7fc783c00700 1 -- 172.21.15.82:0/1528134072 >> 172.21.15.82:0/1528134072 conn(0x7fc77c0d0a70 msgr2=0x7fc77c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:20.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.875+0000 7fc783c00700 1 -- 172.21.15.82:0/1528134072 shutdown_connections 2024-05-10T04:50:20.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.875+0000 7fc783c00700 1 -- 172.21.15.82:0/1528134072 wait complete. 2024-05-10T04:50:20.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.877+0000 7fc783c00700 1 Processor -- start 2024-05-10T04:50:20.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.877+0000 7fc783c00700 1 -- start start 2024-05-10T04:50:20.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc783c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c0b5890 0x7fc77c160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc783c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c15bfe0 0x7fc77c151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc783c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc77c161fb0 0x7fc77c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc783c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1f4870 con 0x7fc77c0b5890 2024-05-10T04:50:20.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc783c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c160b70 con 0x7fc77c161fb0 2024-05-10T04:50:20.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc783c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1f4360 con 0x7fc77c15bfe0 2024-05-10T04:50:20.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc781200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c0b5890 0x7fc77c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc781200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c0b5890 0x7fc77c160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55952/0 (socket says 172.21.15.82:55952) 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc781200700 1 -- 172.21.15.82:0/2833728081 learned_addr learned my addr 172.21.15.82:0/2833728081 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc77be00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c15bfe0 0x7fc77c151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.879+0000 7fc781c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc77c161fb0 0x7fc77c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc781200700 1 -- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c15bfe0 msgr2=0x7fc77c151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc781200700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c15bfe0 0x7fc77c151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc781200700 1 -- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc77c161fb0 msgr2=0x7fc77c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc781200700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc77c161fb0 0x7fc77c0cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc781200700 1 -- 172.21.15.82:0/2833728081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7700094a0 con 0x7fc77c0b5890 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc781c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc77c161fb0 0x7fc77c0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:20.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc781200700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c0b5890 0x7fc77c160570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc770009fd0 tx=0x7fc770004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:20.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc778c00700 1 -- 172.21.15.82:0/2833728081 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700036a0 con 0x7fc77c0b5890 2024-05-10T04:50:20.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc778c00700 1 -- 172.21.15.82:0/2833728081 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77001e070 con 0x7fc77c0b5890 2024-05-10T04:50:20.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c160dc0 con 0x7fc77c0b5890 2024-05-10T04:50:20.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc778c00700 1 -- 172.21.15.82:0/2833728081 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770003a60 con 0x7fc77c0b5890 2024-05-10T04:50:20.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.880+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c0c8e60 con 0x7fc77c0b5890 2024-05-10T04:50:20.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.881+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c08bb50 con 0x7fc77c0b5890 2024-05-10T04:50:20.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.882+0000 7fc778c00700 1 -- 172.21.15.82:0/2833728081 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc770003bc0 con 0x7fc77c0b5890 2024-05-10T04:50:20.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.884+0000 7fc778c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc75c06ac90 0x7fc75c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:20.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.884+0000 7fc778c00700 1 -- 172.21.15.82:0/2833728081 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc77008a370 con 0x7fc77c0b5890 2024-05-10T04:50:20.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.884+0000 7fc77be00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc75c06ac90 0x7fc75c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:20.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.884+0000 7fc77be00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc75c06ac90 0x7fc75c06d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc77c15e150 tx=0x7fc768008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:20.888+0000 7fc778c00700 1 -- 172.21.15.82:0/2833728081 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc7700554b0 con 0x7fc77c0b5890 2024-05-10T04:50:21.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.088+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc77c1623c0 con 0x7fc75c06ac90 2024-05-10T04:50:21.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.098+0000 7fc778c00700 1 -- 172.21.15.82:0/2833728081 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264670 (secure 0 0 0) 0x7fc77c1623c0 con 0x7fc75c06ac90 2024-05-10T04:50:21.102 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:21.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc75c06ac90 msgr2=0x7fc75c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc75c06ac90 0x7fc75c06d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc77c15e150 tx=0x7fc768008040 comp rx=0 tx=0).stop 2024-05-10T04:50:21.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c0b5890 msgr2=0x7fc77c160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c0b5890 0x7fc77c160570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc770009fd0 tx=0x7fc770004750 comp rx=0 tx=0).stop 2024-05-10T04:50:21.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 shutdown_connections 2024-05-10T04:50:21.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc75c06ac90 0x7fc75c06d1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc77c161fb0 0x7fc77c0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc77c0b5890 0x7fc77c160570 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 --2- 172.21.15.82:0/2833728081 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc77c15bfe0 0x7fc77c151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 >> 172.21.15.82:0/2833728081 conn(0x7fc77c0d0a70 msgr2=0x7fc77c15c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:21.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 shutdown_connections 2024-05-10T04:50:21.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.102+0000 7fc783c00700 1 -- 172.21.15.82:0/2833728081 wait complete. 2024-05-10T04:50:21.105 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:50:21.127 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-10T04:50:20.969788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001138"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317468+0000","last_change":"2024-05-10T04:50:16.116571+0000","last_active":"2024-05-10T04:50:17.317468+0000","last_peered":"2024-05-10T04:50:17.317468+0000","last_clean":"2024-05-10T04:50:17.317468+0000","last_became_active":"2024-05-10T04:50:16.114134+0000","last_became_peered":"2024-05-10T04:50:16.114134+0000","last_unstale":"2024-05-10T04:50:17.317468+0000","last_undegraded":"2024-05-10T04:50:17.317468+0000","last_fullsized":"2024-05-10T04:50:17.317468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:48.157294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076993+0000","last_change":"2024-05-10T04:50:16.105444+0000","last_active":"2024-05-10T04:50:17.076993+0000","last_peered":"2024-05-10T04:50:17.076993+0000","last_clean":"2024-05-10T04:50:17.076993+0000","last_became_active":"2024-05-10T04:50:16.105168+0000","last_became_peered":"2024-05-10T04:50:16.105168+0000","last_unstale":"2024-05-10T04:50:17.076993+0000","last_undegraded":"2024-05-10T04:50:17.076993+0000","last_fullsized":"2024-05-10T04:50:17.076993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315713+0000","last_change":"2024-05-10T04:50:16.095062+0000","last_active":"2024-05-10T04:50:17.315713+0000","last_peered":"2024-05-10T04:50:17.315713+0000","last_clean":"2024-05-10T04:50:17.315713+0000","last_became_active":"2024-05-10T04:50:16.094786+0000","last_became_peered":"2024-05-10T04:50:16.094786+0000","last_unstale":"2024-05-10T04:50:17.315713+0000","last_undegraded":"2024-05-10T04:50:17.315713+0000","last_fullsized":"2024-05-10T04:50:17.315713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:32.856707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077027+0000","last_change":"2024-05-10T04:50:16.105222+0000","last_active":"2024-05-10T04:50:17.077027+0000","last_peered":"2024-05-10T04:50:17.077027+0000","last_clean":"2024-05-10T04:50:17.077027+0000","last_became_active":"2024-05-10T04:50:16.104534+0000","last_became_peered":"2024-05-10T04:50:16.104534+0000","last_unstale":"2024-05-10T04:50:17.077027+0000","last_undegraded":"2024-05-10T04:50:17.077027+0000","last_fullsized":"2024-05-10T04:50:17.077027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:13.581090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316177+0000","last_change":"2024-05-10T04:50:16.116857+0000","last_active":"2024-05-10T04:50:17.316177+0000","last_peered":"2024-05-10T04:50:17.316177+0000","last_clean":"2024-05-10T04:50:17.316177+0000","last_became_active":"2024-05-10T04:50:16.114914+0000","last_became_peered":"2024-05-10T04:50:16.114914+0000","last_unstale":"2024-05-10T04:50:17.316177+0000","last_undegraded":"2024-05-10T04:50:17.316177+0000","last_fullsized":"2024-05-10T04:50:17.316177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076793+0000","last_change":"2024-05-10T04:50:16.092687+0000","last_active":"2024-05-10T04:50:17.076793+0000","last_peered":"2024-05-10T04:50:17.076793+0000","last_clean":"2024-05-10T04:50:17.076793+0000","last_became_active":"2024-05-10T04:50:16.092377+0000","last_became_peered":"2024-05-10T04:50:16.092377+0000","last_unstale":"2024-05-10T04:50:17.076793+0000","last_undegraded":"2024-05-10T04:50:17.076793+0000","last_fullsized":"2024-05-10T04:50:17.076793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316827+0000","last_change":"2024-05-10T04:50:16.112968+0000","last_active":"2024-05-10T04:50:17.316827+0000","last_peered":"2024-05-10T04:50:17.316827+0000","last_clean":"2024-05-10T04:50:17.316827+0000","last_became_active":"2024-05-10T04:50:16.112691+0000","last_became_peered":"2024-05-10T04:50:16.112691+0000","last_unstale":"2024-05-10T04:50:17.316827+0000","last_undegraded":"2024-05-10T04:50:17.316827+0000","last_fullsized":"2024-05-10T04:50:17.316827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:32:24.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315078+0000","last_change":"2024-05-10T04:50:16.104549+0000","last_active":"2024-05-10T04:50:17.315078+0000","last_peered":"2024-05-10T04:50:17.315078+0000","last_clean":"2024-05-10T04:50:17.315078+0000","last_became_active":"2024-05-10T04:50:16.104213+0000","last_became_peered":"2024-05-10T04:50:16.104213+0000","last_unstale":"2024-05-10T04:50:17.315078+0000","last_undegraded":"2024-05-10T04:50:17.315078+0000","last_fullsized":"2024-05-10T04:50:17.315078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317412+0000","last_change":"2024-05-10T04:50:16.118415+0000","last_active":"2024-05-10T04:50:17.317412+0000","last_peered":"2024-05-10T04:50:17.317412+0000","last_clean":"2024-05-10T04:50:17.317412+0000","last_became_active":"2024-05-10T04:50:16.118045+0000","last_became_peered":"2024-05-10T04:50:16.118045+0000","last_unstale":"2024-05-10T04:50:17.317412+0000","last_undegraded":"2024-05-10T04:50:17.317412+0000","last_fullsized":"2024-05-10T04:50:17.317412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:07.192432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316747+0000","last_change":"2024-05-10T04:50:16.108768+0000","last_active":"2024-05-10T04:50:17.316747+0000","last_peered":"2024-05-10T04:50:17.316747+0000","last_clean":"2024-05-10T04:50:17.316747+0000","last_became_active":"2024-05-10T04:50:16.108457+0000","last_became_peered":"2024-05-10T04:50:16.108457+0000","last_unstale":"2024-05-10T04:50:17.316747+0000","last_undegraded":"2024-05-10T04:50:17.316747+0000","last_fullsized":"2024-05-10T04:50:17.316747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315861+0000","last_change":"2024-05-10T04:50:16.119907+0000","last_active":"2024-05-10T04:50:17.315861+0000","last_peered":"2024-05-10T04:50:17.315861+0000","last_clean":"2024-05-10T04:50:17.315861+0000","last_became_active":"2024-05-10T04:50:16.119573+0000","last_became_peered":"2024-05-10T04:50:16.119573+0000","last_unstale":"2024-05-10T04:50:17.315861+0000","last_undegraded":"2024-05-10T04:50:17.315861+0000","last_fullsized":"2024-05-10T04:50:17.315861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316976+0000","last_change":"2024-05-10T04:50:16.096302+0000","last_active":"2024-05-10T04:50:17.316976+0000","last_peered":"2024-05-10T04:50:17.316976+0000","last_clean":"2024-05-10T04:50:17.316976+0000","last_became_active":"2024-05-10T04:50:16.095997+0000","last_became_peered":"2024-05-10T04:50:16.095997+0000","last_unstale":"2024-05-10T04:50:17.316976+0000","last_undegraded":"2024-05-10T04:50:17.316976+0000","last_fullsized":"2024-05-10T04:50:17.316976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:25.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315424+0000","last_change":"2024-05-10T04:50:16.106646+0000","last_active":"2024-05-10T04:50:17.315424+0000","last_peered":"2024-05-10T04:50:17.315424+0000","last_clean":"2024-05-10T04:50:17.315424+0000","last_became_active":"2024-05-10T04:50:16.106365+0000","last_became_peered":"2024-05-10T04:50:16.106365+0000","last_unstale":"2024-05-10T04:50:17.315424+0000","last_undegraded":"2024-05-10T04:50:17.315424+0000","last_fullsized":"2024-05-10T04:50:17.315424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315522+0000","last_change":"2024-05-10T04:50:16.091792+0000","last_active":"2024-05-10T04:50:17.315522+0000","last_peered":"2024-05-10T04:50:17.315522+0000","last_clean":"2024-05-10T04:50:17.315522+0000","last_became_active":"2024-05-10T04:50:16.091437+0000","last_became_peered":"2024-05-10T04:50:16.091437+0000","last_unstale":"2024-05-10T04:50:17.315522+0000","last_undegraded":"2024-05-10T04:50:17.315522+0000","last_fullsized":"2024-05-10T04:50:17.315522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076423+0000","last_change":"2024-05-10T04:50:16.106200+0000","last_active":"2024-05-10T04:50:17.076423+0000","last_peered":"2024-05-10T04:50:17.076423+0000","last_clean":"2024-05-10T04:50:17.076423+0000","last_became_active":"2024-05-10T04:50:16.099204+0000","last_became_peered":"2024-05-10T04:50:16.099204+0000","last_unstale":"2024-05-10T04:50:17.076423+0000","last_undegraded":"2024-05-10T04:50:17.076423+0000","last_fullsized":"2024-05-10T04:50:17.076423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076460+0000","last_change":"2024-05-10T04:50:16.091018+0000","last_active":"2024-05-10T04:50:17.076460+0000","last_peered":"2024-05-10T04:50:17.076460+0000","last_clean":"2024-05-10T04:50:17.076460+0000","last_became_active":"2024-05-10T04:50:16.090683+0000","last_became_peered":"2024-05-10T04:50:16.090683+0000","last_unstale":"2024-05-10T04:50:17.076460+0000","last_undegraded":"2024-05-10T04:50:17.076460+0000","last_fullsized":"2024-05-10T04:50:17.076460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077320+0000","last_change":"2024-05-10T04:50:16.100477+0000","last_active":"2024-05-10T04:50:17.077320+0000","last_peered":"2024-05-10T04:50:17.077320+0000","last_clean":"2024-05-10T04:50:17.077320+0000","last_became_active":"2024-05-10T04:50:16.099915+0000","last_became_peered":"2024-05-10T04:50:16.099915+0000","last_unstale":"2024-05-10T04:50:17.077320+0000","last_undegraded":"2024-05-10T04:50:17.077320+0000","last_fullsized":"2024-05-10T04:50:17.077320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:32:24.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077731+0000","last_change":"2024-05-10T04:50:16.100503+0000","last_active":"2024-05-10T04:50:17.077731+0000","last_peered":"2024-05-10T04:50:17.077731+0000","last_clean":"2024-05-10T04:50:17.077731+0000","last_became_active":"2024-05-10T04:50:16.100054+0000","last_became_peered":"2024-05-10T04:50:16.100054+0000","last_unstale":"2024-05-10T04:50:17.077731+0000","last_undegraded":"2024-05-10T04:50:17.077731+0000","last_fullsized":"2024-05-10T04:50:17.077731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317151+0000","last_change":"2024-05-10T04:50:16.111998+0000","last_active":"2024-05-10T04:50:17.317151+0000","last_peered":"2024-05-10T04:50:17.317151+0000","last_clean":"2024-05-10T04:50:17.317151+0000","last_became_active":"2024-05-10T04:50:16.111151+0000","last_became_peered":"2024-05-10T04:50:16.111151+0000","last_unstale":"2024-05-10T04:50:17.317151+0000","last_undegraded":"2024-05-10T04:50:17.317151+0000","last_fullsized":"2024-05-10T04:50:17.317151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.659081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316335+0000","last_change":"2024-05-10T04:50:15.516274+0000","last_active":"2024-05-10T04:50:17.316335+0000","last_peered":"2024-05-10T04:50:17.316335+0000","last_clean":"2024-05-10T04:50:17.316335+0000","last_became_active":"2024-05-10T04:50:15.515938+0000","last_became_peered":"2024-05-10T04:50:15.515938+0000","last_unstale":"2024-05-10T04:50:17.316335+0000","last_undegraded":"2024-05-10T04:50:17.316335+0000","last_fullsized":"2024-05-10T04:50:17.316335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.492940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315956+0000","last_change":"2024-05-10T04:50:16.103965+0000","last_active":"2024-05-10T04:50:17.315956+0000","last_peered":"2024-05-10T04:50:17.315956+0000","last_clean":"2024-05-10T04:50:17.315956+0000","last_became_active":"2024-05-10T04:50:16.100297+0000","last_became_peered":"2024-05-10T04:50:16.100297+0000","last_unstale":"2024-05-10T04:50:17.315956+0000","last_undegraded":"2024-05-10T04:50:17.315956+0000","last_fullsized":"2024-05-10T04:50:17.315956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316052+0000","last_change":"2024-05-10T04:50:15.511208+0000","last_active":"2024-05-10T04:50:17.316052+0000","last_peered":"2024-05-10T04:50:17.316052+0000","last_clean":"2024-05-10T04:50:17.316052+0000","last_became_active":"2024-05-10T04:50:15.510946+0000","last_became_peered":"2024-05-10T04:50:15.510946+0000","last_unstale":"2024-05-10T04:50:17.316052+0000","last_undegraded":"2024-05-10T04:50:17.316052+0000","last_fullsized":"2024-05-10T04:50:17.316052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.492940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316317+0000","last_change":"2024-05-10T04:50:16.103854+0000","last_active":"2024-05-10T04:50:17.316317+0000","last_peered":"2024-05-10T04:50:17.316317+0000","last_clean":"2024-05-10T04:50:17.316317+0000","last_became_active":"2024-05-10T04:50:16.103319+0000","last_became_peered":"2024-05-10T04:50:16.103319+0000","last_unstale":"2024-05-10T04:50:17.316317+0000","last_undegraded":"2024-05-10T04:50:17.316317+0000","last_fullsized":"2024-05-10T04:50:17.316317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:02.917774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317628+0000","last_change":"2024-05-10T04:50:15.520375+0000","last_active":"2024-05-10T04:50:17.317628+0000","last_peered":"2024-05-10T04:50:17.317628+0000","last_clean":"2024-05-10T04:50:17.317628+0000","last_became_active":"2024-05-10T04:50:15.520023+0000","last_became_peered":"2024-05-10T04:50:15.520023+0000","last_unstale":"2024-05-10T04:50:17.317628+0000","last_undegraded":"2024-05-10T04:50:17.317628+0000","last_fullsized":"2024-05-10T04:50:17.317628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076711+0000","last_change":"2024-05-10T04:50:16.092652+0000","last_active":"2024-05-10T04:50:17.076711+0000","last_peered":"2024-05-10T04:50:17.076711+0000","last_clean":"2024-05-10T04:50:17.076711+0000","last_became_active":"2024-05-10T04:50:16.092325+0000","last_became_peered":"2024-05-10T04:50:16.092325+0000","last_unstale":"2024-05-10T04:50:17.076711+0000","last_undegraded":"2024-05-10T04:50:17.076711+0000","last_fullsized":"2024-05-10T04:50:17.076711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317137+0000","last_change":"2024-05-10T04:50:15.519068+0000","last_active":"2024-05-10T04:50:17.317137+0000","last_peered":"2024-05-10T04:50:17.317137+0000","last_clean":"2024-05-10T04:50:17.317137+0000","last_became_active":"2024-05-10T04:50:15.518747+0000","last_became_peered":"2024-05-10T04:50:15.518747+0000","last_unstale":"2024-05-10T04:50:17.317137+0000","last_undegraded":"2024-05-10T04:50:17.317137+0000","last_fullsized":"2024-05-10T04:50:17.317137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:35.682289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077225+0000","last_change":"2024-05-10T04:50:16.105958+0000","last_active":"2024-05-10T04:50:17.077225+0000","last_peered":"2024-05-10T04:50:17.077225+0000","last_clean":"2024-05-10T04:50:17.077225+0000","last_became_active":"2024-05-10T04:50:16.104254+0000","last_became_peered":"2024-05-10T04:50:16.104254+0000","last_unstale":"2024-05-10T04:50:17.077225+0000","last_undegraded":"2024-05-10T04:50:17.077225+0000","last_fullsized":"2024-05-10T04:50:17.077225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.659081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315602+0000","last_change":"2024-05-10T04:50:15.517690+0000","last_active":"2024-05-10T04:50:17.315602+0000","last_peered":"2024-05-10T04:50:17.315602+0000","last_clean":"2024-05-10T04:50:17.315602+0000","last_became_active":"2024-05-10T04:50:15.517371+0000","last_became_peered":"2024-05-10T04:50:15.517371+0000","last_unstale":"2024-05-10T04:50:17.315602+0000","last_undegraded":"2024-05-10T04:50:17.315602+0000","last_fullsized":"2024-05-10T04:50:17.315602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316653+0000","last_change":"2024-05-10T04:50:16.093622+0000","last_active":"2024-05-10T04:50:17.316653+0000","last_peered":"2024-05-10T04:50:17.316653+0000","last_clean":"2024-05-10T04:50:17.316653+0000","last_became_active":"2024-05-10T04:50:16.093266+0000","last_became_peered":"2024-05-10T04:50:16.093266+0000","last_unstale":"2024-05-10T04:50:17.316653+0000","last_undegraded":"2024-05-10T04:50:17.316653+0000","last_fullsized":"2024-05-10T04:50:17.316653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316221+0000","last_change":"2024-05-10T04:50:15.518189+0000","last_active":"2024-05-10T04:50:17.316221+0000","last_peered":"2024-05-10T04:50:17.316221+0000","last_clean":"2024-05-10T04:50:17.316221+0000","last_became_active":"2024-05-10T04:50:15.517697+0000","last_became_peered":"2024-05-10T04:50:15.517697+0000","last_unstale":"2024-05-10T04:50:17.316221+0000","last_undegraded":"2024-05-10T04:50:17.316221+0000","last_fullsized":"2024-05-10T04:50:17.316221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316057+0000","last_change":"2024-05-10T04:50:16.096819+0000","last_active":"2024-05-10T04:50:17.316057+0000","last_peered":"2024-05-10T04:50:17.316057+0000","last_clean":"2024-05-10T04:50:17.316057+0000","last_became_active":"2024-05-10T04:50:16.096295+0000","last_became_peered":"2024-05-10T04:50:16.096295+0000","last_unstale":"2024-05-10T04:50:17.316057+0000","last_undegraded":"2024-05-10T04:50:17.316057+0000","last_fullsized":"2024-05-10T04:50:17.316057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:25.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315314+0000","last_change":"2024-05-10T04:50:15.506725+0000","last_active":"2024-05-10T04:50:17.315314+0000","last_peered":"2024-05-10T04:50:17.315314+0000","last_clean":"2024-05-10T04:50:17.315314+0000","last_became_active":"2024-05-10T04:50:15.504725+0000","last_became_peered":"2024-05-10T04:50:15.504725+0000","last_unstale":"2024-05-10T04:50:17.315314+0000","last_undegraded":"2024-05-10T04:50:17.315314+0000","last_fullsized":"2024-05-10T04:50:17.315314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:30:20.860044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315294+0000","last_change":"2024-05-10T04:50:16.090939+0000","last_active":"2024-05-10T04:50:17.315294+0000","last_peered":"2024-05-10T04:50:17.315294+0000","last_clean":"2024-05-10T04:50:17.315294+0000","last_became_active":"2024-05-10T04:50:16.090673+0000","last_became_peered":"2024-05-10T04:50:16.090673+0000","last_unstale":"2024-05-10T04:50:17.315294+0000","last_undegraded":"2024-05-10T04:50:17.315294+0000","last_fullsized":"2024-05-10T04:50:17.315294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076581+0000","last_change":"2024-05-10T04:50:15.513992+0000","last_active":"2024-05-10T04:50:17.076581+0000","last_peered":"2024-05-10T04:50:17.076581+0000","last_clean":"2024-05-10T04:50:17.076581+0000","last_became_active":"2024-05-10T04:50:15.512537+0000","last_became_peered":"2024-05-10T04:50:15.512537+0000","last_unstale":"2024-05-10T04:50:17.076581+0000","last_undegraded":"2024-05-10T04:50:17.076581+0000","last_fullsized":"2024-05-10T04:50:17.076581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076497+0000","last_change":"2024-05-10T04:50:16.104592+0000","last_active":"2024-05-10T04:50:17.076497+0000","last_peered":"2024-05-10T04:50:17.076497+0000","last_clean":"2024-05-10T04:50:17.076497+0000","last_became_active":"2024-05-10T04:50:16.104262+0000","last_became_peered":"2024-05-10T04:50:16.104262+0000","last_unstale":"2024-05-10T04:50:17.076497+0000","last_undegraded":"2024-05-10T04:50:17.076497+0000","last_fullsized":"2024-05-10T04:50:17.076497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317517+0000","last_change":"2024-05-10T04:50:15.514321+0000","last_active":"2024-05-10T04:50:17.317517+0000","last_peered":"2024-05-10T04:50:17.317517+0000","last_clean":"2024-05-10T04:50:17.317517+0000","last_became_active":"2024-05-10T04:50:15.514125+0000","last_became_peered":"2024-05-10T04:50:15.514125+0000","last_unstale":"2024-05-10T04:50:17.317517+0000","last_undegraded":"2024-05-10T04:50:17.317517+0000","last_fullsized":"2024-05-10T04:50:17.317517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077233+0000","last_change":"2024-05-10T04:50:16.096429+0000","last_active":"2024-05-10T04:50:17.077233+0000","last_peered":"2024-05-10T04:50:17.077233+0000","last_clean":"2024-05-10T04:50:17.077233+0000","last_became_active":"2024-05-10T04:50:16.095555+0000","last_became_peered":"2024-05-10T04:50:16.095555+0000","last_unstale":"2024-05-10T04:50:17.077233+0000","last_undegraded":"2024-05-10T04:50:17.077233+0000","last_fullsized":"2024-05-10T04:50:17.077233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077087+0000","last_change":"2024-05-10T04:50:15.513574+0000","last_active":"2024-05-10T04:50:17.077087+0000","last_peered":"2024-05-10T04:50:17.077087+0000","last_clean":"2024-05-10T04:50:17.077087+0000","last_became_active":"2024-05-10T04:50:15.513121+0000","last_became_peered":"2024-05-10T04:50:15.513121+0000","last_unstale":"2024-05-10T04:50:17.077087+0000","last_undegraded":"2024-05-10T04:50:17.077087+0000","last_fullsized":"2024-05-10T04:50:17.077087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316443+0000","last_change":"2024-05-10T04:50:16.090959+0000","last_active":"2024-05-10T04:50:17.316443+0000","last_peered":"2024-05-10T04:50:17.316443+0000","last_clean":"2024-05-10T04:50:17.316443+0000","last_became_active":"2024-05-10T04:50:16.090673+0000","last_became_peered":"2024-05-10T04:50:16.090673+0000","last_unstale":"2024-05-10T04:50:17.316443+0000","last_undegraded":"2024-05-10T04:50:17.316443+0000","last_fullsized":"2024-05-10T04:50:17.316443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:36.689058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077005+0000","last_change":"2024-05-10T04:50:15.515867+0000","last_active":"2024-05-10T04:50:17.077005+0000","last_peered":"2024-05-10T04:50:17.077005+0000","last_clean":"2024-05-10T04:50:17.077005+0000","last_became_active":"2024-05-10T04:50:15.515578+0000","last_became_peered":"2024-05-10T04:50:15.515578+0000","last_unstale":"2024-05-10T04:50:17.077005+0000","last_undegraded":"2024-05-10T04:50:17.077005+0000","last_fullsized":"2024-05-10T04:50:17.077005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316807+0000","last_change":"2024-05-10T04:50:16.094129+0000","last_active":"2024-05-10T04:50:17.316807+0000","last_peered":"2024-05-10T04:50:17.316807+0000","last_clean":"2024-05-10T04:50:17.316807+0000","last_became_active":"2024-05-10T04:50:16.093853+0000","last_became_peered":"2024-05-10T04:50:16.093853+0000","last_unstale":"2024-05-10T04:50:17.316807+0000","last_undegraded":"2024-05-10T04:50:17.316807+0000","last_fullsized":"2024-05-10T04:50:17.316807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:01.772418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315820+0000","last_change":"2024-05-10T04:50:15.507954+0000","last_active":"2024-05-10T04:50:17.315820+0000","last_peered":"2024-05-10T04:50:17.315820+0000","last_clean":"2024-05-10T04:50:17.315820+0000","last_became_active":"2024-05-10T04:50:15.507504+0000","last_became_peered":"2024-05-10T04:50:15.507504+0000","last_unstale":"2024-05-10T04:50:17.315820+0000","last_undegraded":"2024-05-10T04:50:17.315820+0000","last_fullsized":"2024-05-10T04:50:17.315820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:57.162592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317277+0000","last_change":"2024-05-10T04:50:16.112035+0000","last_active":"2024-05-10T04:50:17.317277+0000","last_peered":"2024-05-10T04:50:17.317277+0000","last_clean":"2024-05-10T04:50:17.317277+0000","last_became_active":"2024-05-10T04:50:16.111519+0000","last_became_peered":"2024-05-10T04:50:16.111519+0000","last_unstale":"2024-05-10T04:50:17.317277+0000","last_undegraded":"2024-05-10T04:50:17.317277+0000","last_fullsized":"2024-05-10T04:50:17.317277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:24:01.388216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315966+0000","last_change":"2024-05-10T04:50:15.497940+0000","last_active":"2024-05-10T04:50:17.315966+0000","last_peered":"2024-05-10T04:50:17.315966+0000","last_clean":"2024-05-10T04:50:17.315966+0000","last_became_active":"2024-05-10T04:50:15.496471+0000","last_became_peered":"2024-05-10T04:50:15.496471+0000","last_unstale":"2024-05-10T04:50:17.315966+0000","last_undegraded":"2024-05-10T04:50:17.315966+0000","last_fullsized":"2024-05-10T04:50:17.315966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:51.200540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315426+0000","last_change":"2024-05-10T04:50:16.107065+0000","last_active":"2024-05-10T04:50:17.315426+0000","last_peered":"2024-05-10T04:50:17.315426+0000","last_clean":"2024-05-10T04:50:17.315426+0000","last_became_active":"2024-05-10T04:50:16.106704+0000","last_became_peered":"2024-05-10T04:50:16.106704+0000","last_unstale":"2024-05-10T04:50:17.315426+0000","last_undegraded":"2024-05-10T04:50:17.315426+0000","last_fullsized":"2024-05-10T04:50:17.315426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:55.406199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077139+0000","last_change":"2024-05-10T04:50:15.512673+0000","last_active":"2024-05-10T04:50:17.077139+0000","last_peered":"2024-05-10T04:50:17.077139+0000","last_clean":"2024-05-10T04:50:17.077139+0000","last_became_active":"2024-05-10T04:50:15.509967+0000","last_became_peered":"2024-05-10T04:50:15.509967+0000","last_unstale":"2024-05-10T04:50:17.077139+0000","last_undegraded":"2024-05-10T04:50:17.077139+0000","last_fullsized":"2024-05-10T04:50:17.077139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:50:53.486663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317332+0000","last_change":"2024-05-10T04:50:16.117728+0000","last_active":"2024-05-10T04:50:17.317332+0000","last_peered":"2024-05-10T04:50:17.317332+0000","last_clean":"2024-05-10T04:50:17.317332+0000","last_became_active":"2024-05-10T04:50:16.117328+0000","last_became_peered":"2024-05-10T04:50:16.117328+0000","last_unstale":"2024-05-10T04:50:17.317332+0000","last_undegraded":"2024-05-10T04:50:17.317332+0000","last_fullsized":"2024-05-10T04:50:17.317332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:13.581090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315668+0000","last_change":"2024-05-10T04:50:15.505534+0000","last_active":"2024-05-10T04:50:17.315668+0000","last_peered":"2024-05-10T04:50:17.315668+0000","last_clean":"2024-05-10T04:50:17.315668+0000","last_became_active":"2024-05-10T04:50:15.505204+0000","last_became_peered":"2024-05-10T04:50:15.505204+0000","last_unstale":"2024-05-10T04:50:17.315668+0000","last_undegraded":"2024-05-10T04:50:17.315668+0000","last_fullsized":"2024-05-10T04:50:17.315668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315762+0000","last_change":"2024-05-10T04:50:16.107456+0000","last_active":"2024-05-10T04:50:17.315762+0000","last_peered":"2024-05-10T04:50:17.315762+0000","last_clean":"2024-05-10T04:50:17.315762+0000","last_became_active":"2024-05-10T04:50:16.107101+0000","last_became_peered":"2024-05-10T04:50:16.107101+0000","last_unstale":"2024-05-10T04:50:17.315762+0000","last_undegraded":"2024-05-10T04:50:17.315762+0000","last_fullsized":"2024-05-10T04:50:17.315762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077555+0000","last_change":"2024-05-10T04:50:15.510534+0000","last_active":"2024-05-10T04:50:17.077555+0000","last_peered":"2024-05-10T04:50:17.077555+0000","last_clean":"2024-05-10T04:50:17.077555+0000","last_became_active":"2024-05-10T04:50:15.510203+0000","last_became_peered":"2024-05-10T04:50:15.510203+0000","last_unstale":"2024-05-10T04:50:17.077555+0000","last_undegraded":"2024-05-10T04:50:17.077555+0000","last_fullsized":"2024-05-10T04:50:17.077555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:30:20.860044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316071+0000","last_change":"2024-05-10T04:50:16.116503+0000","last_active":"2024-05-10T04:50:17.316071+0000","last_peered":"2024-05-10T04:50:17.316071+0000","last_clean":"2024-05-10T04:50:17.316071+0000","last_became_active":"2024-05-10T04:50:16.116218+0000","last_became_peered":"2024-05-10T04:50:16.116218+0000","last_unstale":"2024-05-10T04:50:17.316071+0000","last_undegraded":"2024-05-10T04:50:17.316071+0000","last_fullsized":"2024-05-10T04:50:17.316071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:43:59.737316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317154+0000","last_change":"2024-05-10T04:50:15.507067+0000","last_active":"2024-05-10T04:50:17.317154+0000","last_peered":"2024-05-10T04:50:17.317154+0000","last_clean":"2024-05-10T04:50:17.317154+0000","last_became_active":"2024-05-10T04:50:15.506306+0000","last_became_peered":"2024-05-10T04:50:15.506306+0000","last_unstale":"2024-05-10T04:50:17.317154+0000","last_undegraded":"2024-05-10T04:50:17.317154+0000","last_fullsized":"2024-05-10T04:50:17.317154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:51.200540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317588+0000","last_change":"2024-05-10T04:50:16.112236+0000","last_active":"2024-05-10T04:50:17.317588+0000","last_peered":"2024-05-10T04:50:17.317588+0000","last_clean":"2024-05-10T04:50:17.317588+0000","last_became_active":"2024-05-10T04:50:16.111551+0000","last_became_peered":"2024-05-10T04:50:16.111551+0000","last_unstale":"2024-05-10T04:50:17.317588+0000","last_undegraded":"2024-05-10T04:50:17.317588+0000","last_fullsized":"2024-05-10T04:50:17.317588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:02.230401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076869+0000","last_change":"2024-05-10T04:50:15.511205+0000","last_active":"2024-05-10T04:50:17.076869+0000","last_peered":"2024-05-10T04:50:17.076869+0000","last_clean":"2024-05-10T04:50:17.076869+0000","last_became_active":"2024-05-10T04:50:15.510947+0000","last_became_peered":"2024-05-10T04:50:15.510947+0000","last_unstale":"2024-05-10T04:50:17.076869+0000","last_undegraded":"2024-05-10T04:50:17.076869+0000","last_fullsized":"2024-05-10T04:50:17.076869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:57.162592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077176+0000","last_change":"2024-05-10T04:50:16.101982+0000","last_active":"2024-05-10T04:50:17.077176+0000","last_peered":"2024-05-10T04:50:17.077176+0000","last_clean":"2024-05-10T04:50:17.077176+0000","last_became_active":"2024-05-10T04:50:16.092143+0000","last_became_peered":"2024-05-10T04:50:16.092143+0000","last_unstale":"2024-05-10T04:50:17.077176+0000","last_undegraded":"2024-05-10T04:50:17.077176+0000","last_fullsized":"2024-05-10T04:50:17.077176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:24:01.388216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076958+0000","last_change":"2024-05-10T04:50:15.509745+0000","last_active":"2024-05-10T04:50:17.076958+0000","last_peered":"2024-05-10T04:50:17.076958+0000","last_clean":"2024-05-10T04:50:17.076958+0000","last_became_active":"2024-05-10T04:50:15.509429+0000","last_became_peered":"2024-05-10T04:50:15.509429+0000","last_unstale":"2024-05-10T04:50:17.076958+0000","last_undegraded":"2024-05-10T04:50:17.076958+0000","last_fullsized":"2024-05-10T04:50:17.076958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:37.683206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316304+0000","last_change":"2024-05-10T04:50:16.091478+0000","last_active":"2024-05-10T04:50:17.316304+0000","last_peered":"2024-05-10T04:50:17.316304+0000","last_clean":"2024-05-10T04:50:17.316304+0000","last_became_active":"2024-05-10T04:50:16.091245+0000","last_became_peered":"2024-05-10T04:50:16.091245+0000","last_unstale":"2024-05-10T04:50:17.316304+0000","last_undegraded":"2024-05-10T04:50:17.316304+0000","last_fullsized":"2024-05-10T04:50:17.316304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:26.121531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076468+0000","last_change":"2024-05-10T04:50:16.093555+0000","last_active":"2024-05-10T04:50:17.076468+0000","last_peered":"2024-05-10T04:50:17.076468+0000","last_clean":"2024-05-10T04:50:17.076468+0000","last_became_active":"2024-05-10T04:50:16.093088+0000","last_became_peered":"2024-05-10T04:50:16.093088+0000","last_unstale":"2024-05-10T04:50:17.076468+0000","last_undegraded":"2024-05-10T04:50:17.076468+0000","last_fullsized":"2024-05-10T04:50:17.076468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077611+0000","last_change":"2024-05-10T04:50:15.509023+0000","last_active":"2024-05-10T04:50:17.077611+0000","last_peered":"2024-05-10T04:50:17.077611+0000","last_clean":"2024-05-10T04:50:17.077611+0000","last_became_active":"2024-05-10T04:50:15.508723+0000","last_became_peered":"2024-05-10T04:50:15.508723+0000","last_unstale":"2024-05-10T04:50:17.077611+0000","last_undegraded":"2024-05-10T04:50:17.077611+0000","last_fullsized":"2024-05-10T04:50:17.077611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:50:53.486663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315481+0000","last_change":"2024-05-10T04:50:16.108380+0000","last_active":"2024-05-10T04:50:17.315481+0000","last_peered":"2024-05-10T04:50:17.315481+0000","last_clean":"2024-05-10T04:50:17.315481+0000","last_became_active":"2024-05-10T04:50:16.107863+0000","last_became_peered":"2024-05-10T04:50:16.107863+0000","last_unstale":"2024-05-10T04:50:17.315481+0000","last_undegraded":"2024-05-10T04:50:17.315481+0000","last_fullsized":"2024-05-10T04:50:17.315481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076863+0000","last_change":"2024-05-10T04:50:15.505795+0000","last_active":"2024-05-10T04:50:17.076863+0000","last_peered":"2024-05-10T04:50:17.076863+0000","last_clean":"2024-05-10T04:50:17.076863+0000","last_became_active":"2024-05-10T04:50:15.503636+0000","last_became_peered":"2024-05-10T04:50:15.503636+0000","last_unstale":"2024-05-10T04:50:17.076863+0000","last_undegraded":"2024-05-10T04:50:17.076863+0000","last_fullsized":"2024-05-10T04:50:17.076863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:50:16.094417+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:50:16.094417+0000","last_peered":"2024-05-10T04:50:16.094417+0000","last_clean":"2024-05-10T04:50:16.094417+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:50:16.094417+0000","last_undegraded":"2024-05-10T04:50:16.094417+0000","last_fullsized":"2024-05-10T04:50:16.094417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315146+0000","last_change":"2024-05-10T04:50:16.092439+0000","last_active":"2024-05-10T04:50:17.315146+0000","last_peered":"2024-05-10T04:50:17.315146+0000","last_clean":"2024-05-10T04:50:17.315146+0000","last_became_active":"2024-05-10T04:50:16.092165+0000","last_became_peered":"2024-05-10T04:50:16.092165+0000","last_unstale":"2024-05-10T04:50:17.315146+0000","last_undegraded":"2024-05-10T04:50:17.315146+0000","last_fullsized":"2024-05-10T04:50:17.315146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:26.805209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315978+0000","last_change":"2024-05-10T04:50:15.523201+0000","last_active":"2024-05-10T04:50:17.315978+0000","last_peered":"2024-05-10T04:50:17.315978+0000","last_clean":"2024-05-10T04:50:17.315978+0000","last_became_active":"2024-05-10T04:50:15.522923+0000","last_became_peered":"2024-05-10T04:50:15.522923+0000","last_unstale":"2024-05-10T04:50:17.315978+0000","last_undegraded":"2024-05-10T04:50:17.315978+0000","last_fullsized":"2024-05-10T04:50:17.315978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317655+0000","last_change":"2024-05-10T04:50:15.520251+0000","last_active":"2024-05-10T04:50:17.317655+0000","last_peered":"2024-05-10T04:50:17.317655+0000","last_clean":"2024-05-10T04:50:17.317655+0000","last_became_active":"2024-05-10T04:50:15.519958+0000","last_became_peered":"2024-05-10T04:50:15.519958+0000","last_unstale":"2024-05-10T04:50:17.317655+0000","last_undegraded":"2024-05-10T04:50:17.317655+0000","last_fullsized":"2024-05-10T04:50:17.317655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:15.316078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076829+0000","last_change":"2024-05-10T04:50:16.094812+0000","last_active":"2024-05-10T04:50:17.076829+0000","last_peered":"2024-05-10T04:50:17.076829+0000","last_clean":"2024-05-10T04:50:17.076829+0000","last_became_active":"2024-05-10T04:50:16.093699+0000","last_became_peered":"2024-05-10T04:50:16.093699+0000","last_unstale":"2024-05-10T04:50:17.076829+0000","last_undegraded":"2024-05-10T04:50:17.076829+0000","last_fullsized":"2024-05-10T04:50:17.076829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076920+0000","last_change":"2024-05-10T04:50:15.514342+0000","last_active":"2024-05-10T04:50:17.076920+0000","last_peered":"2024-05-10T04:50:17.076920+0000","last_clean":"2024-05-10T04:50:17.076920+0000","last_became_active":"2024-05-10T04:50:15.514053+0000","last_became_peered":"2024-05-10T04:50:15.514053+0000","last_unstale":"2024-05-10T04:50:17.076920+0000","last_undegraded":"2024-05-10T04:50:17.076920+0000","last_fullsized":"2024-05-10T04:50:17.076920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:15.316078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315978+0000","last_change":"2024-05-10T04:50:16.101714+0000","last_active":"2024-05-10T04:50:17.315978+0000","last_peered":"2024-05-10T04:50:17.315978+0000","last_clean":"2024-05-10T04:50:17.315978+0000","last_became_active":"2024-05-10T04:50:16.101380+0000","last_became_peered":"2024-05-10T04:50:16.101380+0000","last_unstale":"2024-05-10T04:50:17.315978+0000","last_undegraded":"2024-05-10T04:50:17.315978+0000","last_fullsized":"2024-05-10T04:50:17.315978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316044+0000","last_change":"2024-05-10T04:50:15.516370+0000","last_active":"2024-05-10T04:50:17.316044+0000","last_peered":"2024-05-10T04:50:17.316044+0000","last_clean":"2024-05-10T04:50:17.316044+0000","last_became_active":"2024-05-10T04:50:15.514786+0000","last_became_peered":"2024-05-10T04:50:15.514786+0000","last_unstale":"2024-05-10T04:50:17.316044+0000","last_undegraded":"2024-05-10T04:50:17.316044+0000","last_fullsized":"2024-05-10T04:50:17.316044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316311+0000","last_change":"2024-05-10T04:50:16.091731+0000","last_active":"2024-05-10T04:50:17.316311+0000","last_peered":"2024-05-10T04:50:17.316311+0000","last_clean":"2024-05-10T04:50:17.316311+0000","last_became_active":"2024-05-10T04:50:16.091459+0000","last_became_peered":"2024-05-10T04:50:16.091459+0000","last_unstale":"2024-05-10T04:50:17.316311+0000","last_undegraded":"2024-05-10T04:50:17.316311+0000","last_fullsized":"2024-05-10T04:50:17.316311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315645+0000","last_change":"2024-05-10T04:50:15.520260+0000","last_active":"2024-05-10T04:50:17.315645+0000","last_peered":"2024-05-10T04:50:17.315645+0000","last_clean":"2024-05-10T04:50:17.315645+0000","last_became_active":"2024-05-10T04:50:15.520059+0000","last_became_peered":"2024-05-10T04:50:15.520059+0000","last_unstale":"2024-05-10T04:50:17.315645+0000","last_undegraded":"2024-05-10T04:50:17.315645+0000","last_fullsized":"2024-05-10T04:50:17.315645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:25.798441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316457+0000","last_change":"2024-05-10T04:50:16.091927+0000","last_active":"2024-05-10T04:50:17.316457+0000","last_peered":"2024-05-10T04:50:17.316457+0000","last_clean":"2024-05-10T04:50:17.316457+0000","last_became_active":"2024-05-10T04:50:16.091543+0000","last_became_peered":"2024-05-10T04:50:16.091543+0000","last_unstale":"2024-05-10T04:50:17.316457+0000","last_undegraded":"2024-05-10T04:50:17.316457+0000","last_fullsized":"2024-05-10T04:50:17.316457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:16.322846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076410+0000","last_change":"2024-05-10T04:50:15.517935+0000","last_active":"2024-05-10T04:50:17.076410+0000","last_peered":"2024-05-10T04:50:17.076410+0000","last_clean":"2024-05-10T04:50:17.076410+0000","last_became_active":"2024-05-10T04:50:15.517528+0000","last_became_peered":"2024-05-10T04:50:15.517528+0000","last_unstale":"2024-05-10T04:50:17.076410+0000","last_undegraded":"2024-05-10T04:50:17.076410+0000","last_fullsized":"2024-05-10T04:50:17.076410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315174+0000","last_change":"2024-05-10T04:50:16.096422+0000","last_active":"2024-05-10T04:50:17.315174+0000","last_peered":"2024-05-10T04:50:17.315174+0000","last_clean":"2024-05-10T04:50:17.315174+0000","last_became_active":"2024-05-10T04:50:16.095048+0000","last_became_peered":"2024-05-10T04:50:16.095048+0000","last_unstale":"2024-05-10T04:50:17.315174+0000","last_undegraded":"2024-05-10T04:50:17.315174+0000","last_fullsized":"2024-05-10T04:50:17.315174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:55.406199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076765+0000","last_change":"2024-05-10T04:50:15.510474+0000","last_active":"2024-05-10T04:50:17.076765+0000","last_peered":"2024-05-10T04:50:17.076765+0000","last_clean":"2024-05-10T04:50:17.076765+0000","last_became_active":"2024-05-10T04:50:15.509890+0000","last_became_peered":"2024-05-10T04:50:15.509890+0000","last_unstale":"2024-05-10T04:50:17.076765+0000","last_undegraded":"2024-05-10T04:50:17.076765+0000","last_fullsized":"2024-05-10T04:50:17.076765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315711+0000","last_change":"2024-05-10T04:50:16.091690+0000","last_active":"2024-05-10T04:50:17.315711+0000","last_peered":"2024-05-10T04:50:17.315711+0000","last_clean":"2024-05-10T04:50:17.315711+0000","last_became_active":"2024-05-10T04:50:16.090685+0000","last_became_peered":"2024-05-10T04:50:16.090685+0000","last_unstale":"2024-05-10T04:50:17.315711+0000","last_undegraded":"2024-05-10T04:50:17.315711+0000","last_fullsized":"2024-05-10T04:50:17.315711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317278+0000","last_change":"2024-05-10T04:50:15.517573+0000","last_active":"2024-05-10T04:50:17.317278+0000","last_peered":"2024-05-10T04:50:17.317278+0000","last_clean":"2024-05-10T04:50:17.317278+0000","last_became_active":"2024-05-10T04:50:15.517108+0000","last_became_peered":"2024-05-10T04:50:15.517108+0000","last_unstale":"2024-05-10T04:50:17.317278+0000","last_undegraded":"2024-05-10T04:50:17.317278+0000","last_fullsized":"2024-05-10T04:50:17.317278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:30.795068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316202+0000","last_change":"2024-05-10T04:50:16.111071+0000","last_active":"2024-05-10T04:50:17.316202+0000","last_peered":"2024-05-10T04:50:17.316202+0000","last_clean":"2024-05-10T04:50:17.316202+0000","last_became_active":"2024-05-10T04:50:16.109828+0000","last_became_peered":"2024-05-10T04:50:16.109828+0000","last_unstale":"2024-05-10T04:50:17.316202+0000","last_undegraded":"2024-05-10T04:50:17.316202+0000","last_fullsized":"2024-05-10T04:50:17.316202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077673+0000","last_change":"2024-05-10T04:50:15.512759+0000","last_active":"2024-05-10T04:50:17.077673+0000","last_peered":"2024-05-10T04:50:17.077673+0000","last_clean":"2024-05-10T04:50:17.077673+0000","last_became_active":"2024-05-10T04:50:15.512504+0000","last_became_peered":"2024-05-10T04:50:15.512504+0000","last_unstale":"2024-05-10T04:50:17.077673+0000","last_undegraded":"2024-05-10T04:50:17.077673+0000","last_fullsized":"2024-05-10T04:50:17.077673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317426+0000","last_change":"2024-05-10T04:50:16.120261+0000","last_active":"2024-05-10T04:50:17.317426+0000","last_peered":"2024-05-10T04:50:17.317426+0000","last_clean":"2024-05-10T04:50:17.317426+0000","last_became_active":"2024-05-10T04:50:16.119987+0000","last_became_peered":"2024-05-10T04:50:16.119987+0000","last_unstale":"2024-05-10T04:50:17.317426+0000","last_undegraded":"2024-05-10T04:50:17.317426+0000","last_fullsized":"2024-05-10T04:50:17.317426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:37.923918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076976+0000","last_change":"2024-05-10T04:50:15.510033+0000","last_active":"2024-05-10T04:50:17.076976+0000","last_peered":"2024-05-10T04:50:17.076976+0000","last_clean":"2024-05-10T04:50:17.076976+0000","last_became_active":"2024-05-10T04:50:15.509678+0000","last_became_peered":"2024-05-10T04:50:15.509678+0000","last_unstale":"2024-05-10T04:50:17.076976+0000","last_undegraded":"2024-05-10T04:50:17.076976+0000","last_fullsized":"2024-05-10T04:50:17.076976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076880+0000","last_change":"2024-05-10T04:50:16.114747+0000","last_active":"2024-05-10T04:50:17.076880+0000","last_peered":"2024-05-10T04:50:17.076880+0000","last_clean":"2024-05-10T04:50:17.076880+0000","last_became_active":"2024-05-10T04:50:16.108054+0000","last_became_peered":"2024-05-10T04:50:16.108054+0000","last_unstale":"2024-05-10T04:50:17.076880+0000","last_undegraded":"2024-05-10T04:50:17.076880+0000","last_fullsized":"2024-05-10T04:50:17.076880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:02.230401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077792+0000","last_change":"2024-05-10T04:50:15.511828+0000","last_active":"2024-05-10T04:50:17.077792+0000","last_peered":"2024-05-10T04:50:17.077792+0000","last_clean":"2024-05-10T04:50:17.077792+0000","last_became_active":"2024-05-10T04:50:15.508490+0000","last_became_peered":"2024-05-10T04:50:15.508490+0000","last_unstale":"2024-05-10T04:50:17.077792+0000","last_undegraded":"2024-05-10T04:50:17.077792+0000","last_fullsized":"2024-05-10T04:50:17.077792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:37.683206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317311+0000","last_change":"2024-05-10T04:50:16.118853+0000","last_active":"2024-05-10T04:50:17.317311+0000","last_peered":"2024-05-10T04:50:17.317311+0000","last_clean":"2024-05-10T04:50:17.317311+0000","last_became_active":"2024-05-10T04:50:16.118491+0000","last_became_peered":"2024-05-10T04:50:16.118491+0000","last_unstale":"2024-05-10T04:50:17.317311+0000","last_undegraded":"2024-05-10T04:50:17.317311+0000","last_fullsized":"2024-05-10T04:50:17.317311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:52.596368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316201+0000","last_change":"2024-05-10T04:50:16.111132+0000","last_active":"2024-05-10T04:50:17.316201+0000","last_peered":"2024-05-10T04:50:17.316201+0000","last_clean":"2024-05-10T04:50:17.316201+0000","last_became_active":"2024-05-10T04:50:16.110819+0000","last_became_peered":"2024-05-10T04:50:16.110819+0000","last_unstale":"2024-05-10T04:50:17.316201+0000","last_undegraded":"2024-05-10T04:50:17.316201+0000","last_fullsized":"2024-05-10T04:50:17.316201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077705+0000","last_change":"2024-05-10T04:50:16.085668+0000","last_active":"2024-05-10T04:50:17.077705+0000","last_peered":"2024-05-10T04:50:17.077705+0000","last_clean":"2024-05-10T04:50:17.077705+0000","last_became_active":"2024-05-10T04:50:16.084595+0000","last_became_peered":"2024-05-10T04:50:16.084595+0000","last_unstale":"2024-05-10T04:50:17.077705+0000","last_undegraded":"2024-05-10T04:50:17.077705+0000","last_fullsized":"2024-05-10T04:50:17.077705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:01.772418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077071+0000","last_change":"2024-05-10T04:50:16.104882+0000","last_active":"2024-05-10T04:50:17.077071+0000","last_peered":"2024-05-10T04:50:17.077071+0000","last_clean":"2024-05-10T04:50:17.077071+0000","last_became_active":"2024-05-10T04:50:16.101840+0000","last_became_peered":"2024-05-10T04:50:16.101840+0000","last_unstale":"2024-05-10T04:50:17.077071+0000","last_undegraded":"2024-05-10T04:50:17.077071+0000","last_fullsized":"2024-05-10T04:50:17.077071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:07.192432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315884+0000","last_change":"2024-05-10T04:50:16.096600+0000","last_active":"2024-05-10T04:50:17.315884+0000","last_peered":"2024-05-10T04:50:17.315884+0000","last_clean":"2024-05-10T04:50:17.315884+0000","last_became_active":"2024-05-10T04:50:16.095907+0000","last_became_peered":"2024-05-10T04:50:16.095907+0000","last_unstale":"2024-05-10T04:50:17.315884+0000","last_undegraded":"2024-05-10T04:50:17.315884+0000","last_fullsized":"2024-05-10T04:50:17.315884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315600+0000","last_change":"2024-05-10T04:50:16.097111+0000","last_active":"2024-05-10T04:50:17.315600+0000","last_peered":"2024-05-10T04:50:17.315600+0000","last_clean":"2024-05-10T04:50:17.315600+0000","last_became_active":"2024-05-10T04:50:16.096855+0000","last_became_peered":"2024-05-10T04:50:16.096855+0000","last_unstale":"2024-05-10T04:50:17.315600+0000","last_undegraded":"2024-05-10T04:50:17.315600+0000","last_fullsized":"2024-05-10T04:50:17.315600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076898+0000","last_change":"2024-05-10T04:50:16.100106+0000","last_active":"2024-05-10T04:50:17.076898+0000","last_peered":"2024-05-10T04:50:17.076898+0000","last_clean":"2024-05-10T04:50:17.076898+0000","last_became_active":"2024-05-10T04:50:16.095317+0000","last_became_peered":"2024-05-10T04:50:16.095317+0000","last_unstale":"2024-05-10T04:50:17.076898+0000","last_undegraded":"2024-05-10T04:50:17.076898+0000","last_fullsized":"2024-05-10T04:50:17.076898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316523+0000","last_change":"2024-05-10T04:50:16.103396+0000","last_active":"2024-05-10T04:50:17.316523+0000","last_peered":"2024-05-10T04:50:17.316523+0000","last_clean":"2024-05-10T04:50:17.316523+0000","last_became_active":"2024-05-10T04:50:16.102768+0000","last_became_peered":"2024-05-10T04:50:16.102768+0000","last_unstale":"2024-05-10T04:50:17.316523+0000","last_undegraded":"2024-05-10T04:50:17.316523+0000","last_fullsized":"2024-05-10T04:50:17.316523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315919+0000","last_change":"2024-05-10T04:50:16.095965+0000","last_active":"2024-05-10T04:50:17.315919+0000","last_peered":"2024-05-10T04:50:17.315919+0000","last_clean":"2024-05-10T04:50:17.315919+0000","last_became_active":"2024-05-10T04:50:16.095711+0000","last_became_peered":"2024-05-10T04:50:16.095711+0000","last_unstale":"2024-05-10T04:50:17.315919+0000","last_undegraded":"2024-05-10T04:50:17.315919+0000","last_fullsized":"2024-05-10T04:50:17.315919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076712+0000","last_change":"2024-05-10T04:50:16.107080+0000","last_active":"2024-05-10T04:50:17.076712+0000","last_peered":"2024-05-10T04:50:17.076712+0000","last_clean":"2024-05-10T04:50:17.076712+0000","last_became_active":"2024-05-10T04:50:16.102437+0000","last_became_peered":"2024-05-10T04:50:16.102437+0000","last_unstale":"2024-05-10T04:50:17.076712+0000","last_undegraded":"2024-05-10T04:50:17.076712+0000","last_fullsized":"2024-05-10T04:50:17.076712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:37.923918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315288+0000","last_change":"2024-05-10T04:50:16.095687+0000","last_active":"2024-05-10T04:50:17.315288+0000","last_peered":"2024-05-10T04:50:17.315288+0000","last_clean":"2024-05-10T04:50:17.315288+0000","last_became_active":"2024-05-10T04:50:16.093813+0000","last_became_peered":"2024-05-10T04:50:16.093813+0000","last_unstale":"2024-05-10T04:50:17.315288+0000","last_undegraded":"2024-05-10T04:50:17.315288+0000","last_fullsized":"2024-05-10T04:50:17.315288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076694+0000","last_change":"2024-05-10T04:50:16.108911+0000","last_active":"2024-05-10T04:50:17.076694+0000","last_peered":"2024-05-10T04:50:17.076694+0000","last_clean":"2024-05-10T04:50:17.076694+0000","last_became_active":"2024-05-10T04:50:16.107713+0000","last_became_peered":"2024-05-10T04:50:16.107713+0000","last_unstale":"2024-05-10T04:50:17.076694+0000","last_undegraded":"2024-05-10T04:50:17.076694+0000","last_fullsized":"2024-05-10T04:50:17.076694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315797+0000","last_change":"2024-05-10T04:50:16.097207+0000","last_active":"2024-05-10T04:50:17.315797+0000","last_peered":"2024-05-10T04:50:17.315797+0000","last_clean":"2024-05-10T04:50:17.315797+0000","last_became_active":"2024-05-10T04:50:16.093993+0000","last_became_peered":"2024-05-10T04:50:16.093993+0000","last_unstale":"2024-05-10T04:50:17.315797+0000","last_undegraded":"2024-05-10T04:50:17.315797+0000","last_fullsized":"2024-05-10T04:50:17.315797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315905+0000","last_change":"2024-05-10T04:50:16.096624+0000","last_active":"2024-05-10T04:50:17.315905+0000","last_peered":"2024-05-10T04:50:17.315905+0000","last_clean":"2024-05-10T04:50:17.315905+0000","last_became_active":"2024-05-10T04:50:16.096111+0000","last_became_peered":"2024-05-10T04:50:16.096111+0000","last_unstale":"2024-05-10T04:50:17.315905+0000","last_undegraded":"2024-05-10T04:50:17.315905+0000","last_fullsized":"2024-05-10T04:50:17.315905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:50:21.132 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:50:21.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.428+0000 7f616b400700 1 Processor -- start 2024-05-10T04:50:21.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.428+0000 7f616b400700 1 -- start start 2024-05-10T04:50:21.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.429+0000 7f616b400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f616415bfe0 0x7f616415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.429+0000 7f616b400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6164161fb0 0x7f61641623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.429+0000 7f616b400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f61640b5890 0x7f61640b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.429+0000 7f616b400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616415c3f0 con 0x7f616415bfe0 2024-05-10T04:50:21.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.429+0000 7f616b400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61640b61e0 con 0x7f6164161fb0 2024-05-10T04:50:21.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.429+0000 7f616b400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6164162a70 con 0x7f61640b5890 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f616415bfe0 0x7f616415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f616415bfe0 0x7f616415f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55964/0 (socket says 172.21.15.82:55964) 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 -- 172.21.15.82:0/1425180368 learned_addr learned my addr 172.21.15.82:0/1425180368 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6163e00700 1 --2- 172.21.15.82:0/1425180368 >> v2:172.21.15.129:3300/0 conn(0x7f6164161fb0 0x7f61641623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 -- 172.21.15.82:0/1425180368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f61640b5890 msgr2=0x7f61640b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6169400700 1 --2- 172.21.15.82:0/1425180368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f61640b5890 0x7f61640b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 --2- 172.21.15.82:0/1425180368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f61640b5890 0x7f61640b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 -- 172.21.15.82:0/1425180368 >> v2:172.21.15.129:3300/0 conn(0x7f6164161fb0 msgr2=0x7f61641623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 --2- 172.21.15.82:0/1425180368 >> v2:172.21.15.129:3300/0 conn(0x7f6164161fb0 0x7f61641623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 -- 172.21.15.82:0/1425180368 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6164162d50 con 0x7f616415bfe0 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6163e00700 1 --2- 172.21.15.82:0/1425180368 >> v2:172.21.15.129:3300/0 conn(0x7f6164161fb0 0x7f61641623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6169400700 1 --2- 172.21.15.82:0/1425180368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f61640b5890 0x7f61640b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:21.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.430+0000 7f6168a00700 1 --2- 172.21.15.82:0/1425180368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616415f4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61640b66e0 tx=0x7f6158009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35d7f74b141f8c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f6163400700 1 -- 172.21.15.82:0/1425180368 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800b870 con 0x7f616415bfe0 2024-05-10T04:50:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f6163400700 1 -- 172.21.15.82:0/1425180368 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800b9d0 con 0x7f616415bfe0 2024-05-10T04:50:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f6163400700 1 -- 172.21.15.82:0/1425180368 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800bd60 con 0x7f616415bfe0 2024-05-10T04:50:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f616b400700 1 -- 172.21.15.82:0/1425180368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 msgr2=0x7f616415f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f616b400700 1 --2- 172.21.15.82:0/1425180368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616415f4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61640b66e0 tx=0x7f6158009bd0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f616b400700 1 -- 172.21.15.82:0/1425180368 shutdown_connections 2024-05-10T04:50:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f616b400700 1 --2- 172.21.15.82:0/1425180368 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f61640b5890 0x7f61640b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f616b400700 1 --2- 172.21.15.82:0/1425180368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616415f4f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f616b400700 1 --2- 172.21.15.82:0/1425180368 >> v2:172.21.15.129:3300/0 conn(0x7f6164161fb0 0x7f61641623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.431+0000 7f616b400700 1 -- 172.21.15.82:0/1425180368 >> 172.21.15.82:0/1425180368 conn(0x7f61640d0a70 msgr2=0x7f61640d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.432+0000 7f616b400700 1 -- 172.21.15.82:0/1425180368 shutdown_connections 2024-05-10T04:50:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.432+0000 7f616b400700 1 -- 172.21.15.82:0/1425180368 wait complete. 2024-05-10T04:50:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.434+0000 7f616b400700 1 Processor -- start 2024-05-10T04:50:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.434+0000 7f616b400700 1 -- start start 2024-05-10T04:50:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.435+0000 7f616b400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61640b5890 0x7f616414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.435+0000 7f616b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.435+0000 7f616b400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6164161fb0 0x7f61640cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.435+0000 7f616b400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640ca0b0 con 0x7f616415bfe0 2024-05-10T04:50:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.435+0000 7f616b400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640c7d30 con 0x7f61640b5890 2024-05-10T04:50:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.435+0000 7f616b400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61640ca300 con 0x7f6164161fb0 2024-05-10T04:50:21.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616414ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55966/0 (socket says 172.21.15.82:55966) 2024-05-10T04:50:21.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 -- 172.21.15.82:0/2460471500 learned_addr learned my addr 172.21.15.82:0/2460471500 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:21.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6168a00700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61640b5890 0x7f616414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6169400700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6164161fb0 0x7f61640cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 -- 172.21.15.82:0/2460471500 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6164161fb0 msgr2=0x7f61640cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6164161fb0 0x7f61640cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 -- 172.21.15.82:0/2460471500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61640b5890 msgr2=0x7f616414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61640b5890 0x7f616414a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 -- 172.21.15.82:0/2460471500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009550 con 0x7f616415bfe0 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6163e00700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616414ae70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f615000c7f0 tx=0x7f615000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.436+0000 7f6160c00700 1 -- 172.21.15.82:0/2460471500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150011800 con 0x7f616415bfe0 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.437+0000 7f6160c00700 1 -- 172.21.15.82:0/2460471500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6150011960 con 0x7f616415bfe0 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.437+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61640ca5e0 con 0x7f616415bfe0 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.437+0000 7f6160c00700 1 -- 172.21.15.82:0/2460471500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150011cf0 con 0x7f616415bfe0 2024-05-10T04:50:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.437+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61640c79c0 con 0x7f616415bfe0 2024-05-10T04:50:21.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.438+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61640c7b80 con 0x7f616415bfe0 2024-05-10T04:50:21.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.439+0000 7f6160c00700 1 -- 172.21.15.82:0/2460471500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6150018360 con 0x7f616415bfe0 2024-05-10T04:50:21.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.439+0000 7f6160c00700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f614406ac90 0x7f614406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.439+0000 7f6160c00700 1 -- 172.21.15.82:0/2460471500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6150089280 con 0x7f616415bfe0 2024-05-10T04:50:21.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.440+0000 7f6168a00700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f614406ac90 0x7f614406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.440+0000 7f6168a00700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f614406ac90 0x7f614406d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6158014040 tx=0x7f6158008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:21.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.444+0000 7f6160c00700 1 -- 172.21.15.82:0/2460471500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6150054330 con 0x7f616415bfe0 2024-05-10T04:50:21.471 INFO:tasks.ceph.mds.b.smithi129.stderr:2024-05-10T04:50:21.470+0000 7f1274400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:50:21.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.644+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61640d2f70 con 0x7f614406ac90 2024-05-10T04:50:21.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.652+0000 7f6160c00700 1 -- 172.21.15.82:0/2460471500 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264670 (secure 0 0 0) 0x7f61640d2f70 con 0x7f614406ac90 2024-05-10T04:50:21.656 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:21.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f614406ac90 msgr2=0x7f614406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f614406ac90 0x7f614406d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6158014040 tx=0x7f6158008030 comp rx=0 tx=0).stop 2024-05-10T04:50:21.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 msgr2=0x7f616414ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616414ae70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f615000c7f0 tx=0x7f615000cb00 comp rx=0 tx=0).stop 2024-05-10T04:50:21.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 shutdown_connections 2024-05-10T04:50:21.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f614406ac90 0x7f614406d1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6164161fb0 0x7f61640cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f61640b5890 0x7f616414a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 --2- 172.21.15.82:0/2460471500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f616415bfe0 0x7f616414ae70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 >> 172.21.15.82:0/2460471500 conn(0x7f61640d0a70 msgr2=0x7f61640b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:21.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 shutdown_connections 2024-05-10T04:50:21.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.656+0000 7f616b400700 1 -- 172.21.15.82:0/2460471500 wait complete. 2024-05-10T04:50:21.659 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:50:21.681 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-10T04:50:20.969788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001138"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317468+0000","last_change":"2024-05-10T04:50:16.116571+0000","last_active":"2024-05-10T04:50:17.317468+0000","last_peered":"2024-05-10T04:50:17.317468+0000","last_clean":"2024-05-10T04:50:17.317468+0000","last_became_active":"2024-05-10T04:50:16.114134+0000","last_became_peered":"2024-05-10T04:50:16.114134+0000","last_unstale":"2024-05-10T04:50:17.317468+0000","last_undegraded":"2024-05-10T04:50:17.317468+0000","last_fullsized":"2024-05-10T04:50:17.317468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:48.157294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076993+0000","last_change":"2024-05-10T04:50:16.105444+0000","last_active":"2024-05-10T04:50:17.076993+0000","last_peered":"2024-05-10T04:50:17.076993+0000","last_clean":"2024-05-10T04:50:17.076993+0000","last_became_active":"2024-05-10T04:50:16.105168+0000","last_became_peered":"2024-05-10T04:50:16.105168+0000","last_unstale":"2024-05-10T04:50:17.076993+0000","last_undegraded":"2024-05-10T04:50:17.076993+0000","last_fullsized":"2024-05-10T04:50:17.076993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315713+0000","last_change":"2024-05-10T04:50:16.095062+0000","last_active":"2024-05-10T04:50:17.315713+0000","last_peered":"2024-05-10T04:50:17.315713+0000","last_clean":"2024-05-10T04:50:17.315713+0000","last_became_active":"2024-05-10T04:50:16.094786+0000","last_became_peered":"2024-05-10T04:50:16.094786+0000","last_unstale":"2024-05-10T04:50:17.315713+0000","last_undegraded":"2024-05-10T04:50:17.315713+0000","last_fullsized":"2024-05-10T04:50:17.315713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:32.856707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077027+0000","last_change":"2024-05-10T04:50:16.105222+0000","last_active":"2024-05-10T04:50:17.077027+0000","last_peered":"2024-05-10T04:50:17.077027+0000","last_clean":"2024-05-10T04:50:17.077027+0000","last_became_active":"2024-05-10T04:50:16.104534+0000","last_became_peered":"2024-05-10T04:50:16.104534+0000","last_unstale":"2024-05-10T04:50:17.077027+0000","last_undegraded":"2024-05-10T04:50:17.077027+0000","last_fullsized":"2024-05-10T04:50:17.077027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:13.581090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316177+0000","last_change":"2024-05-10T04:50:16.116857+0000","last_active":"2024-05-10T04:50:17.316177+0000","last_peered":"2024-05-10T04:50:17.316177+0000","last_clean":"2024-05-10T04:50:17.316177+0000","last_became_active":"2024-05-10T04:50:16.114914+0000","last_became_peered":"2024-05-10T04:50:16.114914+0000","last_unstale":"2024-05-10T04:50:17.316177+0000","last_undegraded":"2024-05-10T04:50:17.316177+0000","last_fullsized":"2024-05-10T04:50:17.316177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076793+0000","last_change":"2024-05-10T04:50:16.092687+0000","last_active":"2024-05-10T04:50:17.076793+0000","last_peered":"2024-05-10T04:50:17.076793+0000","last_clean":"2024-05-10T04:50:17.076793+0000","last_became_active":"2024-05-10T04:50:16.092377+0000","last_became_peered":"2024-05-10T04:50:16.092377+0000","last_unstale":"2024-05-10T04:50:17.076793+0000","last_undegraded":"2024-05-10T04:50:17.076793+0000","last_fullsized":"2024-05-10T04:50:17.076793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316827+0000","last_change":"2024-05-10T04:50:16.112968+0000","last_active":"2024-05-10T04:50:17.316827+0000","last_peered":"2024-05-10T04:50:17.316827+0000","last_clean":"2024-05-10T04:50:17.316827+0000","last_became_active":"2024-05-10T04:50:16.112691+0000","last_became_peered":"2024-05-10T04:50:16.112691+0000","last_unstale":"2024-05-10T04:50:17.316827+0000","last_undegraded":"2024-05-10T04:50:17.316827+0000","last_fullsized":"2024-05-10T04:50:17.316827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:32:24.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315078+0000","last_change":"2024-05-10T04:50:16.104549+0000","last_active":"2024-05-10T04:50:17.315078+0000","last_peered":"2024-05-10T04:50:17.315078+0000","last_clean":"2024-05-10T04:50:17.315078+0000","last_became_active":"2024-05-10T04:50:16.104213+0000","last_became_peered":"2024-05-10T04:50:16.104213+0000","last_unstale":"2024-05-10T04:50:17.315078+0000","last_undegraded":"2024-05-10T04:50:17.315078+0000","last_fullsized":"2024-05-10T04:50:17.315078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317412+0000","last_change":"2024-05-10T04:50:16.118415+0000","last_active":"2024-05-10T04:50:17.317412+0000","last_peered":"2024-05-10T04:50:17.317412+0000","last_clean":"2024-05-10T04:50:17.317412+0000","last_became_active":"2024-05-10T04:50:16.118045+0000","last_became_peered":"2024-05-10T04:50:16.118045+0000","last_unstale":"2024-05-10T04:50:17.317412+0000","last_undegraded":"2024-05-10T04:50:17.317412+0000","last_fullsized":"2024-05-10T04:50:17.317412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:07.192432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316747+0000","last_change":"2024-05-10T04:50:16.108768+0000","last_active":"2024-05-10T04:50:17.316747+0000","last_peered":"2024-05-10T04:50:17.316747+0000","last_clean":"2024-05-10T04:50:17.316747+0000","last_became_active":"2024-05-10T04:50:16.108457+0000","last_became_peered":"2024-05-10T04:50:16.108457+0000","last_unstale":"2024-05-10T04:50:17.316747+0000","last_undegraded":"2024-05-10T04:50:17.316747+0000","last_fullsized":"2024-05-10T04:50:17.316747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315861+0000","last_change":"2024-05-10T04:50:16.119907+0000","last_active":"2024-05-10T04:50:17.315861+0000","last_peered":"2024-05-10T04:50:17.315861+0000","last_clean":"2024-05-10T04:50:17.315861+0000","last_became_active":"2024-05-10T04:50:16.119573+0000","last_became_peered":"2024-05-10T04:50:16.119573+0000","last_unstale":"2024-05-10T04:50:17.315861+0000","last_undegraded":"2024-05-10T04:50:17.315861+0000","last_fullsized":"2024-05-10T04:50:17.315861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316976+0000","last_change":"2024-05-10T04:50:16.096302+0000","last_active":"2024-05-10T04:50:17.316976+0000","last_peered":"2024-05-10T04:50:17.316976+0000","last_clean":"2024-05-10T04:50:17.316976+0000","last_became_active":"2024-05-10T04:50:16.095997+0000","last_became_peered":"2024-05-10T04:50:16.095997+0000","last_unstale":"2024-05-10T04:50:17.316976+0000","last_undegraded":"2024-05-10T04:50:17.316976+0000","last_fullsized":"2024-05-10T04:50:17.316976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:25.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315424+0000","last_change":"2024-05-10T04:50:16.106646+0000","last_active":"2024-05-10T04:50:17.315424+0000","last_peered":"2024-05-10T04:50:17.315424+0000","last_clean":"2024-05-10T04:50:17.315424+0000","last_became_active":"2024-05-10T04:50:16.106365+0000","last_became_peered":"2024-05-10T04:50:16.106365+0000","last_unstale":"2024-05-10T04:50:17.315424+0000","last_undegraded":"2024-05-10T04:50:17.315424+0000","last_fullsized":"2024-05-10T04:50:17.315424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315522+0000","last_change":"2024-05-10T04:50:16.091792+0000","last_active":"2024-05-10T04:50:17.315522+0000","last_peered":"2024-05-10T04:50:17.315522+0000","last_clean":"2024-05-10T04:50:17.315522+0000","last_became_active":"2024-05-10T04:50:16.091437+0000","last_became_peered":"2024-05-10T04:50:16.091437+0000","last_unstale":"2024-05-10T04:50:17.315522+0000","last_undegraded":"2024-05-10T04:50:17.315522+0000","last_fullsized":"2024-05-10T04:50:17.315522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076423+0000","last_change":"2024-05-10T04:50:16.106200+0000","last_active":"2024-05-10T04:50:17.076423+0000","last_peered":"2024-05-10T04:50:17.076423+0000","last_clean":"2024-05-10T04:50:17.076423+0000","last_became_active":"2024-05-10T04:50:16.099204+0000","last_became_peered":"2024-05-10T04:50:16.099204+0000","last_unstale":"2024-05-10T04:50:17.076423+0000","last_undegraded":"2024-05-10T04:50:17.076423+0000","last_fullsized":"2024-05-10T04:50:17.076423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076460+0000","last_change":"2024-05-10T04:50:16.091018+0000","last_active":"2024-05-10T04:50:17.076460+0000","last_peered":"2024-05-10T04:50:17.076460+0000","last_clean":"2024-05-10T04:50:17.076460+0000","last_became_active":"2024-05-10T04:50:16.090683+0000","last_became_peered":"2024-05-10T04:50:16.090683+0000","last_unstale":"2024-05-10T04:50:17.076460+0000","last_undegraded":"2024-05-10T04:50:17.076460+0000","last_fullsized":"2024-05-10T04:50:17.076460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077320+0000","last_change":"2024-05-10T04:50:16.100477+0000","last_active":"2024-05-10T04:50:17.077320+0000","last_peered":"2024-05-10T04:50:17.077320+0000","last_clean":"2024-05-10T04:50:17.077320+0000","last_became_active":"2024-05-10T04:50:16.099915+0000","last_became_peered":"2024-05-10T04:50:16.099915+0000","last_unstale":"2024-05-10T04:50:17.077320+0000","last_undegraded":"2024-05-10T04:50:17.077320+0000","last_fullsized":"2024-05-10T04:50:17.077320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:32:24.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077731+0000","last_change":"2024-05-10T04:50:16.100503+0000","last_active":"2024-05-10T04:50:17.077731+0000","last_peered":"2024-05-10T04:50:17.077731+0000","last_clean":"2024-05-10T04:50:17.077731+0000","last_became_active":"2024-05-10T04:50:16.100054+0000","last_became_peered":"2024-05-10T04:50:16.100054+0000","last_unstale":"2024-05-10T04:50:17.077731+0000","last_undegraded":"2024-05-10T04:50:17.077731+0000","last_fullsized":"2024-05-10T04:50:17.077731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317151+0000","last_change":"2024-05-10T04:50:16.111998+0000","last_active":"2024-05-10T04:50:17.317151+0000","last_peered":"2024-05-10T04:50:17.317151+0000","last_clean":"2024-05-10T04:50:17.317151+0000","last_became_active":"2024-05-10T04:50:16.111151+0000","last_became_peered":"2024-05-10T04:50:16.111151+0000","last_unstale":"2024-05-10T04:50:17.317151+0000","last_undegraded":"2024-05-10T04:50:17.317151+0000","last_fullsized":"2024-05-10T04:50:17.317151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.659081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316335+0000","last_change":"2024-05-10T04:50:15.516274+0000","last_active":"2024-05-10T04:50:17.316335+0000","last_peered":"2024-05-10T04:50:17.316335+0000","last_clean":"2024-05-10T04:50:17.316335+0000","last_became_active":"2024-05-10T04:50:15.515938+0000","last_became_peered":"2024-05-10T04:50:15.515938+0000","last_unstale":"2024-05-10T04:50:17.316335+0000","last_undegraded":"2024-05-10T04:50:17.316335+0000","last_fullsized":"2024-05-10T04:50:17.316335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.492940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315956+0000","last_change":"2024-05-10T04:50:16.103965+0000","last_active":"2024-05-10T04:50:17.315956+0000","last_peered":"2024-05-10T04:50:17.315956+0000","last_clean":"2024-05-10T04:50:17.315956+0000","last_became_active":"2024-05-10T04:50:16.100297+0000","last_became_peered":"2024-05-10T04:50:16.100297+0000","last_unstale":"2024-05-10T04:50:17.315956+0000","last_undegraded":"2024-05-10T04:50:17.315956+0000","last_fullsized":"2024-05-10T04:50:17.315956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316052+0000","last_change":"2024-05-10T04:50:15.511208+0000","last_active":"2024-05-10T04:50:17.316052+0000","last_peered":"2024-05-10T04:50:17.316052+0000","last_clean":"2024-05-10T04:50:17.316052+0000","last_became_active":"2024-05-10T04:50:15.510946+0000","last_became_peered":"2024-05-10T04:50:15.510946+0000","last_unstale":"2024-05-10T04:50:17.316052+0000","last_undegraded":"2024-05-10T04:50:17.316052+0000","last_fullsized":"2024-05-10T04:50:17.316052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.492940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316317+0000","last_change":"2024-05-10T04:50:16.103854+0000","last_active":"2024-05-10T04:50:17.316317+0000","last_peered":"2024-05-10T04:50:17.316317+0000","last_clean":"2024-05-10T04:50:17.316317+0000","last_became_active":"2024-05-10T04:50:16.103319+0000","last_became_peered":"2024-05-10T04:50:16.103319+0000","last_unstale":"2024-05-10T04:50:17.316317+0000","last_undegraded":"2024-05-10T04:50:17.316317+0000","last_fullsized":"2024-05-10T04:50:17.316317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:02.917774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317628+0000","last_change":"2024-05-10T04:50:15.520375+0000","last_active":"2024-05-10T04:50:17.317628+0000","last_peered":"2024-05-10T04:50:17.317628+0000","last_clean":"2024-05-10T04:50:17.317628+0000","last_became_active":"2024-05-10T04:50:15.520023+0000","last_became_peered":"2024-05-10T04:50:15.520023+0000","last_unstale":"2024-05-10T04:50:17.317628+0000","last_undegraded":"2024-05-10T04:50:17.317628+0000","last_fullsized":"2024-05-10T04:50:17.317628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076711+0000","last_change":"2024-05-10T04:50:16.092652+0000","last_active":"2024-05-10T04:50:17.076711+0000","last_peered":"2024-05-10T04:50:17.076711+0000","last_clean":"2024-05-10T04:50:17.076711+0000","last_became_active":"2024-05-10T04:50:16.092325+0000","last_became_peered":"2024-05-10T04:50:16.092325+0000","last_unstale":"2024-05-10T04:50:17.076711+0000","last_undegraded":"2024-05-10T04:50:17.076711+0000","last_fullsized":"2024-05-10T04:50:17.076711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317137+0000","last_change":"2024-05-10T04:50:15.519068+0000","last_active":"2024-05-10T04:50:17.317137+0000","last_peered":"2024-05-10T04:50:17.317137+0000","last_clean":"2024-05-10T04:50:17.317137+0000","last_became_active":"2024-05-10T04:50:15.518747+0000","last_became_peered":"2024-05-10T04:50:15.518747+0000","last_unstale":"2024-05-10T04:50:17.317137+0000","last_undegraded":"2024-05-10T04:50:17.317137+0000","last_fullsized":"2024-05-10T04:50:17.317137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:35.682289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077225+0000","last_change":"2024-05-10T04:50:16.105958+0000","last_active":"2024-05-10T04:50:17.077225+0000","last_peered":"2024-05-10T04:50:17.077225+0000","last_clean":"2024-05-10T04:50:17.077225+0000","last_became_active":"2024-05-10T04:50:16.104254+0000","last_became_peered":"2024-05-10T04:50:16.104254+0000","last_unstale":"2024-05-10T04:50:17.077225+0000","last_undegraded":"2024-05-10T04:50:17.077225+0000","last_fullsized":"2024-05-10T04:50:17.077225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.659081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315602+0000","last_change":"2024-05-10T04:50:15.517690+0000","last_active":"2024-05-10T04:50:17.315602+0000","last_peered":"2024-05-10T04:50:17.315602+0000","last_clean":"2024-05-10T04:50:17.315602+0000","last_became_active":"2024-05-10T04:50:15.517371+0000","last_became_peered":"2024-05-10T04:50:15.517371+0000","last_unstale":"2024-05-10T04:50:17.315602+0000","last_undegraded":"2024-05-10T04:50:17.315602+0000","last_fullsized":"2024-05-10T04:50:17.315602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316653+0000","last_change":"2024-05-10T04:50:16.093622+0000","last_active":"2024-05-10T04:50:17.316653+0000","last_peered":"2024-05-10T04:50:17.316653+0000","last_clean":"2024-05-10T04:50:17.316653+0000","last_became_active":"2024-05-10T04:50:16.093266+0000","last_became_peered":"2024-05-10T04:50:16.093266+0000","last_unstale":"2024-05-10T04:50:17.316653+0000","last_undegraded":"2024-05-10T04:50:17.316653+0000","last_fullsized":"2024-05-10T04:50:17.316653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316221+0000","last_change":"2024-05-10T04:50:15.518189+0000","last_active":"2024-05-10T04:50:17.316221+0000","last_peered":"2024-05-10T04:50:17.316221+0000","last_clean":"2024-05-10T04:50:17.316221+0000","last_became_active":"2024-05-10T04:50:15.517697+0000","last_became_peered":"2024-05-10T04:50:15.517697+0000","last_unstale":"2024-05-10T04:50:17.316221+0000","last_undegraded":"2024-05-10T04:50:17.316221+0000","last_fullsized":"2024-05-10T04:50:17.316221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316057+0000","last_change":"2024-05-10T04:50:16.096819+0000","last_active":"2024-05-10T04:50:17.316057+0000","last_peered":"2024-05-10T04:50:17.316057+0000","last_clean":"2024-05-10T04:50:17.316057+0000","last_became_active":"2024-05-10T04:50:16.096295+0000","last_became_peered":"2024-05-10T04:50:16.096295+0000","last_unstale":"2024-05-10T04:50:17.316057+0000","last_undegraded":"2024-05-10T04:50:17.316057+0000","last_fullsized":"2024-05-10T04:50:17.316057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:25.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315314+0000","last_change":"2024-05-10T04:50:15.506725+0000","last_active":"2024-05-10T04:50:17.315314+0000","last_peered":"2024-05-10T04:50:17.315314+0000","last_clean":"2024-05-10T04:50:17.315314+0000","last_became_active":"2024-05-10T04:50:15.504725+0000","last_became_peered":"2024-05-10T04:50:15.504725+0000","last_unstale":"2024-05-10T04:50:17.315314+0000","last_undegraded":"2024-05-10T04:50:17.315314+0000","last_fullsized":"2024-05-10T04:50:17.315314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:30:20.860044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315294+0000","last_change":"2024-05-10T04:50:16.090939+0000","last_active":"2024-05-10T04:50:17.315294+0000","last_peered":"2024-05-10T04:50:17.315294+0000","last_clean":"2024-05-10T04:50:17.315294+0000","last_became_active":"2024-05-10T04:50:16.090673+0000","last_became_peered":"2024-05-10T04:50:16.090673+0000","last_unstale":"2024-05-10T04:50:17.315294+0000","last_undegraded":"2024-05-10T04:50:17.315294+0000","last_fullsized":"2024-05-10T04:50:17.315294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076581+0000","last_change":"2024-05-10T04:50:15.513992+0000","last_active":"2024-05-10T04:50:17.076581+0000","last_peered":"2024-05-10T04:50:17.076581+0000","last_clean":"2024-05-10T04:50:17.076581+0000","last_became_active":"2024-05-10T04:50:15.512537+0000","last_became_peered":"2024-05-10T04:50:15.512537+0000","last_unstale":"2024-05-10T04:50:17.076581+0000","last_undegraded":"2024-05-10T04:50:17.076581+0000","last_fullsized":"2024-05-10T04:50:17.076581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076497+0000","last_change":"2024-05-10T04:50:16.104592+0000","last_active":"2024-05-10T04:50:17.076497+0000","last_peered":"2024-05-10T04:50:17.076497+0000","last_clean":"2024-05-10T04:50:17.076497+0000","last_became_active":"2024-05-10T04:50:16.104262+0000","last_became_peered":"2024-05-10T04:50:16.104262+0000","last_unstale":"2024-05-10T04:50:17.076497+0000","last_undegraded":"2024-05-10T04:50:17.076497+0000","last_fullsized":"2024-05-10T04:50:17.076497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317517+0000","last_change":"2024-05-10T04:50:15.514321+0000","last_active":"2024-05-10T04:50:17.317517+0000","last_peered":"2024-05-10T04:50:17.317517+0000","last_clean":"2024-05-10T04:50:17.317517+0000","last_became_active":"2024-05-10T04:50:15.514125+0000","last_became_peered":"2024-05-10T04:50:15.514125+0000","last_unstale":"2024-05-10T04:50:17.317517+0000","last_undegraded":"2024-05-10T04:50:17.317517+0000","last_fullsized":"2024-05-10T04:50:17.317517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077233+0000","last_change":"2024-05-10T04:50:16.096429+0000","last_active":"2024-05-10T04:50:17.077233+0000","last_peered":"2024-05-10T04:50:17.077233+0000","last_clean":"2024-05-10T04:50:17.077233+0000","last_became_active":"2024-05-10T04:50:16.095555+0000","last_became_peered":"2024-05-10T04:50:16.095555+0000","last_unstale":"2024-05-10T04:50:17.077233+0000","last_undegraded":"2024-05-10T04:50:17.077233+0000","last_fullsized":"2024-05-10T04:50:17.077233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077087+0000","last_change":"2024-05-10T04:50:15.513574+0000","last_active":"2024-05-10T04:50:17.077087+0000","last_peered":"2024-05-10T04:50:17.077087+0000","last_clean":"2024-05-10T04:50:17.077087+0000","last_became_active":"2024-05-10T04:50:15.513121+0000","last_became_peered":"2024-05-10T04:50:15.513121+0000","last_unstale":"2024-05-10T04:50:17.077087+0000","last_undegraded":"2024-05-10T04:50:17.077087+0000","last_fullsized":"2024-05-10T04:50:17.077087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316443+0000","last_change":"2024-05-10T04:50:16.090959+0000","last_active":"2024-05-10T04:50:17.316443+0000","last_peered":"2024-05-10T04:50:17.316443+0000","last_clean":"2024-05-10T04:50:17.316443+0000","last_became_active":"2024-05-10T04:50:16.090673+0000","last_became_peered":"2024-05-10T04:50:16.090673+0000","last_unstale":"2024-05-10T04:50:17.316443+0000","last_undegraded":"2024-05-10T04:50:17.316443+0000","last_fullsized":"2024-05-10T04:50:17.316443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:36.689058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077005+0000","last_change":"2024-05-10T04:50:15.515867+0000","last_active":"2024-05-10T04:50:17.077005+0000","last_peered":"2024-05-10T04:50:17.077005+0000","last_clean":"2024-05-10T04:50:17.077005+0000","last_became_active":"2024-05-10T04:50:15.515578+0000","last_became_peered":"2024-05-10T04:50:15.515578+0000","last_unstale":"2024-05-10T04:50:17.077005+0000","last_undegraded":"2024-05-10T04:50:17.077005+0000","last_fullsized":"2024-05-10T04:50:17.077005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316807+0000","last_change":"2024-05-10T04:50:16.094129+0000","last_active":"2024-05-10T04:50:17.316807+0000","last_peered":"2024-05-10T04:50:17.316807+0000","last_clean":"2024-05-10T04:50:17.316807+0000","last_became_active":"2024-05-10T04:50:16.093853+0000","last_became_peered":"2024-05-10T04:50:16.093853+0000","last_unstale":"2024-05-10T04:50:17.316807+0000","last_undegraded":"2024-05-10T04:50:17.316807+0000","last_fullsized":"2024-05-10T04:50:17.316807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:01.772418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315820+0000","last_change":"2024-05-10T04:50:15.507954+0000","last_active":"2024-05-10T04:50:17.315820+0000","last_peered":"2024-05-10T04:50:17.315820+0000","last_clean":"2024-05-10T04:50:17.315820+0000","last_became_active":"2024-05-10T04:50:15.507504+0000","last_became_peered":"2024-05-10T04:50:15.507504+0000","last_unstale":"2024-05-10T04:50:17.315820+0000","last_undegraded":"2024-05-10T04:50:17.315820+0000","last_fullsized":"2024-05-10T04:50:17.315820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:57.162592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317277+0000","last_change":"2024-05-10T04:50:16.112035+0000","last_active":"2024-05-10T04:50:17.317277+0000","last_peered":"2024-05-10T04:50:17.317277+0000","last_clean":"2024-05-10T04:50:17.317277+0000","last_became_active":"2024-05-10T04:50:16.111519+0000","last_became_peered":"2024-05-10T04:50:16.111519+0000","last_unstale":"2024-05-10T04:50:17.317277+0000","last_undegraded":"2024-05-10T04:50:17.317277+0000","last_fullsized":"2024-05-10T04:50:17.317277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:24:01.388216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315966+0000","last_change":"2024-05-10T04:50:15.497940+0000","last_active":"2024-05-10T04:50:17.315966+0000","last_peered":"2024-05-10T04:50:17.315966+0000","last_clean":"2024-05-10T04:50:17.315966+0000","last_became_active":"2024-05-10T04:50:15.496471+0000","last_became_peered":"2024-05-10T04:50:15.496471+0000","last_unstale":"2024-05-10T04:50:17.315966+0000","last_undegraded":"2024-05-10T04:50:17.315966+0000","last_fullsized":"2024-05-10T04:50:17.315966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:51.200540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315426+0000","last_change":"2024-05-10T04:50:16.107065+0000","last_active":"2024-05-10T04:50:17.315426+0000","last_peered":"2024-05-10T04:50:17.315426+0000","last_clean":"2024-05-10T04:50:17.315426+0000","last_became_active":"2024-05-10T04:50:16.106704+0000","last_became_peered":"2024-05-10T04:50:16.106704+0000","last_unstale":"2024-05-10T04:50:17.315426+0000","last_undegraded":"2024-05-10T04:50:17.315426+0000","last_fullsized":"2024-05-10T04:50:17.315426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:55.406199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077139+0000","last_change":"2024-05-10T04:50:15.512673+0000","last_active":"2024-05-10T04:50:17.077139+0000","last_peered":"2024-05-10T04:50:17.077139+0000","last_clean":"2024-05-10T04:50:17.077139+0000","last_became_active":"2024-05-10T04:50:15.509967+0000","last_became_peered":"2024-05-10T04:50:15.509967+0000","last_unstale":"2024-05-10T04:50:17.077139+0000","last_undegraded":"2024-05-10T04:50:17.077139+0000","last_fullsized":"2024-05-10T04:50:17.077139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:50:53.486663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317332+0000","last_change":"2024-05-10T04:50:16.117728+0000","last_active":"2024-05-10T04:50:17.317332+0000","last_peered":"2024-05-10T04:50:17.317332+0000","last_clean":"2024-05-10T04:50:17.317332+0000","last_became_active":"2024-05-10T04:50:16.117328+0000","last_became_peered":"2024-05-10T04:50:16.117328+0000","last_unstale":"2024-05-10T04:50:17.317332+0000","last_undegraded":"2024-05-10T04:50:17.317332+0000","last_fullsized":"2024-05-10T04:50:17.317332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:13.581090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315668+0000","last_change":"2024-05-10T04:50:15.505534+0000","last_active":"2024-05-10T04:50:17.315668+0000","last_peered":"2024-05-10T04:50:17.315668+0000","last_clean":"2024-05-10T04:50:17.315668+0000","last_became_active":"2024-05-10T04:50:15.505204+0000","last_became_peered":"2024-05-10T04:50:15.505204+0000","last_unstale":"2024-05-10T04:50:17.315668+0000","last_undegraded":"2024-05-10T04:50:17.315668+0000","last_fullsized":"2024-05-10T04:50:17.315668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315762+0000","last_change":"2024-05-10T04:50:16.107456+0000","last_active":"2024-05-10T04:50:17.315762+0000","last_peered":"2024-05-10T04:50:17.315762+0000","last_clean":"2024-05-10T04:50:17.315762+0000","last_became_active":"2024-05-10T04:50:16.107101+0000","last_became_peered":"2024-05-10T04:50:16.107101+0000","last_unstale":"2024-05-10T04:50:17.315762+0000","last_undegraded":"2024-05-10T04:50:17.315762+0000","last_fullsized":"2024-05-10T04:50:17.315762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077555+0000","last_change":"2024-05-10T04:50:15.510534+0000","last_active":"2024-05-10T04:50:17.077555+0000","last_peered":"2024-05-10T04:50:17.077555+0000","last_clean":"2024-05-10T04:50:17.077555+0000","last_became_active":"2024-05-10T04:50:15.510203+0000","last_became_peered":"2024-05-10T04:50:15.510203+0000","last_unstale":"2024-05-10T04:50:17.077555+0000","last_undegraded":"2024-05-10T04:50:17.077555+0000","last_fullsized":"2024-05-10T04:50:17.077555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:30:20.860044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316071+0000","last_change":"2024-05-10T04:50:16.116503+0000","last_active":"2024-05-10T04:50:17.316071+0000","last_peered":"2024-05-10T04:50:17.316071+0000","last_clean":"2024-05-10T04:50:17.316071+0000","last_became_active":"2024-05-10T04:50:16.116218+0000","last_became_peered":"2024-05-10T04:50:16.116218+0000","last_unstale":"2024-05-10T04:50:17.316071+0000","last_undegraded":"2024-05-10T04:50:17.316071+0000","last_fullsized":"2024-05-10T04:50:17.316071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:43:59.737316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317154+0000","last_change":"2024-05-10T04:50:15.507067+0000","last_active":"2024-05-10T04:50:17.317154+0000","last_peered":"2024-05-10T04:50:17.317154+0000","last_clean":"2024-05-10T04:50:17.317154+0000","last_became_active":"2024-05-10T04:50:15.506306+0000","last_became_peered":"2024-05-10T04:50:15.506306+0000","last_unstale":"2024-05-10T04:50:17.317154+0000","last_undegraded":"2024-05-10T04:50:17.317154+0000","last_fullsized":"2024-05-10T04:50:17.317154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:51.200540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317588+0000","last_change":"2024-05-10T04:50:16.112236+0000","last_active":"2024-05-10T04:50:17.317588+0000","last_peered":"2024-05-10T04:50:17.317588+0000","last_clean":"2024-05-10T04:50:17.317588+0000","last_became_active":"2024-05-10T04:50:16.111551+0000","last_became_peered":"2024-05-10T04:50:16.111551+0000","last_unstale":"2024-05-10T04:50:17.317588+0000","last_undegraded":"2024-05-10T04:50:17.317588+0000","last_fullsized":"2024-05-10T04:50:17.317588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:02.230401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076869+0000","last_change":"2024-05-10T04:50:15.511205+0000","last_active":"2024-05-10T04:50:17.076869+0000","last_peered":"2024-05-10T04:50:17.076869+0000","last_clean":"2024-05-10T04:50:17.076869+0000","last_became_active":"2024-05-10T04:50:15.510947+0000","last_became_peered":"2024-05-10T04:50:15.510947+0000","last_unstale":"2024-05-10T04:50:17.076869+0000","last_undegraded":"2024-05-10T04:50:17.076869+0000","last_fullsized":"2024-05-10T04:50:17.076869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:57.162592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077176+0000","last_change":"2024-05-10T04:50:16.101982+0000","last_active":"2024-05-10T04:50:17.077176+0000","last_peered":"2024-05-10T04:50:17.077176+0000","last_clean":"2024-05-10T04:50:17.077176+0000","last_became_active":"2024-05-10T04:50:16.092143+0000","last_became_peered":"2024-05-10T04:50:16.092143+0000","last_unstale":"2024-05-10T04:50:17.077176+0000","last_undegraded":"2024-05-10T04:50:17.077176+0000","last_fullsized":"2024-05-10T04:50:17.077176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:24:01.388216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076958+0000","last_change":"2024-05-10T04:50:15.509745+0000","last_active":"2024-05-10T04:50:17.076958+0000","last_peered":"2024-05-10T04:50:17.076958+0000","last_clean":"2024-05-10T04:50:17.076958+0000","last_became_active":"2024-05-10T04:50:15.509429+0000","last_became_peered":"2024-05-10T04:50:15.509429+0000","last_unstale":"2024-05-10T04:50:17.076958+0000","last_undegraded":"2024-05-10T04:50:17.076958+0000","last_fullsized":"2024-05-10T04:50:17.076958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:37.683206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316304+0000","last_change":"2024-05-10T04:50:16.091478+0000","last_active":"2024-05-10T04:50:17.316304+0000","last_peered":"2024-05-10T04:50:17.316304+0000","last_clean":"2024-05-10T04:50:17.316304+0000","last_became_active":"2024-05-10T04:50:16.091245+0000","last_became_peered":"2024-05-10T04:50:16.091245+0000","last_unstale":"2024-05-10T04:50:17.316304+0000","last_undegraded":"2024-05-10T04:50:17.316304+0000","last_fullsized":"2024-05-10T04:50:17.316304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:26.121531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076468+0000","last_change":"2024-05-10T04:50:16.093555+0000","last_active":"2024-05-10T04:50:17.076468+0000","last_peered":"2024-05-10T04:50:17.076468+0000","last_clean":"2024-05-10T04:50:17.076468+0000","last_became_active":"2024-05-10T04:50:16.093088+0000","last_became_peered":"2024-05-10T04:50:16.093088+0000","last_unstale":"2024-05-10T04:50:17.076468+0000","last_undegraded":"2024-05-10T04:50:17.076468+0000","last_fullsized":"2024-05-10T04:50:17.076468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077611+0000","last_change":"2024-05-10T04:50:15.509023+0000","last_active":"2024-05-10T04:50:17.077611+0000","last_peered":"2024-05-10T04:50:17.077611+0000","last_clean":"2024-05-10T04:50:17.077611+0000","last_became_active":"2024-05-10T04:50:15.508723+0000","last_became_peered":"2024-05-10T04:50:15.508723+0000","last_unstale":"2024-05-10T04:50:17.077611+0000","last_undegraded":"2024-05-10T04:50:17.077611+0000","last_fullsized":"2024-05-10T04:50:17.077611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:50:53.486663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315481+0000","last_change":"2024-05-10T04:50:16.108380+0000","last_active":"2024-05-10T04:50:17.315481+0000","last_peered":"2024-05-10T04:50:17.315481+0000","last_clean":"2024-05-10T04:50:17.315481+0000","last_became_active":"2024-05-10T04:50:16.107863+0000","last_became_peered":"2024-05-10T04:50:16.107863+0000","last_unstale":"2024-05-10T04:50:17.315481+0000","last_undegraded":"2024-05-10T04:50:17.315481+0000","last_fullsized":"2024-05-10T04:50:17.315481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076863+0000","last_change":"2024-05-10T04:50:15.505795+0000","last_active":"2024-05-10T04:50:17.076863+0000","last_peered":"2024-05-10T04:50:17.076863+0000","last_clean":"2024-05-10T04:50:17.076863+0000","last_became_active":"2024-05-10T04:50:15.503636+0000","last_became_peered":"2024-05-10T04:50:15.503636+0000","last_unstale":"2024-05-10T04:50:17.076863+0000","last_undegraded":"2024-05-10T04:50:17.076863+0000","last_fullsized":"2024-05-10T04:50:17.076863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:50:16.094417+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:50:16.094417+0000","last_peered":"2024-05-10T04:50:16.094417+0000","last_clean":"2024-05-10T04:50:16.094417+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:50:16.094417+0000","last_undegraded":"2024-05-10T04:50:16.094417+0000","last_fullsized":"2024-05-10T04:50:16.094417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315146+0000","last_change":"2024-05-10T04:50:16.092439+0000","last_active":"2024-05-10T04:50:17.315146+0000","last_peered":"2024-05-10T04:50:17.315146+0000","last_clean":"2024-05-10T04:50:17.315146+0000","last_became_active":"2024-05-10T04:50:16.092165+0000","last_became_peered":"2024-05-10T04:50:16.092165+0000","last_unstale":"2024-05-10T04:50:17.315146+0000","last_undegraded":"2024-05-10T04:50:17.315146+0000","last_fullsized":"2024-05-10T04:50:17.315146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:26.805209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315978+0000","last_change":"2024-05-10T04:50:15.523201+0000","last_active":"2024-05-10T04:50:17.315978+0000","last_peered":"2024-05-10T04:50:17.315978+0000","last_clean":"2024-05-10T04:50:17.315978+0000","last_became_active":"2024-05-10T04:50:15.522923+0000","last_became_peered":"2024-05-10T04:50:15.522923+0000","last_unstale":"2024-05-10T04:50:17.315978+0000","last_undegraded":"2024-05-10T04:50:17.315978+0000","last_fullsized":"2024-05-10T04:50:17.315978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317655+0000","last_change":"2024-05-10T04:50:15.520251+0000","last_active":"2024-05-10T04:50:17.317655+0000","last_peered":"2024-05-10T04:50:17.317655+0000","last_clean":"2024-05-10T04:50:17.317655+0000","last_became_active":"2024-05-10T04:50:15.519958+0000","last_became_peered":"2024-05-10T04:50:15.519958+0000","last_unstale":"2024-05-10T04:50:17.317655+0000","last_undegraded":"2024-05-10T04:50:17.317655+0000","last_fullsized":"2024-05-10T04:50:17.317655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:15.316078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076829+0000","last_change":"2024-05-10T04:50:16.094812+0000","last_active":"2024-05-10T04:50:17.076829+0000","last_peered":"2024-05-10T04:50:17.076829+0000","last_clean":"2024-05-10T04:50:17.076829+0000","last_became_active":"2024-05-10T04:50:16.093699+0000","last_became_peered":"2024-05-10T04:50:16.093699+0000","last_unstale":"2024-05-10T04:50:17.076829+0000","last_undegraded":"2024-05-10T04:50:17.076829+0000","last_fullsized":"2024-05-10T04:50:17.076829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076920+0000","last_change":"2024-05-10T04:50:15.514342+0000","last_active":"2024-05-10T04:50:17.076920+0000","last_peered":"2024-05-10T04:50:17.076920+0000","last_clean":"2024-05-10T04:50:17.076920+0000","last_became_active":"2024-05-10T04:50:15.514053+0000","last_became_peered":"2024-05-10T04:50:15.514053+0000","last_unstale":"2024-05-10T04:50:17.076920+0000","last_undegraded":"2024-05-10T04:50:17.076920+0000","last_fullsized":"2024-05-10T04:50:17.076920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:15.316078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315978+0000","last_change":"2024-05-10T04:50:16.101714+0000","last_active":"2024-05-10T04:50:17.315978+0000","last_peered":"2024-05-10T04:50:17.315978+0000","last_clean":"2024-05-10T04:50:17.315978+0000","last_became_active":"2024-05-10T04:50:16.101380+0000","last_became_peered":"2024-05-10T04:50:16.101380+0000","last_unstale":"2024-05-10T04:50:17.315978+0000","last_undegraded":"2024-05-10T04:50:17.315978+0000","last_fullsized":"2024-05-10T04:50:17.315978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316044+0000","last_change":"2024-05-10T04:50:15.516370+0000","last_active":"2024-05-10T04:50:17.316044+0000","last_peered":"2024-05-10T04:50:17.316044+0000","last_clean":"2024-05-10T04:50:17.316044+0000","last_became_active":"2024-05-10T04:50:15.514786+0000","last_became_peered":"2024-05-10T04:50:15.514786+0000","last_unstale":"2024-05-10T04:50:17.316044+0000","last_undegraded":"2024-05-10T04:50:17.316044+0000","last_fullsized":"2024-05-10T04:50:17.316044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316311+0000","last_change":"2024-05-10T04:50:16.091731+0000","last_active":"2024-05-10T04:50:17.316311+0000","last_peered":"2024-05-10T04:50:17.316311+0000","last_clean":"2024-05-10T04:50:17.316311+0000","last_became_active":"2024-05-10T04:50:16.091459+0000","last_became_peered":"2024-05-10T04:50:16.091459+0000","last_unstale":"2024-05-10T04:50:17.316311+0000","last_undegraded":"2024-05-10T04:50:17.316311+0000","last_fullsized":"2024-05-10T04:50:17.316311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315645+0000","last_change":"2024-05-10T04:50:15.520260+0000","last_active":"2024-05-10T04:50:17.315645+0000","last_peered":"2024-05-10T04:50:17.315645+0000","last_clean":"2024-05-10T04:50:17.315645+0000","last_became_active":"2024-05-10T04:50:15.520059+0000","last_became_peered":"2024-05-10T04:50:15.520059+0000","last_unstale":"2024-05-10T04:50:17.315645+0000","last_undegraded":"2024-05-10T04:50:17.315645+0000","last_fullsized":"2024-05-10T04:50:17.315645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:25.798441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316457+0000","last_change":"2024-05-10T04:50:16.091927+0000","last_active":"2024-05-10T04:50:17.316457+0000","last_peered":"2024-05-10T04:50:17.316457+0000","last_clean":"2024-05-10T04:50:17.316457+0000","last_became_active":"2024-05-10T04:50:16.091543+0000","last_became_peered":"2024-05-10T04:50:16.091543+0000","last_unstale":"2024-05-10T04:50:17.316457+0000","last_undegraded":"2024-05-10T04:50:17.316457+0000","last_fullsized":"2024-05-10T04:50:17.316457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:16.322846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076410+0000","last_change":"2024-05-10T04:50:15.517935+0000","last_active":"2024-05-10T04:50:17.076410+0000","last_peered":"2024-05-10T04:50:17.076410+0000","last_clean":"2024-05-10T04:50:17.076410+0000","last_became_active":"2024-05-10T04:50:15.517528+0000","last_became_peered":"2024-05-10T04:50:15.517528+0000","last_unstale":"2024-05-10T04:50:17.076410+0000","last_undegraded":"2024-05-10T04:50:17.076410+0000","last_fullsized":"2024-05-10T04:50:17.076410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315174+0000","last_change":"2024-05-10T04:50:16.096422+0000","last_active":"2024-05-10T04:50:17.315174+0000","last_peered":"2024-05-10T04:50:17.315174+0000","last_clean":"2024-05-10T04:50:17.315174+0000","last_became_active":"2024-05-10T04:50:16.095048+0000","last_became_peered":"2024-05-10T04:50:16.095048+0000","last_unstale":"2024-05-10T04:50:17.315174+0000","last_undegraded":"2024-05-10T04:50:17.315174+0000","last_fullsized":"2024-05-10T04:50:17.315174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:55.406199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076765+0000","last_change":"2024-05-10T04:50:15.510474+0000","last_active":"2024-05-10T04:50:17.076765+0000","last_peered":"2024-05-10T04:50:17.076765+0000","last_clean":"2024-05-10T04:50:17.076765+0000","last_became_active":"2024-05-10T04:50:15.509890+0000","last_became_peered":"2024-05-10T04:50:15.509890+0000","last_unstale":"2024-05-10T04:50:17.076765+0000","last_undegraded":"2024-05-10T04:50:17.076765+0000","last_fullsized":"2024-05-10T04:50:17.076765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315711+0000","last_change":"2024-05-10T04:50:16.091690+0000","last_active":"2024-05-10T04:50:17.315711+0000","last_peered":"2024-05-10T04:50:17.315711+0000","last_clean":"2024-05-10T04:50:17.315711+0000","last_became_active":"2024-05-10T04:50:16.090685+0000","last_became_peered":"2024-05-10T04:50:16.090685+0000","last_unstale":"2024-05-10T04:50:17.315711+0000","last_undegraded":"2024-05-10T04:50:17.315711+0000","last_fullsized":"2024-05-10T04:50:17.315711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317278+0000","last_change":"2024-05-10T04:50:15.517573+0000","last_active":"2024-05-10T04:50:17.317278+0000","last_peered":"2024-05-10T04:50:17.317278+0000","last_clean":"2024-05-10T04:50:17.317278+0000","last_became_active":"2024-05-10T04:50:15.517108+0000","last_became_peered":"2024-05-10T04:50:15.517108+0000","last_unstale":"2024-05-10T04:50:17.317278+0000","last_undegraded":"2024-05-10T04:50:17.317278+0000","last_fullsized":"2024-05-10T04:50:17.317278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:30.795068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316202+0000","last_change":"2024-05-10T04:50:16.111071+0000","last_active":"2024-05-10T04:50:17.316202+0000","last_peered":"2024-05-10T04:50:17.316202+0000","last_clean":"2024-05-10T04:50:17.316202+0000","last_became_active":"2024-05-10T04:50:16.109828+0000","last_became_peered":"2024-05-10T04:50:16.109828+0000","last_unstale":"2024-05-10T04:50:17.316202+0000","last_undegraded":"2024-05-10T04:50:17.316202+0000","last_fullsized":"2024-05-10T04:50:17.316202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077673+0000","last_change":"2024-05-10T04:50:15.512759+0000","last_active":"2024-05-10T04:50:17.077673+0000","last_peered":"2024-05-10T04:50:17.077673+0000","last_clean":"2024-05-10T04:50:17.077673+0000","last_became_active":"2024-05-10T04:50:15.512504+0000","last_became_peered":"2024-05-10T04:50:15.512504+0000","last_unstale":"2024-05-10T04:50:17.077673+0000","last_undegraded":"2024-05-10T04:50:17.077673+0000","last_fullsized":"2024-05-10T04:50:17.077673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317426+0000","last_change":"2024-05-10T04:50:16.120261+0000","last_active":"2024-05-10T04:50:17.317426+0000","last_peered":"2024-05-10T04:50:17.317426+0000","last_clean":"2024-05-10T04:50:17.317426+0000","last_became_active":"2024-05-10T04:50:16.119987+0000","last_became_peered":"2024-05-10T04:50:16.119987+0000","last_unstale":"2024-05-10T04:50:17.317426+0000","last_undegraded":"2024-05-10T04:50:17.317426+0000","last_fullsized":"2024-05-10T04:50:17.317426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:37.923918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076976+0000","last_change":"2024-05-10T04:50:15.510033+0000","last_active":"2024-05-10T04:50:17.076976+0000","last_peered":"2024-05-10T04:50:17.076976+0000","last_clean":"2024-05-10T04:50:17.076976+0000","last_became_active":"2024-05-10T04:50:15.509678+0000","last_became_peered":"2024-05-10T04:50:15.509678+0000","last_unstale":"2024-05-10T04:50:17.076976+0000","last_undegraded":"2024-05-10T04:50:17.076976+0000","last_fullsized":"2024-05-10T04:50:17.076976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076880+0000","last_change":"2024-05-10T04:50:16.114747+0000","last_active":"2024-05-10T04:50:17.076880+0000","last_peered":"2024-05-10T04:50:17.076880+0000","last_clean":"2024-05-10T04:50:17.076880+0000","last_became_active":"2024-05-10T04:50:16.108054+0000","last_became_peered":"2024-05-10T04:50:16.108054+0000","last_unstale":"2024-05-10T04:50:17.076880+0000","last_undegraded":"2024-05-10T04:50:17.076880+0000","last_fullsized":"2024-05-10T04:50:17.076880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:02.230401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077792+0000","last_change":"2024-05-10T04:50:15.511828+0000","last_active":"2024-05-10T04:50:17.077792+0000","last_peered":"2024-05-10T04:50:17.077792+0000","last_clean":"2024-05-10T04:50:17.077792+0000","last_became_active":"2024-05-10T04:50:15.508490+0000","last_became_peered":"2024-05-10T04:50:15.508490+0000","last_unstale":"2024-05-10T04:50:17.077792+0000","last_undegraded":"2024-05-10T04:50:17.077792+0000","last_fullsized":"2024-05-10T04:50:17.077792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:37.683206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317311+0000","last_change":"2024-05-10T04:50:16.118853+0000","last_active":"2024-05-10T04:50:17.317311+0000","last_peered":"2024-05-10T04:50:17.317311+0000","last_clean":"2024-05-10T04:50:17.317311+0000","last_became_active":"2024-05-10T04:50:16.118491+0000","last_became_peered":"2024-05-10T04:50:16.118491+0000","last_unstale":"2024-05-10T04:50:17.317311+0000","last_undegraded":"2024-05-10T04:50:17.317311+0000","last_fullsized":"2024-05-10T04:50:17.317311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:52.596368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316201+0000","last_change":"2024-05-10T04:50:16.111132+0000","last_active":"2024-05-10T04:50:17.316201+0000","last_peered":"2024-05-10T04:50:17.316201+0000","last_clean":"2024-05-10T04:50:17.316201+0000","last_became_active":"2024-05-10T04:50:16.110819+0000","last_became_peered":"2024-05-10T04:50:16.110819+0000","last_unstale":"2024-05-10T04:50:17.316201+0000","last_undegraded":"2024-05-10T04:50:17.316201+0000","last_fullsized":"2024-05-10T04:50:17.316201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077705+0000","last_change":"2024-05-10T04:50:16.085668+0000","last_active":"2024-05-10T04:50:17.077705+0000","last_peered":"2024-05-10T04:50:17.077705+0000","last_clean":"2024-05-10T04:50:17.077705+0000","last_became_active":"2024-05-10T04:50:16.084595+0000","last_became_peered":"2024-05-10T04:50:16.084595+0000","last_unstale":"2024-05-10T04:50:17.077705+0000","last_undegraded":"2024-05-10T04:50:17.077705+0000","last_fullsized":"2024-05-10T04:50:17.077705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:01.772418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077071+0000","last_change":"2024-05-10T04:50:16.104882+0000","last_active":"2024-05-10T04:50:17.077071+0000","last_peered":"2024-05-10T04:50:17.077071+0000","last_clean":"2024-05-10T04:50:17.077071+0000","last_became_active":"2024-05-10T04:50:16.101840+0000","last_became_peered":"2024-05-10T04:50:16.101840+0000","last_unstale":"2024-05-10T04:50:17.077071+0000","last_undegraded":"2024-05-10T04:50:17.077071+0000","last_fullsized":"2024-05-10T04:50:17.077071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:07.192432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315884+0000","last_change":"2024-05-10T04:50:16.096600+0000","last_active":"2024-05-10T04:50:17.315884+0000","last_peered":"2024-05-10T04:50:17.315884+0000","last_clean":"2024-05-10T04:50:17.315884+0000","last_became_active":"2024-05-10T04:50:16.095907+0000","last_became_peered":"2024-05-10T04:50:16.095907+0000","last_unstale":"2024-05-10T04:50:17.315884+0000","last_undegraded":"2024-05-10T04:50:17.315884+0000","last_fullsized":"2024-05-10T04:50:17.315884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315600+0000","last_change":"2024-05-10T04:50:16.097111+0000","last_active":"2024-05-10T04:50:17.315600+0000","last_peered":"2024-05-10T04:50:17.315600+0000","last_clean":"2024-05-10T04:50:17.315600+0000","last_became_active":"2024-05-10T04:50:16.096855+0000","last_became_peered":"2024-05-10T04:50:16.096855+0000","last_unstale":"2024-05-10T04:50:17.315600+0000","last_undegraded":"2024-05-10T04:50:17.315600+0000","last_fullsized":"2024-05-10T04:50:17.315600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076898+0000","last_change":"2024-05-10T04:50:16.100106+0000","last_active":"2024-05-10T04:50:17.076898+0000","last_peered":"2024-05-10T04:50:17.076898+0000","last_clean":"2024-05-10T04:50:17.076898+0000","last_became_active":"2024-05-10T04:50:16.095317+0000","last_became_peered":"2024-05-10T04:50:16.095317+0000","last_unstale":"2024-05-10T04:50:17.076898+0000","last_undegraded":"2024-05-10T04:50:17.076898+0000","last_fullsized":"2024-05-10T04:50:17.076898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316523+0000","last_change":"2024-05-10T04:50:16.103396+0000","last_active":"2024-05-10T04:50:17.316523+0000","last_peered":"2024-05-10T04:50:17.316523+0000","last_clean":"2024-05-10T04:50:17.316523+0000","last_became_active":"2024-05-10T04:50:16.102768+0000","last_became_peered":"2024-05-10T04:50:16.102768+0000","last_unstale":"2024-05-10T04:50:17.316523+0000","last_undegraded":"2024-05-10T04:50:17.316523+0000","last_fullsized":"2024-05-10T04:50:17.316523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315919+0000","last_change":"2024-05-10T04:50:16.095965+0000","last_active":"2024-05-10T04:50:17.315919+0000","last_peered":"2024-05-10T04:50:17.315919+0000","last_clean":"2024-05-10T04:50:17.315919+0000","last_became_active":"2024-05-10T04:50:16.095711+0000","last_became_peered":"2024-05-10T04:50:16.095711+0000","last_unstale":"2024-05-10T04:50:17.315919+0000","last_undegraded":"2024-05-10T04:50:17.315919+0000","last_fullsized":"2024-05-10T04:50:17.315919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076712+0000","last_change":"2024-05-10T04:50:16.107080+0000","last_active":"2024-05-10T04:50:17.076712+0000","last_peered":"2024-05-10T04:50:17.076712+0000","last_clean":"2024-05-10T04:50:17.076712+0000","last_became_active":"2024-05-10T04:50:16.102437+0000","last_became_peered":"2024-05-10T04:50:16.102437+0000","last_unstale":"2024-05-10T04:50:17.076712+0000","last_undegraded":"2024-05-10T04:50:17.076712+0000","last_fullsized":"2024-05-10T04:50:17.076712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:37.923918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315288+0000","last_change":"2024-05-10T04:50:16.095687+0000","last_active":"2024-05-10T04:50:17.315288+0000","last_peered":"2024-05-10T04:50:17.315288+0000","last_clean":"2024-05-10T04:50:17.315288+0000","last_became_active":"2024-05-10T04:50:16.093813+0000","last_became_peered":"2024-05-10T04:50:16.093813+0000","last_unstale":"2024-05-10T04:50:17.315288+0000","last_undegraded":"2024-05-10T04:50:17.315288+0000","last_fullsized":"2024-05-10T04:50:17.315288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076694+0000","last_change":"2024-05-10T04:50:16.108911+0000","last_active":"2024-05-10T04:50:17.076694+0000","last_peered":"2024-05-10T04:50:17.076694+0000","last_clean":"2024-05-10T04:50:17.076694+0000","last_became_active":"2024-05-10T04:50:16.107713+0000","last_became_peered":"2024-05-10T04:50:16.107713+0000","last_unstale":"2024-05-10T04:50:17.076694+0000","last_undegraded":"2024-05-10T04:50:17.076694+0000","last_fullsized":"2024-05-10T04:50:17.076694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315797+0000","last_change":"2024-05-10T04:50:16.097207+0000","last_active":"2024-05-10T04:50:17.315797+0000","last_peered":"2024-05-10T04:50:17.315797+0000","last_clean":"2024-05-10T04:50:17.315797+0000","last_became_active":"2024-05-10T04:50:16.093993+0000","last_became_peered":"2024-05-10T04:50:16.093993+0000","last_unstale":"2024-05-10T04:50:17.315797+0000","last_undegraded":"2024-05-10T04:50:17.315797+0000","last_fullsized":"2024-05-10T04:50:17.315797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315905+0000","last_change":"2024-05-10T04:50:16.096624+0000","last_active":"2024-05-10T04:50:17.315905+0000","last_peered":"2024-05-10T04:50:17.315905+0000","last_clean":"2024-05-10T04:50:17.315905+0000","last_became_active":"2024-05-10T04:50:16.096111+0000","last_became_peered":"2024-05-10T04:50:16.096111+0000","last_unstale":"2024-05-10T04:50:17.315905+0000","last_undegraded":"2024-05-10T04:50:17.315905+0000","last_fullsized":"2024-05-10T04:50:17.315905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:50:21.685 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-10T04:50:21.685 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T04:50:21.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-10T04:50:21.686 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-10T04:50:21.686 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-10T04:50:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.981+0000 7fd2a7000700 1 Processor -- start 2024-05-10T04:50:21.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.981+0000 7fd2a7000700 1 -- start start 2024-05-10T04:50:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd2a7000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2a015df40 0x7fd2a00d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd2a7000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a0161e40 con 0x7fd2a00b2ca0 2024-05-10T04:50:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd2a7000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a0162120 con 0x7fd2a015e350 2024-05-10T04:50:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd2a7000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a0162400 con 0x7fd2a015df40 2024-05-10T04:50:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd2a5c00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd2a00b2ca0 0x7fd2a00cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43254/0 (socket says 172.21.15.82:43254) 2024-05-10T04:50:21.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd2a5c00700 1 -- 172.21.15.82:0/2859279535 learned_addr learned my addr 172.21.15.82:0/2859279535 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:21.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd2a5200700 1 --2- 172.21.15.82:0/2859279535 >> v2:172.21.15.82:3300/0 conn(0x7fd2a015df40 0x7fd2a00d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd29fe00700 1 -- 172.21.15.82:0/2859279535 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780053537 0 0) 0x7fd2a0161e40 con 0x7fd2a00b2ca0 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd29fe00700 1 -- 172.21.15.82:0/2859279535 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2880035b0 con 0x7fd2a00b2ca0 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.983+0000 7fd2a5200700 1 -- 172.21.15.82:0/2859279535 >> v1:172.21.15.129:6789/0 conn(0x7fd2a015e350 legacy=0x7fd2a00d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.984+0000 7fd2a5200700 1 -- 172.21.15.82:0/2859279535 >> v1:172.21.15.82:6789/0 conn(0x7fd2a00b2ca0 legacy=0x7fd2a00cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.984+0000 7fd2a5200700 1 -- 172.21.15.82:0/2859279535 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a01626e0 con 0x7fd2a015df40 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.984+0000 7fd2a5200700 1 --2- 172.21.15.82:0/2859279535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015df40 0x7fd2a00d03b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009840 tx=0x7fd28c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85933f95f61c77eb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.984+0000 7fd29fe00700 1 -- 172.21.15.82:0/2859279535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c011830 con 0x7fd2a015df40 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.984+0000 7fd29fe00700 1 -- 172.21.15.82:0/2859279535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c011990 con 0x7fd2a015df40 2024-05-10T04:50:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.984+0000 7fd29fe00700 1 -- 172.21.15.82:0/2859279535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c011d20 con 0x7fd2a015df40 2024-05-10T04:50:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.985+0000 7fd2a7000700 1 -- 172.21.15.82:0/2859279535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015df40 msgr2=0x7fd2a00d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.985+0000 7fd2a7000700 1 --2- 172.21.15.82:0/2859279535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015df40 0x7fd2a00d03b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009840 tx=0x7fd28c009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.985+0000 7fd2a7000700 1 -- 172.21.15.82:0/2859279535 shutdown_connections 2024-05-10T04:50:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.985+0000 7fd2a7000700 1 --2- 172.21.15.82:0/2859279535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015df40 0x7fd2a00d03b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.985+0000 7fd2a7000700 1 -- 172.21.15.82:0/2859279535 >> 172.21.15.82:0/2859279535 conn(0x7fd2a0067600 msgr2=0x7fd2a006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.985+0000 7fd2a7000700 1 -- 172.21.15.82:0/2859279535 shutdown_connections 2024-05-10T04:50:21.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.985+0000 7fd2a7000700 1 -- 172.21.15.82:0/2859279535 wait complete. 2024-05-10T04:50:21.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.987+0000 7fd2a7000700 1 Processor -- start 2024-05-10T04:50:21.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.987+0000 7fd2a7000700 1 -- start start 2024-05-10T04:50:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a7000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2a00b2ca0 0x7fd2a0156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a7000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2a015df40 0x7fd2a01f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a7000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015e350 0x7fd2a00b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a7000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00b5350 con 0x7fd2a015e350 2024-05-10T04:50:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a7000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a01f4f50 con 0x7fd2a015df40 2024-05-10T04:50:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a7000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0159170 con 0x7fd2a00b2ca0 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015e350 0x7fd2a00b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015e350 0x7fd2a00b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55984/0 (socket says 172.21.15.82:55984) 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a6600700 1 -- 172.21.15.82:0/4247038135 learned_addr learned my addr 172.21.15.82:0/4247038135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a5200700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2a015df40 0x7fd2a01f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a5c00700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2a00b2ca0 0x7fd2a0156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a6600700 1 -- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2a00b2ca0 msgr2=0x7fd2a0156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a6600700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2a00b2ca0 0x7fd2a0156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a6600700 1 -- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2a015df40 msgr2=0x7fd2a01f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a6600700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2a015df40 0x7fd2a01f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a6600700 1 -- 172.21.15.82:0/4247038135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0094a0 con 0x7fd2a015e350 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.989+0000 7fd2a5200700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2a015df40 0x7fd2a01f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.990+0000 7fd2a6600700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015e350 0x7fd2a00b5770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd29800cc20 tx=0x7fd2980021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.990+0000 7fd29d600700 1 -- 172.21.15.82:0/4247038135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298003c00 con 0x7fd2a015e350 2024-05-10T04:50:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.990+0000 7fd29d600700 1 -- 172.21.15.82:0/4247038135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd298003d60 con 0x7fd2a015e350 2024-05-10T04:50:21.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.990+0000 7fd29d600700 1 -- 172.21.15.82:0/4247038135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800ab40 con 0x7fd2a015e350 2024-05-10T04:50:21.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.990+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a00b4710 con 0x7fd2a015e350 2024-05-10T04:50:21.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.990+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a00b4c90 con 0x7fd2a015e350 2024-05-10T04:50:21.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.991+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a0074af0 con 0x7fd2a015e350 2024-05-10T04:50:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.992+0000 7fd29d600700 1 -- 172.21.15.82:0/4247038135 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd29800aca0 con 0x7fd2a015e350 2024-05-10T04:50:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.993+0000 7fd29d600700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd28006ac90 0x7fd28006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.993+0000 7fd29d600700 1 -- 172.21.15.82:0/4247038135 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2980892e0 con 0x7fd2a015e350 2024-05-10T04:50:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.993+0000 7fd2a5c00700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd28006ac90 0x7fd28006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.994+0000 7fd2a5c00700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd28006ac90 0x7fd28006d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2940011e0 tx=0x7fd294009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:21.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:21.998+0000 7fd29d600700 1 -- 172.21.15.82:0/4247038135 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd298054550 con 0x7fd2a015e350 2024-05-10T04:50:22.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.259+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd2a00d1fa0 con 0x7fd2a015e350 2024-05-10T04:50:22.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.263+0000 7fd29d600700 1 -- 172.21.15.82:0/4247038135 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170937 (secure 0 0 0) 0x7fd298057b70 con 0x7fd2a015e350 2024-05-10T04:50:22.266 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd28006ac90 msgr2=0x7fd28006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd28006ac90 0x7fd28006d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2940011e0 tx=0x7fd294009040 comp rx=0 tx=0).stop 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015e350 msgr2=0x7fd2a00b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015e350 0x7fd2a00b5770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd29800cc20 tx=0x7fd2980021c0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 shutdown_connections 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd28006ac90 0x7fd28006d1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2a015e350 0x7fd2a00b5770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2a00b2ca0 0x7fd2a0156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 --2- 172.21.15.82:0/4247038135 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2a015df40 0x7fd2a01f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 >> 172.21.15.82:0/4247038135 conn(0x7fd2a0067600 msgr2=0x7fd2a015fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 shutdown_connections 2024-05-10T04:50:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.266+0000 7fd2a7000700 1 -- 172.21.15.82:0/4247038135 wait complete. 2024-05-10T04:50:22.292 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":43622},{"type":"v1","addr":"172.21.15.82:6833","nonce":43622}]},"active_addr":"172.21.15.82:6833/43622","active_change":"2024-05-10T04:49:56.954849+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3131213396}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3238518727}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3950271818}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3042030789}]}]} 2024-05-10T04:50:22.295 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-10T04:50:22.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T04:50:22.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.559+0000 7f9a74e00700 1 Processor -- start 2024-05-10T04:50:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.559+0000 7f9a74e00700 1 -- start start 2024-05-10T04:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.560+0000 7f9a74e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a7015bfe0 0x7f9a7015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.560+0000 7f9a74e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a70161fb0 0x7f9a701623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.560+0000 7f9a74e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a70162a70 con 0x7f9a700b5890 2024-05-10T04:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.560+0000 7f9a74e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7015c3f0 con 0x7f9a70161fb0 2024-05-10T04:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.560+0000 7f9a74e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70162d50 con 0x7f9a7015bfe0 2024-05-10T04:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6e800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9a700b5890 0x7f9a700b5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43256/0 (socket says 172.21.15.82:43256) 2024-05-10T04:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6d400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a70161fb0 0x7f9a701623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6e800700 1 -- 172.21.15.82:0/2338254648 learned_addr learned my addr 172.21.15.82:0/2338254648 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6de00700 1 --2- 172.21.15.82:0/2338254648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a7015bfe0 0x7f9a7015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6d400700 1 -- 172.21.15.82:0/2338254648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a7015bfe0 msgr2=0x7f9a7015f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6d400700 1 --2- 172.21.15.82:0/2338254648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a7015bfe0 0x7f9a7015f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6d400700 1 -- 172.21.15.82:0/2338254648 >> v1:172.21.15.82:6789/0 conn(0x7f9a700b5890 legacy=0x7f9a700b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6d400700 1 -- 172.21.15.82:0/2338254648 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7015ecf0 con 0x7f9a70161fb0 2024-05-10T04:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6ca00700 1 -- 172.21.15.82:0/2338254648 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182355289 0 0) 0x7f9a70162a70 con 0x7f9a700b5890 2024-05-10T04:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.561+0000 7f9a6d400700 1 --2- 172.21.15.82:0/2338254648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a70161fb0 0x7f9a701623c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009840 tx=0x7f9a5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6384a1bfa60e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a6ca00700 1 -- 172.21.15.82:0/2338254648 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c011830 con 0x7f9a70161fb0 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a6ca00700 1 -- 172.21.15.82:0/2338254648 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c011990 con 0x7f9a70161fb0 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a6ca00700 1 -- 172.21.15.82:0/2338254648 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c011d20 con 0x7f9a70161fb0 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a74e00700 1 -- 172.21.15.82:0/2338254648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a70161fb0 msgr2=0x7f9a701623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2338254648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a70161fb0 0x7f9a701623c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009840 tx=0x7f9a5c009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a74e00700 1 -- 172.21.15.82:0/2338254648 shutdown_connections 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2338254648 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a7015bfe0 0x7f9a7015f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2338254648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a70161fb0 0x7f9a701623c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.562+0000 7f9a74e00700 1 -- 172.21.15.82:0/2338254648 >> 172.21.15.82:0/2338254648 conn(0x7f9a700d0a70 msgr2=0x7f9a700d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.563+0000 7f9a74e00700 1 -- 172.21.15.82:0/2338254648 shutdown_connections 2024-05-10T04:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.563+0000 7f9a74e00700 1 -- 172.21.15.82:0/2338254648 wait complete. 2024-05-10T04:50:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.565+0000 7f9a74e00700 1 Processor -- start 2024-05-10T04:50:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.565+0000 7f9a74e00700 1 -- start start 2024-05-10T04:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.566+0000 7f9a74e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a700b5890 0x7f9a70155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.566+0000 7f9a74e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7015bfe0 0x7f9a701f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.566+0000 7f9a74e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a70161fb0 0x7f9a7015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.566+0000 7f9a74e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70152b20 con 0x7f9a7015bfe0 2024-05-10T04:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.566+0000 7f9a74e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a701f8290 con 0x7f9a700b5890 2024-05-10T04:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.566+0000 7f9a74e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70152650 con 0x7f9a70161fb0 2024-05-10T04:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7015bfe0 0x7f9a701f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7015bfe0 0x7f9a701f77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56010/0 (socket says 172.21.15.82:56010) 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 -- 172.21.15.82:0/2571796430 learned_addr learned my addr 172.21.15.82:0/2571796430 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6e800700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a70161fb0 0x7f9a7015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6de00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a700b5890 0x7f9a70155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 -- 172.21.15.82:0/2571796430 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a70161fb0 msgr2=0x7f9a7015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a70161fb0 0x7f9a7015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 -- 172.21.15.82:0/2571796430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a700b5890 msgr2=0x7f9a70155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a700b5890 0x7f9a70155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 -- 172.21.15.82:0/2571796430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0094a0 con 0x7f9a7015bfe0 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.567+0000 7f9a6d400700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7015bfe0 0x7f9a701f77b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0090b0 tx=0x7f9a5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.568+0000 7f9a66000700 1 -- 172.21.15.82:0/2571796430 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0038a0 con 0x7f9a7015bfe0 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.568+0000 7f9a66000700 1 -- 172.21.15.82:0/2571796430 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c01f070 con 0x7f9a7015bfe0 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.568+0000 7f9a66000700 1 -- 172.21.15.82:0/2571796430 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c003c40 con 0x7f9a7015bfe0 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.568+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a70155940 con 0x7f9a7015bfe0 2024-05-10T04:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.568+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a701f84e0 con 0x7f9a7015bfe0 2024-05-10T04:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.569+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a700c8270 con 0x7f9a7015bfe0 2024-05-10T04:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.570+0000 7f9a66000700 1 -- 172.21.15.82:0/2571796430 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9a5c026480 con 0x7f9a7015bfe0 2024-05-10T04:50:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.570+0000 7f9a66000700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9a5006ac90 0x7f9a5006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.571+0000 7f9a66000700 1 -- 172.21.15.82:0/2571796430 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a5c021070 con 0x7f9a7015bfe0 2024-05-10T04:50:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.571+0000 7f9a6de00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9a5006ac90 0x7f9a5006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.571+0000 7f9a6de00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9a5006ac90 0x7f9a5006d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009ad0 tx=0x7f9a60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.575+0000 7f9a66000700 1 -- 172.21.15.82:0/2571796430 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9a5c055e90 con 0x7f9a7015bfe0 2024-05-10T04:50:22.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.780+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a70074af0 con 0x7f9a7015bfe0 2024-05-10T04:50:22.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.781+0000 7f9a66000700 1 -- 172.21.15.82:0/2571796430 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f9a5c02b090 con 0x7f9a7015bfe0 2024-05-10T04:50:22.781 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:22.782 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:22.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9a5006ac90 msgr2=0x7f9a5006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:22.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9a5006ac90 0x7f9a5006d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009ad0 tx=0x7f9a60008040 comp rx=0 tx=0).stop 2024-05-10T04:50:22.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7015bfe0 msgr2=0x7f9a701f77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:22.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7015bfe0 0x7f9a701f77b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0090b0 tx=0x7f9a5c004750 comp rx=0 tx=0).stop 2024-05-10T04:50:22.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 shutdown_connections 2024-05-10T04:50:22.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9a5006ac90 0x7f9a5006d1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a70161fb0 0x7f9a7015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a700b5890 0x7f9a70155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 --2- 172.21.15.82:0/2571796430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7015bfe0 0x7f9a701f77b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:22.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.783+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 >> 172.21.15.82:0/2571796430 conn(0x7f9a700d0a70 msgr2=0x7f9a700740c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:22.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.784+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 shutdown_connections 2024-05-10T04:50:22.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:22.784+0000 7f9a74e00700 1 -- 172.21.15.82:0/2571796430 wait complete. 2024-05-10T04:50:22.809 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T04:50:22.809 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:23.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.073+0000 7f5562c00700 1 Processor -- start 2024-05-10T04:50:23.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.073+0000 7f5562c00700 1 -- start start 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.075+0000 7f5562c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f555c0b2ca0 0x7f555c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.075+0000 7f5562c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15df40 0x7f555c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.075+0000 7f5562c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c0d3500 con 0x7f555c15e350 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.075+0000 7f5562c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c161e40 con 0x7f555c0b2ca0 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.075+0000 7f5562c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c162120 con 0x7f555c15df40 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.075+0000 7f5561800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f555c0b2ca0 0x7f555c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.075+0000 7f5562200700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f555c15e350 0x7f555c0b56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43268/0 (socket says 172.21.15.82:43268) 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.075+0000 7f5562200700 1 -- 172.21.15.82:0/1051331528 learned_addr learned my addr 172.21.15.82:0/1051331528 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f5560e00700 1 --2- 172.21.15.82:0/1051331528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15df40 0x7f555c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f5561800700 1 -- 172.21.15.82:0/1051331528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15df40 msgr2=0x7f555c0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f5561800700 1 --2- 172.21.15.82:0/1051331528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15df40 0x7f555c0d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f5561800700 1 -- 172.21.15.82:0/1051331528 >> v1:172.21.15.82:6789/0 conn(0x7f555c15e350 legacy=0x7f555c0b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f5561800700 1 -- 172.21.15.82:0/1051331528 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c162400 con 0x7f555c0b2ca0 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f5560e00700 1 --2- 172.21.15.82:0/1051331528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15df40 0x7f555c0d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f5561800700 1 --2- 172.21.15.82:0/1051331528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c0b2ca0 0x7f555c0cf150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5550009840 tx=0x7f5550009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd590f838eb27bb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f555be00700 1 -- 172.21.15.82:0/1051331528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011830 con 0x7f555c0b2ca0 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f555be00700 1 -- 172.21.15.82:0/1051331528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5550011990 con 0x7f555c0b2ca0 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.076+0000 7f555be00700 1 -- 172.21.15.82:0/1051331528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550011d20 con 0x7f555c0b2ca0 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.077+0000 7f5562c00700 1 -- 172.21.15.82:0/1051331528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c0b2ca0 msgr2=0x7f555c0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.077+0000 7f5562c00700 1 --2- 172.21.15.82:0/1051331528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c0b2ca0 0x7f555c0cf150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5550009840 tx=0x7f5550009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.077+0000 7f5562c00700 1 -- 172.21.15.82:0/1051331528 shutdown_connections 2024-05-10T04:50:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.077+0000 7f5562c00700 1 --2- 172.21.15.82:0/1051331528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c0b2ca0 0x7f555c0cf150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.077+0000 7f5562c00700 1 --2- 172.21.15.82:0/1051331528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15df40 0x7f555c0d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.077+0000 7f5562c00700 1 -- 172.21.15.82:0/1051331528 >> 172.21.15.82:0/1051331528 conn(0x7f555c067600 msgr2=0x7f555c06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.077+0000 7f5562c00700 1 -- 172.21.15.82:0/1051331528 shutdown_connections 2024-05-10T04:50:23.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.077+0000 7f5562c00700 1 -- 172.21.15.82:0/1051331528 wait complete. 2024-05-10T04:50:23.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.079+0000 7f5562c00700 1 Processor -- start 2024-05-10T04:50:23.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.080+0000 7f5562c00700 1 -- start start 2024-05-10T04:50:23.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5562c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f555c0b2ca0 0x7f555c14a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5562c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c15df40 0x7f555c14b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5562c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15e350 0x7f555c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5562c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c14bc00 con 0x7f555c15df40 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5562c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c1f8640 con 0x7f555c0b2ca0 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5562c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c151540 con 0x7f555c15e350 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5560e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c15df40 0x7f555c14b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5560e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c15df40 0x7f555c14b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56028/0 (socket says 172.21.15.82:56028) 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5560e00700 1 -- 172.21.15.82:0/1367040968 learned_addr learned my addr 172.21.15.82:0/1367040968 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5561800700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f555c0b2ca0 0x7f555c14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.081+0000 7f5562200700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15e350 0x7f555c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5560e00700 1 -- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15e350 msgr2=0x7f555c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5560e00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15e350 0x7f555c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5560e00700 1 -- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f555c0b2ca0 msgr2=0x7f555c14a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5560e00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f555c0b2ca0 0x7f555c14a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5560e00700 1 -- 172.21.15.82:0/1367040968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500094a0 con 0x7f555c15df40 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5561800700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f555c0b2ca0 0x7f555c14a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5560e00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c15df40 0x7f555c14b180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f554800e760 tx=0x7f554800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5559600700 1 -- 172.21.15.82:0/1367040968 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548013610 con 0x7f555c15df40 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5559600700 1 -- 172.21.15.82:0/1367040968 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548013770 con 0x7f555c15df40 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c1f4580 con 0x7f555c15df40 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5559600700 1 -- 172.21.15.82:0/1367040968 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548013b20 con 0x7f555c15df40 2024-05-10T04:50:23.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.082+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c1f8890 con 0x7f555c15df40 2024-05-10T04:50:23.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.083+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c0ca2e0 con 0x7f555c15df40 2024-05-10T04:50:23.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.084+0000 7f5559600700 1 -- 172.21.15.82:0/1367040968 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5548013c80 con 0x7f555c15df40 2024-05-10T04:50:23.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.085+0000 7f5559600700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f553c06ac90 0x7f553c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.085+0000 7f5559600700 1 -- 172.21.15.82:0/1367040968 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5548088f80 con 0x7f555c15df40 2024-05-10T04:50:23.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.085+0000 7f5561800700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f553c06ac90 0x7f553c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.086+0000 7f5561800700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f553c06ac90 0x7f553c06d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f55500090b0 tx=0x7f555001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.090+0000 7f5559600700 1 -- 172.21.15.82:0/1367040968 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f55480540b0 con 0x7f555c15df40 2024-05-10T04:50:23.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.292+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f555c074af0 con 0x7f555c15df40 2024-05-10T04:50:23.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.293+0000 7f5559600700 1 -- 172.21.15.82:0/1367040968 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f5548021090 con 0x7f555c15df40 2024-05-10T04:50:23.294 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:23.294 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:23.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f553c06ac90 msgr2=0x7f553c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f553c06ac90 0x7f553c06d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f55500090b0 tx=0x7f555001c040 comp rx=0 tx=0).stop 2024-05-10T04:50:23.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c15df40 msgr2=0x7f555c14b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c15df40 0x7f555c14b180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f554800e760 tx=0x7f554800ea70 comp rx=0 tx=0).stop 2024-05-10T04:50:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 shutdown_connections 2024-05-10T04:50:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f553c06ac90 0x7f553c06d1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f555c15e350 0x7f555c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f555c0b2ca0 0x7f555c14a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 --2- 172.21.15.82:0/1367040968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f555c15df40 0x7f555c14b180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 >> 172.21.15.82:0/1367040968 conn(0x7f555c067600 msgr2=0x7f555c15bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 shutdown_connections 2024-05-10T04:50:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.296+0000 7f5562c00700 1 -- 172.21.15.82:0/1367040968 wait complete. 2024-05-10T04:50:23.321 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T04:50:23.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T04:50:23.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T04:50:23.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T04:50:23.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T04:50:23.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T04:50:23.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T04:50:23.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T04:50:23.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.805+0000 7f09d5600700 1 Processor -- start 2024-05-10T04:50:23.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.808+0000 7f8e49800700 1 Processor -- start 2024-05-10T04:50:23.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.806+0000 7f09d5600700 1 -- start start 2024-05-10T04:50:23.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.808+0000 7f8e49800700 1 -- start start 2024-05-10T04:50:23.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.809+0000 7f09d5600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f09d0071620 0x7f09d0071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.809+0000 7f09d5600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f09d00b3f00 0x7f09d00b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.809+0000 7f09d5600700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d0071f70 con 0x7f09d0148b80 2024-05-10T04:50:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.809+0000 7f09d5600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d006f270 con 0x7f09d00b3f00 2024-05-10T04:50:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.809+0000 7f09d5600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d00cd910 con 0x7f09d0071620 2024-05-10T04:50:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.810+0000 7f87aac00700 1 Processor -- start 2024-05-10T04:50:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.810+0000 7f09cf400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f09d00b3f00 0x7f09d00b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.811+0000 7f8e49800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e440cf880 0x7f8e440cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.810+0000 7f87aac00700 1 -- start start 2024-05-10T04:50:23.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.810+0000 7f09cea00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f09d0148b80 0x7f09d006eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:46330/0 (socket says 172.21.15.82:46330) 2024-05-10T04:50:23.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.810+0000 7f09cea00700 1 -- 172.21.15.82:0/2524447972 learned_addr learned my addr 172.21.15.82:0/2524447972 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:23.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.811+0000 7f8e43e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e440cf880 0x7f8e440cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7f8e49800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8e440b59c0 0x7f8e440cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7f8e49800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e440b6d90 con 0x7f8e440cc870 2024-05-10T04:50:23.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7f8e49800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e440b74a0 con 0x7f8e440cf880 2024-05-10T04:50:23.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7f8e49800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e440b3320 con 0x7f8e440b59c0 2024-05-10T04:50:23.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7fe297e00700 1 Processor -- start 2024-05-10T04:50:23.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7f8e43e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e440cf880 0x7f8e440cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56038/0 (socket says 172.21.15.82:56038) 2024-05-10T04:50:23.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7f8e43e00700 1 -- 172.21.15.82:0/3528394531 learned_addr learned my addr 172.21.15.82:0/3528394531 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7f09cf400700 1 -- 172.21.15.82:0/2524447972 >> v2:172.21.15.129:3300/0 conn(0x7f09d0071620 msgr2=0x7f09d0071a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:50:23.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f8e48e00700 1 --2- 172.21.15.82:0/3528394531 >> v2:172.21.15.129:3300/0 conn(0x7f8e440b59c0 0x7f8e440cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7fe8bf400700 1 Processor -- start 2024-05-10T04:50:23.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f87aac00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f87a40b60e0 0x7f87a415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f8e42a00700 1 -- 172.21.15.82:0/3528394531 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313731940 0 0) 0x7f8e440b6d90 con 0x7f8e440cc870 2024-05-10T04:50:23.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f09cf400700 1 --2- 172.21.15.82:0/2524447972 >> v2:172.21.15.129:3300/0 conn(0x7f09d0071620 0x7f09d0071a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f09cf400700 1 -- 172.21.15.82:0/2524447972 >> v1:172.21.15.129:6789/0 conn(0x7f09d0148b80 legacy=0x7f09d006eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f8e42a00700 1 -- 172.21.15.82:0/3528394531 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e280035b0 con 0x7f8e440cc870 2024-05-10T04:50:23.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f09cf400700 1 -- 172.21.15.82:0/2524447972 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0163e00 con 0x7f09d00b3f00 2024-05-10T04:50:23.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7fe8bf400700 1 -- start start 2024-05-10T04:50:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f87aac00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a40d3180 con 0x7f87a40b32b0 2024-05-10T04:50:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f87aac00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a40d2890 con 0x7f87a415f150 2024-05-10T04:50:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f87aac00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a40b36c0 con 0x7f87a40b60e0 2024-05-10T04:50:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.813+0000 7f87a3400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f87a40b60e0 0x7f87a415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f87a3400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f87a40b60e0 0x7f87a415ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46134/0 (socket says 172.21.15.82:46134) 2024-05-10T04:50:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f87a3400700 1 -- 172.21.15.82:0/1565276328 learned_addr learned my addr 172.21.15.82:0/1565276328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f8e48e00700 1 -- 172.21.15.82:0/3528394531 >> v2:172.21.15.82:3300/0 conn(0x7f8e440cf880 msgr2=0x7f8e440cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f8e48e00700 1 --2- 172.21.15.82:0/3528394531 >> v2:172.21.15.82:3300/0 conn(0x7f8e440cf880 0x7f8e440cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f8e48e00700 1 -- 172.21.15.82:0/3528394531 >> v1:172.21.15.82:6789/0 conn(0x7f8e440cc870 legacy=0x7f8e440ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f8e48e00700 1 -- 172.21.15.82:0/3528394531 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e440b71c0 con 0x7f8e440b59c0 2024-05-10T04:50:23.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f8e43e00700 1 --2- 172.21.15.82:0/3528394531 >> v2:172.21.15.82:3300/0 conn(0x7f8e440cf880 0x7f8e440cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:23.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f87a3400700 1 -- 172.21.15.82:0/1565276328 >> v1:172.21.15.129:6789/0 conn(0x7f87a415f150 legacy=0x7f87a415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f87a3400700 1 -- 172.21.15.82:0/1565276328 >> v1:172.21.15.82:6789/0 conn(0x7f87a40b32b0 legacy=0x7f87a40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.814+0000 7f87a3400700 1 -- 172.21.15.82:0/1565276328 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a415f990 con 0x7f87a40b60e0 2024-05-10T04:50:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.812+0000 7fe297e00700 1 -- start start 2024-05-10T04:50:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.815+0000 7fe297e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe290056d50 0x7fe2900541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.815+0000 7f09cf400700 1 --2- 172.21.15.82:0/2524447972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d00b3f00 0x7f09d00b4310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09d0070830 tx=0x7f09c0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52d900e0fe68b43 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7f09cd600700 1 -- 172.21.15.82:0/2524447972 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0011830 con 0x7f09d00b3f00 2024-05-10T04:50:23.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7f09cd600700 1 -- 172.21.15.82:0/2524447972 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c0011990 con 0x7f09d00b3f00 2024-05-10T04:50:23.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.815+0000 7f87a3400700 1 --2- 172.21.15.82:0/1565276328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87a40b60e0 0x7f87a415ec10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f87900098f0 tx=0x7f8790009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c8caa157be4eda server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7f87a2a00700 1 -- 172.21.15.82:0/1565276328 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790004230 con 0x7f87a40b60e0 2024-05-10T04:50:23.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7f87a2a00700 1 -- 172.21.15.82:0/1565276328 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790004390 con 0x7f87a40b60e0 2024-05-10T04:50:23.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7f87a2a00700 1 -- 172.21.15.82:0/1565276328 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900036a0 con 0x7f87a40b60e0 2024-05-10T04:50:23.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.815+0000 7fe297e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe29003c6e0 0x7fe2900f1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.815+0000 7fe297e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe290058290 con 0x7fe290058720 2024-05-10T04:50:23.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.815+0000 7fe297e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900573a0 con 0x7fe290056d50 2024-05-10T04:50:23.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7fe296000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe290058720 0x7fe29003bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43280/0 (socket says 172.21.15.82:43280) 2024-05-10T04:50:23.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7fe296000700 1 -- 172.21.15.82:0/2847212368 learned_addr learned my addr 172.21.15.82:0/2847212368 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:23.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7fe8bf400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe8b80b32b0 0x7fe8b80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7fe8bf400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b80b5f10 0x7fe8b815ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7fe8bf400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b80d3180 con 0x7fe8b815f150 2024-05-10T04:50:23.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7fe8bf400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b80b36c0 con 0x7fe8b80b32b0 2024-05-10T04:50:23.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.816+0000 7fe8bf400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80b6320 con 0x7fe8b80b5f10 2024-05-10T04:50:23.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7fe297e00700 1 -- 172.21.15.82:0/2847212368 --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe290057680 con 0x7fe29003c6e0 2024-05-10T04:50:23.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7fe8bd400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe8b815f150 0x7fe8b806c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43288/0 (socket says 172.21.15.82:43288) 2024-05-10T04:50:23.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7fe8bd400700 1 -- 172.21.15.82:0/2036213384 learned_addr learned my addr 172.21.15.82:0/2036213384 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:23.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7f8e48e00700 1 --2- 172.21.15.82:0/3528394531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440b59c0 0x7f8e440cd390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e440c5180 tx=0x7f8e3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14f46ba321f5903 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7f09cd600700 1 -- 172.21.15.82:0/2524447972 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0011d20 con 0x7f09d00b3f00 2024-05-10T04:50:23.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7f8e42a00700 1 -- 172.21.15.82:0/3528394531 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00e070 con 0x7f8e440b59c0 2024-05-10T04:50:23.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7fe8b7e00700 1 --2- 172.21.15.82:0/2036213384 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b80b5f10 0x7fe8b815ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7f8e42a00700 1 -- 172.21.15.82:0/3528394531 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00bb20 con 0x7f8e440b59c0 2024-05-10T04:50:23.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7f8e42a00700 1 -- 172.21.15.82:0/3528394531 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c012430 con 0x7f8e440b59c0 2024-05-10T04:50:23.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7fe297400700 1 --2- 172.21.15.82:0/2847212368 >> v2:172.21.15.129:3300/0 conn(0x7fe29003c6e0 0x7fe2900f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.817+0000 7fe296a00700 1 --2- 172.21.15.82:0/2847212368 >> v2:172.21.15.82:3300/0 conn(0x7fe290056d50 0x7fe2900541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe8b7e00700 1 -- 172.21.15.82:0/2036213384 >> v2:172.21.15.129:3300/0 conn(0x7fe8b80b32b0 msgr2=0x7fe8b80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe8bca00700 1 --2- 172.21.15.82:0/2036213384 >> v2:172.21.15.129:3300/0 conn(0x7fe8b80b32b0 0x7fe8b80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe8b7e00700 1 --2- 172.21.15.82:0/2036213384 >> v2:172.21.15.129:3300/0 conn(0x7fe8b80b32b0 0x7fe8b80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe8b7e00700 1 -- 172.21.15.82:0/2036213384 >> v1:172.21.15.82:6789/0 conn(0x7fe8b815f150 legacy=0x7fe8b806c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe8b7e00700 1 -- 172.21.15.82:0/2036213384 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80d2890 con 0x7fe8b80b5f10 2024-05-10T04:50:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7f09d5600700 1 -- 172.21.15.82:0/2524447972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d00b3f00 msgr2=0x7f09d00b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7f09d5600700 1 --2- 172.21.15.82:0/2524447972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d00b3f00 0x7f09d00b4310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09d0070830 tx=0x7f09c0009b20 comp rx=0 tx=0).stop 2024-05-10T04:50:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe8b7e00700 1 --2- 172.21.15.82:0/2036213384 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b80b5f10 0x7fe8b815ec10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009840 tx=0x7fe8b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e479e0b4693a07a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe8bca00700 1 --2- 172.21.15.82:0/2036213384 >> v2:172.21.15.129:3300/0 conn(0x7fe8b80b32b0 0x7fe8b80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7f8e49800700 1 -- 172.21.15.82:0/3528394531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440b59c0 msgr2=0x7f8e440cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7f09d5600700 1 -- 172.21.15.82:0/2524447972 shutdown_connections 2024-05-10T04:50:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7f09d5600700 1 --2- 172.21.15.82:0/2524447972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d00b3f00 0x7f09d00b4310 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7f09d5600700 1 --2- 172.21.15.82:0/2524447972 >> v2:172.21.15.129:3300/0 conn(0x7f09d0071620 0x7f09d0071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7f09d5600700 1 -- 172.21.15.82:0/2524447972 >> 172.21.15.82:0/2524447972 conn(0x7f09d006b470 msgr2=0x7f09d00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7f8e49800700 1 --2- 172.21.15.82:0/3528394531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440b59c0 0x7f8e440cd390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e440c5180 tx=0x7f8e3c00b330 comp rx=0 tx=0).stop 2024-05-10T04:50:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe8b7400700 1 -- 172.21.15.82:0/2036213384 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0004230 con 0x7fe8b80b5f10 2024-05-10T04:50:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.818+0000 7fe295600700 1 -- 172.21.15.82:0/2847212368 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791096479 0 0) 0x7fe290058290 con 0x7fe290058720 2024-05-10T04:50:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7fe8b7400700 1 -- 172.21.15.82:0/2036213384 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0004390 con 0x7fe8b80b5f10 2024-05-10T04:50:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7fe8b7400700 1 -- 172.21.15.82:0/2036213384 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00036a0 con 0x7fe8b80b5f10 2024-05-10T04:50:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7f09d5600700 1 -- 172.21.15.82:0/2524447972 shutdown_connections 2024-05-10T04:50:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7fe296a00700 1 -- 172.21.15.82:0/2847212368 >> v2:172.21.15.129:3300/0 conn(0x7fe29003c6e0 msgr2=0x7fe2900f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7fe296a00700 1 --2- 172.21.15.82:0/2847212368 >> v2:172.21.15.129:3300/0 conn(0x7fe29003c6e0 0x7fe2900f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7fe296a00700 1 -- 172.21.15.82:0/2847212368 >> v1:172.21.15.82:6789/0 conn(0x7fe290058720 legacy=0x7fe29003bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7fe296a00700 1 -- 172.21.15.82:0/2847212368 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290057960 con 0x7fe290056d50 2024-05-10T04:50:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7f8e49800700 1 -- 172.21.15.82:0/3528394531 shutdown_connections 2024-05-10T04:50:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7f8e49800700 1 --2- 172.21.15.82:0/3528394531 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440b59c0 0x7f8e440cd390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7f8e49800700 1 --2- 172.21.15.82:0/3528394531 >> v2:172.21.15.82:3300/0 conn(0x7f8e440cf880 0x7f8e440cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.819+0000 7f8e49800700 1 -- 172.21.15.82:0/3528394531 >> 172.21.15.82:0/3528394531 conn(0x7f8e440ce550 msgr2=0x7f8e440ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7fe296a00700 1 --2- 172.21.15.82:0/2847212368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe290056d50 0x7fe2900541e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe2900384c0 tx=0x7fe288009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e7c70b45dbd9ed server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7fe8bf400700 1 -- 172.21.15.82:0/2036213384 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b80b5f10 msgr2=0x7fe8b815ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7f8e49800700 1 -- 172.21.15.82:0/3528394531 shutdown_connections 2024-05-10T04:50:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7f8e49800700 1 -- 172.21.15.82:0/3528394531 wait complete. 2024-05-10T04:50:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7fe8bf400700 1 --2- 172.21.15.82:0/2036213384 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b80b5f10 0x7fe8b815ec10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009840 tx=0x7fe8b0009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.821+0000 7fe295600700 1 -- 172.21.15.82:0/2847212368 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800b850 con 0x7fe290056d50 2024-05-10T04:50:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7f09d5600700 1 -- 172.21.15.82:0/2524447972 wait complete. 2024-05-10T04:50:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.821+0000 7fe295600700 1 -- 172.21.15.82:0/2847212368 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28800b9b0 con 0x7fe290056d50 2024-05-10T04:50:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.821+0000 7fe295600700 1 -- 172.21.15.82:0/2847212368 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800b850 con 0x7fe290056d50 2024-05-10T04:50:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7f87aac00700 1 -- 172.21.15.82:0/1565276328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87a40b60e0 msgr2=0x7f87a415ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7f87aac00700 1 --2- 172.21.15.82:0/1565276328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87a40b60e0 0x7f87a415ec10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f87900098f0 tx=0x7f8790009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7f87aac00700 1 -- 172.21.15.82:0/1565276328 shutdown_connections 2024-05-10T04:50:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7f87aac00700 1 --2- 172.21.15.82:0/1565276328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87a40b60e0 0x7f87a415ec10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.820+0000 7f87aac00700 1 -- 172.21.15.82:0/1565276328 >> 172.21.15.82:0/1565276328 conn(0x7f87a40d0a40 msgr2=0x7f87a40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.822+0000 7fe297e00700 1 -- 172.21.15.82:0/2847212368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe290056d50 msgr2=0x7fe2900541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.822+0000 7fe297e00700 1 --2- 172.21.15.82:0/2847212368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe290056d50 0x7fe2900541e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe2900384c0 tx=0x7fe288009d80 comp rx=0 tx=0).stop 2024-05-10T04:50:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe8bf400700 1 -- 172.21.15.82:0/2036213384 shutdown_connections 2024-05-10T04:50:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe8bf400700 1 --2- 172.21.15.82:0/2036213384 >> v2:172.21.15.129:3300/0 conn(0x7fe8b80b32b0 0x7fe8b80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe8bf400700 1 --2- 172.21.15.82:0/2036213384 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b80b5f10 0x7fe8b815ec10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe8bf400700 1 -- 172.21.15.82:0/2036213384 >> 172.21.15.82:0/2036213384 conn(0x7fe8b80d0a40 msgr2=0x7fe8b80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe8bf400700 1 -- 172.21.15.82:0/2036213384 shutdown_connections 2024-05-10T04:50:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe297e00700 1 -- 172.21.15.82:0/2847212368 shutdown_connections 2024-05-10T04:50:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe297e00700 1 --2- 172.21.15.82:0/2847212368 >> v2:172.21.15.129:3300/0 conn(0x7fe29003c6e0 0x7fe2900f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe297e00700 1 --2- 172.21.15.82:0/2847212368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe290056d50 0x7fe2900541e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe8bf400700 1 -- 172.21.15.82:0/2036213384 wait complete. 2024-05-10T04:50:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe297e00700 1 -- 172.21.15.82:0/2847212368 >> 172.21.15.82:0/2847212368 conn(0x7fe29003ac70 msgr2=0x7fe29003b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7f9ff5800700 1 Processor -- start 2024-05-10T04:50:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe297e00700 1 -- 172.21.15.82:0/2847212368 shutdown_connections 2024-05-10T04:50:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.823+0000 7fe297e00700 1 -- 172.21.15.82:0/2847212368 wait complete. 2024-05-10T04:50:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.824+0000 7f9ff5800700 1 -- start start 2024-05-10T04:50:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.824+0000 7f09d5600700 1 Processor -- start 2024-05-10T04:50:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.825+0000 7f8e49800700 1 Processor -- start 2024-05-10T04:50:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.825+0000 7f87aac00700 1 -- 172.21.15.82:0/1565276328 shutdown_connections 2024-05-10T04:50:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.826+0000 7fe8bf400700 1 Processor -- start 2024-05-10T04:50:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.826+0000 7fe8bf400700 1 -- start start 2024-05-10T04:50:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9ff5800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ff0071620 0x7f9ff0071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9ff5800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ff00b3f00 0x7f9ff00b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9ff5800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff0071f70 con 0x7f9ff0148b80 2024-05-10T04:50:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9ff5800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff006f270 con 0x7f9ff0071620 2024-05-10T04:50:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9ff5800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00cd910 con 0x7f9ff00b3f00 2024-05-10T04:50:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.825+0000 7f09d5600700 1 -- start start 2024-05-10T04:50:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9feea00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9ff0148b80 0x7f9ff006eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43290/0 (socket says 172.21.15.82:43290) 2024-05-10T04:50:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9feea00700 1 -- 172.21.15.82:0/2121650585 learned_addr learned my addr 172.21.15.82:0/2121650585 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9fee000700 1 --2- 172.21.15.82:0/2121650585 >> v2:172.21.15.82:3300/0 conn(0x7f9ff0071620 0x7f9ff0071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.827+0000 7f9fef400700 1 --2- 172.21.15.82:0/2121650585 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ff00b3f00 0x7f9ff00b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.826+0000 7f8e49800700 1 -- start start 2024-05-10T04:50:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f8e49800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8e440b59c0 0x7f8e441e2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f8e49800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e440cc870 0x7f8e441fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f8e49800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440cf880 0x7f8e44099c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f9fed600700 1 -- 172.21.15.82:0/2121650585 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986796790 0 0) 0x7f9ff0071f70 con 0x7f9ff0148b80 2024-05-10T04:50:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f88d4000700 1 Processor -- start 2024-05-10T04:50:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f8e43400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e440cc870 0x7f8e441fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f88d4000700 1 -- start start 2024-05-10T04:50:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f8e49800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440cb520 con 0x7f8e440cc870 2024-05-10T04:50:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f8e49800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e441e7a70 con 0x7f8e440cf880 2024-05-10T04:50:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f8e49800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e441fc350 con 0x7f8e440b59c0 2024-05-10T04:50:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f8e48e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440cf880 0x7f8e44099c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f9fee000700 1 -- 172.21.15.82:0/2121650585 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ff00b3f00 msgr2=0x7f9ff00b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f9fee000700 1 --2- 172.21.15.82:0/2121650585 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ff00b3f00 0x7f9ff00b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f9fee000700 1 -- 172.21.15.82:0/2121650585 >> v1:172.21.15.82:6789/0 conn(0x7f9ff0148b80 legacy=0x7f9ff006eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f9fee000700 1 -- 172.21.15.82:0/2121650585 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff0163e00 con 0x7f9ff0071620 2024-05-10T04:50:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7fe8bf400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8b80b32b0 0x7fe8b81541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7f9fee000700 1 --2- 172.21.15.82:0/2121650585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff0071620 0x7f9ff0071a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009840 tx=0x7f9fe0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaf5d8e1193c674 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7fe8bf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8b80b5f10 0x7fe8b8071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7fe8bf400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b815f150 0x7fe8b8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7fe8bf400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80720f0 con 0x7fe8b80b5f10 2024-05-10T04:50:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7fe8bf400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81fce80 con 0x7fe8b80b32b0 2024-05-10T04:50:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.829+0000 7fe8bf400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81f9900 con 0x7fe8b815f150 2024-05-10T04:50:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f9fed600700 1 -- 172.21.15.82:0/2121650585 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0011830 con 0x7f9ff0071620 2024-05-10T04:50:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f9fed600700 1 -- 172.21.15.82:0/2121650585 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0011990 con 0x7f9ff0071620 2024-05-10T04:50:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7fe8b7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8b80b5f10 0x7fe8b8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f9fed600700 1 -- 172.21.15.82:0/2121650585 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0011d20 con 0x7f9ff0071620 2024-05-10T04:50:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7fe8b7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8b80b5f10 0x7fe8b8071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56068/0 (socket says 172.21.15.82:56068) 2024-05-10T04:50:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7fe8b7e00700 1 -- 172.21.15.82:0/1591455224 learned_addr learned my addr 172.21.15.82:0/1591455224 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f8e43400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e440cc870 0x7f8e441fba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56064/0 (socket says 172.21.15.82:56064) 2024-05-10T04:50:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7fe8bca00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8b80b32b0 0x7fe8b81541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f8e43400700 1 -- 172.21.15.82:0/4066939372 learned_addr learned my addr 172.21.15.82:0/4066939372 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f8e43e00700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8e440b59c0 0x7f8e441e2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f09d5600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09d0071620 0x7f09d014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f09d5600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d00b3f00 0x7f09d01ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f09d5600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09d0148b80 0x7f09d0145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f09d5600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d01ef0a0 con 0x7f09d00b3f00 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f09d5600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d014bf30 con 0x7f09d0148b80 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.828+0000 7f09d5600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d01ec2f0 con 0x7f09d0071620 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f09cea00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09d0071620 0x7f09d014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f09cea00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09d0071620 0x7f09d014b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:51552/0 (socket says 172.21.15.82:51552) 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7f09cea00700 1 -- 172.21.15.82:0/1581509138 learned_addr learned my addr 172.21.15.82:0/1581509138 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7fe8b7e00700 1 -- 172.21.15.82:0/1591455224 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b815f150 msgr2=0x7fe8b8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f09cea00700 1 -- 172.21.15.82:0/1581509138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09d0148b80 msgr2=0x7f09d0145600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T04:50:23.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f09cea00700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09d0148b80 0x7f09d0145600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7fe297e00700 1 Processor -- start 2024-05-10T04:50:23.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f09cea00700 1 -- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d00b3f00 msgr2=0x7f09d01ecfe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T04:50:23.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f09cea00700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09d00b3f00 0x7f09d01ecfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f09cea00700 1 -- 172.21.15.82:0/1581509138 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c00094a0 con 0x7f09d0071620 2024-05-10T04:50:23.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7fe297e00700 1 -- start start 2024-05-10T04:50:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f8e43400700 1 -- 172.21.15.82:0/4066939372 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8e440b59c0 msgr2=0x7f8e441e2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f8e43400700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8e440b59c0 0x7f8e441e2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f8e43400700 1 -- 172.21.15.82:0/4066939372 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440cf880 msgr2=0x7f8e44099c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f8e43400700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440cf880 0x7f8e44099c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f8e43400700 1 -- 172.21.15.82:0/4066939372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009a70 con 0x7f8e440cc870 2024-05-10T04:50:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f9ff5800700 1 -- 172.21.15.82:0/2121650585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff0071620 msgr2=0x7f9ff0071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f9ff5800700 1 --2- 172.21.15.82:0/2121650585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff0071620 0x7f9ff0071a30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009840 tx=0x7f9fe0009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f8e48e00700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8e440cf880 0x7f8e44099c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.831+0000 7f09cea00700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09d0071620 0x7f09d014b9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f09c800cb10 tx=0x7f09c800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.825+0000 7f87aac00700 1 -- 172.21.15.82:0/1565276328 wait complete. 2024-05-10T04:50:23.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f87aac00700 1 Processor -- start 2024-05-10T04:50:23.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f8e43400700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e440cc870 0x7f8e441fba30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c430 tx=0x7f8e3000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800aac0 con 0x7f09d0071620 2024-05-10T04:50:23.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c800ac20 con 0x7f09d0071620 2024-05-10T04:50:23.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8012400 con 0x7f09d0071620 2024-05-10T04:50:23.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f9ff5800700 1 -- 172.21.15.82:0/2121650585 shutdown_connections 2024-05-10T04:50:23.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f9ff5800700 1 --2- 172.21.15.82:0/2121650585 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ff00b3f00 0x7f9ff00b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f9ff5800700 1 --2- 172.21.15.82:0/2121650585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff0071620 0x7f9ff0071a30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f9ff5800700 1 -- 172.21.15.82:0/2121650585 >> 172.21.15.82:0/2121650585 conn(0x7f9ff006b470 msgr2=0x7f9ff00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f87aac00700 1 -- start start 2024-05-10T04:50:23.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300052d0 con 0x7f8e440cc870 2024-05-10T04:50:23.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f88d4000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 0x7f88cc0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.830+0000 7fe8bd400700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b815f150 0x7fe8b8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f8e49800700 1 -- 172.21.15.82:0/4066939372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e441f8ba0 con 0x7f8e440cc870 2024-05-10T04:50:23.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f8e49800700 1 -- 172.21.15.82:0/4066939372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e441fc5a0 con 0x7f8e440cc870 2024-05-10T04:50:23.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.832+0000 7f88d4000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88cc0d28c0 con 0x7f88cc0b2f50 2024-05-10T04:50:23.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000ce90 con 0x7f8e440cc870 2024-05-10T04:50:23.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7f88d4000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88cc0d2ba0 con 0x7f88cc0d0b70 2024-05-10T04:50:23.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7f88d4000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0b3360 con 0x7f88cc161fa0 2024-05-10T04:50:23.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7f88d1600700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f88cc0b2f50 0x7f88cc0d3030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43294/0 (socket says 172.21.15.82:43294) 2024-05-10T04:50:23.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7f88d1600700 1 -- 172.21.15.82:0/458367519 learned_addr learned my addr 172.21.15.82:0/458367519 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300052d0 con 0x7f8e440cc870 2024-05-10T04:50:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f9ff5800700 1 -- 172.21.15.82:0/2121650585 shutdown_connections 2024-05-10T04:50:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7fe8b7e00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b815f150 0x7fe8b8071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7fe8b7e00700 1 -- 172.21.15.82:0/1591455224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8b80b32b0 msgr2=0x7fe8b81541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f88d0c00700 1 --2- 172.21.15.82:0/458367519 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 0x7f88cc0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f87aac00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87a40b32b0 0x7f87a4153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f87aac00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87a415f150 0x7f87a4154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f87aac00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f87a41581a0 0x7f87a41585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f87aac00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a41f5cc0 con 0x7f87a40b32b0 2024-05-10T04:50:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f87aac00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a41555b0 con 0x7f87a415f150 2024-05-10T04:50:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f87aac00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4154730 con 0x7f87a41581a0 2024-05-10T04:50:23.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f87a3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87a40b32b0 0x7f87a4153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7fe297e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29003c6e0 0x7fe2900e30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7fe8b7e00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8b80b32b0 0x7fe8b81541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.833+0000 7fe8b7e00700 1 -- 172.21.15.82:0/1591455224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00094a0 con 0x7fe8b80b5f10 2024-05-10T04:50:23.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7fe8bca00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8b80b32b0 0x7fe8b81541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7fe8bd400700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8b815f150 0x7fe8b8071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:23.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f87a3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87a40b32b0 0x7f87a4153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56072/0 (socket says 172.21.15.82:56072) 2024-05-10T04:50:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f87a3e00700 1 -- 172.21.15.82:0/1211661817 learned_addr learned my addr 172.21.15.82:0/1211661817 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7fe297e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe290056d50 0x7fe2900d9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f88cbe00700 1 -- 172.21.15.82:0/458367519 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033421604 0 0) 0x7f88cc0d28c0 con 0x7f88cc0b2f50 2024-05-10T04:50:23.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f88cbe00700 1 -- 172.21.15.82:0/458367519 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b40035b0 con 0x7f88cc0b2f50 2024-05-10T04:50:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7fe297e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe290058720 0x7fe2900da250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.834+0000 7f9ff5800700 1 -- 172.21.15.82:0/2121650585 wait complete. 2024-05-10T04:50:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7fe296000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe290056d50 0x7fe2900d9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7fe296000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe290056d50 0x7fe2900d9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46204/0 (socket says 172.21.15.82:46204) 2024-05-10T04:50:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7fe296000700 1 -- 172.21.15.82:0/363167120 learned_addr learned my addr 172.21.15.82:0/363167120 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7fe297400700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe290058720 0x7fe2900da250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f87a3e00700 1 -- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f87a41581a0 msgr2=0x7f87a41585b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:50:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f87a3e00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f87a41581a0 0x7f87a41585b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900e3630 con 0x7fe29003c6e0 2024-05-10T04:50:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f87a3e00700 1 -- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87a415f150 msgr2=0x7f87a4154c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:50:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.836+0000 7f87a3e00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f87a415f150 0x7f87a4154c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.836+0000 7f87a3e00700 1 -- 172.21.15.82:0/1211661817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8790009550 con 0x7f87a40b32b0 2024-05-10T04:50:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.836+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900dcd90 con 0x7fe290056d50 2024-05-10T04:50:23.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.836+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900ea1e0 con 0x7fe290058720 2024-05-10T04:50:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.836+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d01eeb70 con 0x7f09d0071620 2024-05-10T04:50:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.836+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d01ec500 con 0x7f09d0071620 2024-05-10T04:50:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f88d0c00700 1 -- 172.21.15.82:0/458367519 >> v1:172.21.15.129:6789/0 conn(0x7f88cc0d0b70 legacy=0x7f88cc0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f88d0c00700 1 -- 172.21.15.82:0/458367519 >> v1:172.21.15.82:6789/0 conn(0x7f88cc0b2f50 legacy=0x7f88cc0d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.835+0000 7f88d0c00700 1 -- 172.21.15.82:0/458367519 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc0cf970 con 0x7f88cc161fa0 2024-05-10T04:50:23.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.837+0000 7fe297400700 1 -- 172.21.15.82:0/363167120 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe290056d50 msgr2=0x7fe2900d9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.837+0000 7fe297400700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe290056d50 0x7fe2900d9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.837+0000 7fe297400700 1 -- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29003c6e0 msgr2=0x7fe2900e30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.837+0000 7fe297400700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe29003c6e0 0x7fe2900e30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.837+0000 7fe297400700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2880094a0 con 0x7fe290058720 2024-05-10T04:50:23.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.836+0000 7f87a3e00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87a40b32b0 0x7f87a4153d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f879c00b9f0 tx=0x7f879c00bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.837+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e30005430 con 0x7f8e440cc870 2024-05-10T04:50:23.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.837+0000 7fe296000700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe290056d50 0x7fe2900d9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:23.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f8e49800700 1 -- 172.21.15.82:0/4066939372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e1c000fb0 con 0x7f8e440cc870 2024-05-10T04:50:23.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00ca30 con 0x7f87a40b32b0 2024-05-10T04:50:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f88d0c00700 1 --2- 172.21.15.82:0/458367519 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 0x7f88cc0d0630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009870 tx=0x7f88c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7c9b13b96021b88 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7fe297400700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe290058720 0x7fe2900da250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe2980644e0 tx=0x7fe298068750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09d0166a50 con 0x7f09d0071620 2024-05-10T04:50:23.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f88cbe00700 1 -- 172.21.15.82:0/458367519 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0004230 con 0x7f88cc161fa0 2024-05-10T04:50:23.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c00cb90 con 0x7f87a40b32b0 2024-05-10T04:50:23.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f8e3be00700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8e2406ad20 0x7f8e2406d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e300882e0 con 0x7f8e440cc870 2024-05-10T04:50:23.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f8e3be00700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7f8e24072f10 0x7f8e24075360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 --> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e24075a30 con 0x7f8e24072f10 2024-05-10T04:50:23.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e300533c0 con 0x7f8e440cc870 2024-05-10T04:50:23.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f88cbe00700 1 -- 172.21.15.82:0/458367519 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0004390 con 0x7f88cc161fa0 2024-05-10T04:50:23.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980748b0 con 0x7fe290058720 2024-05-10T04:50:23.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.839+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe298074a10 con 0x7fe290058720 2024-05-10T04:50:23.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.839+0000 7f8e48e00700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7f8e24072f10 0x7f8e24075360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.839+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2900dad20 con 0x7fe290058720 2024-05-10T04:50:23.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.839+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2900daf70 con 0x7fe290058720 2024-05-10T04:50:23.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.839+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980956a0 con 0x7fe290058720 2024-05-10T04:50:23.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a4158af0 con 0x7f87a40b32b0 2024-05-10T04:50:23.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a4155ae0 con 0x7f87a40b32b0 2024-05-10T04:50:23.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.839+0000 7f88d4000700 1 -- 172.21.15.82:0/458367519 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 msgr2=0x7f88cc0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.839+0000 7f88d4000700 1 --2- 172.21.15.82:0/458367519 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 0x7f88cc0d0630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009870 tx=0x7f88c0009b80 comp rx=0 tx=0).stop 2024-05-10T04:50:23.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7fde80600700 1 Processor -- start 2024-05-10T04:50:23.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c014440 con 0x7f87a40b32b0 2024-05-10T04:50:23.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f877c000fb0 con 0x7f87a40b32b0 2024-05-10T04:50:23.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.838+0000 7fe8b7e00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8b80b5f10 0x7fe8b8071670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80b6460 tx=0x7fe8b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0003db0 con 0x7fe8b80b5f10 2024-05-10T04:50:23.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b001f070 con 0x7fe8b80b5f10 2024-05-10T04:50:23.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0011830 con 0x7fe8b80b5f10 2024-05-10T04:50:23.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b81f8b40 con 0x7fe8b80b5f10 2024-05-10T04:50:23.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7f8e48e00700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7f8e24072f10 0x7f8e24075360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7f8e43e00700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8e2406ad20 0x7f8e2406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b81f9100 con 0x7fe8b80b5f10 2024-05-10T04:50:23.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.841+0000 7f88d4000700 1 -- 172.21.15.82:0/458367519 shutdown_connections 2024-05-10T04:50:23.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.841+0000 7f88d4000700 1 --2- 172.21.15.82:0/458367519 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 0x7f88cc0d0630 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.841+0000 7f88d4000700 1 -- 172.21.15.82:0/458367519 >> 172.21.15.82:0/458367519 conn(0x7f88cc06c3f0 msgr2=0x7f88cc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f09c801b3b0 con 0x7f09d0071620 2024-05-10T04:50:23.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.841+0000 7f09c6a00700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f09b006ac90 0x7f09b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.842+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09c8088f80 con 0x7f09d0071620 2024-05-10T04:50:23.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.842+0000 7f9ff5800700 1 Processor -- start 2024-05-10T04:50:23.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.841+0000 7f88d4000700 1 -- 172.21.15.82:0/458367519 shutdown_connections 2024-05-10T04:50:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.843+0000 7f09c6a00700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7f09b0072f00 0x7f09b0075350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.843+0000 7f8e43e00700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8e2406ad20 0x7f8e2406d230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e340045f0 tx=0x7f8e34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.843+0000 7f09ce000700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f09b006ac90 0x7f09b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.843+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 --> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09b0075a20 con 0x7f09b0072f00 2024-05-10T04:50:23.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.843+0000 7f09cf400700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7f09b0072f00 0x7f09b0075350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.844+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09c808b5a0 con 0x7f09d0071620 2024-05-10T04:50:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.840+0000 7fde80600700 1 -- start start 2024-05-10T04:50:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.843+0000 7fde80600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde780b2f50 0x7fde78161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.842+0000 7f9ff5800700 1 -- start start 2024-05-10T04:50:23.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.844+0000 7fde80600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.844+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f879c01d3b0 con 0x7f87a40b32b0 2024-05-10T04:50:23.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7f09cf400700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7f09b0072f00 0x7f09b0075350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 <== osd.0 v2:172.21.15.82:6808/43965 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8e24075a30 con 0x7f8e24072f10 2024-05-10T04:50:23.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7f9ff5800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff0071620 0x7f9ff0151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7fde7dc00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde780b2f50 0x7fde78161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7f09ce000700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f09b006ac90 0x7f09b006d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09bc006fd0 tx=0x7f09bc006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7fde7dc00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde780b2f50 0x7fde78161fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56098/0 (socket says 172.21.15.82:56098) 2024-05-10T04:50:23.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7fde7dc00700 1 -- 172.21.15.82:0/362371558 learned_addr learned my addr 172.21.15.82:0/362371558 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f879be00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f878406ad90 0x7f878406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7f9ff5800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ff00b3f00 0x7f9ff00aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f9ff5800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ff0148b80 0x7f9ff00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f9ff5800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00aa2e0 con 0x7f9ff0071620 2024-05-10T04:50:23.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f9ff5800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0151880 con 0x7f9ff0148b80 2024-05-10T04:50:23.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f9ff5800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff01515c0 con 0x7f9ff00b3f00 2024-05-10T04:50:23.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f879c089140 con 0x7f87a40b32b0 2024-05-10T04:50:23.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.844+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8b0021030 con 0x7fe8b80b5f10 2024-05-10T04:50:23.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.845+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8b80d2e10 con 0x7fe8b80b5f10 2024-05-10T04:50:23.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fe8b4c00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe89406ad60 0x7fe89406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8b008a7a0 con 0x7fe8b80b5f10 2024-05-10T04:50:23.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fe8b4c00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fe894072f50 0x7fe8940753a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 --> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe894075a70 con 0x7fe894072f50 2024-05-10T04:50:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.842+0000 7f88d4000700 1 -- 172.21.15.82:0/458367519 wait complete. 2024-05-10T04:50:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f879be00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f8784073000 0x7f8784075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 --> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8784075b20 con 0x7f8784073000 2024-05-10T04:50:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f879c08b760 con 0x7f87a40b32b0 2024-05-10T04:50:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f9fef400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ff0148b80 0x7f9ff00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fde80600700 1 --2- 172.21.15.82:0/362371558 >> v2:172.21.15.129:3300/0 conn(0x7fde780d0630 0x7fde780d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fde80600700 1 -- 172.21.15.82:0/362371558 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde780b3360 con 0x7fde780b2f50 2024-05-10T04:50:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fde80600700 1 -- 172.21.15.82:0/362371558 --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde781624e0 con 0x7fde780d0630 2024-05-10T04:50:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fde80600700 1 -- 172.21.15.82:0/362371558 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde780d28c0 con 0x7fde780d3030 2024-05-10T04:50:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7f9fef400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ff0148b80 0x7f9ff00b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46218/0 (socket says 172.21.15.82:46218) 2024-05-10T04:50:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7f9feea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff0071620 0x7f9ff0151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7fe8bd400700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fe894072f50 0x7fe8940753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7f9fef400700 1 -- 172.21.15.82:0/3285920346 learned_addr learned my addr 172.21.15.82:0/3285920346 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8b0009100 con 0x7fe8b80b5f10 2024-05-10T04:50:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7fde7dc00700 1 -- 172.21.15.82:0/362371558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 msgr2=0x7fde780d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7fe8bca00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe89406ad60 0x7fe89406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 <== osd.2 v2:172.21.15.82:6813/43970 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f09b0075a20 con 0x7f09b0072f00 2024-05-10T04:50:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7f88d4000700 1 Processor -- start 2024-05-10T04:50:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7f88d4000700 1 -- start start 2024-05-10T04:50:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.846+0000 7fde7d200700 1 --2- 172.21.15.82:0/362371558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7fde7dc00700 1 --2- 172.21.15.82:0/362371558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7fde7dc00700 1 -- 172.21.15.82:0/362371558 >> v2:172.21.15.129:3300/0 conn(0x7fde780d0630 msgr2=0x7fde780d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7fde7dc00700 1 --2- 172.21.15.82:0/362371558 >> v2:172.21.15.129:3300/0 conn(0x7fde780d0630 0x7fde780d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7fde7dc00700 1 -- 172.21.15.82:0/362371558 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780d2ba0 con 0x7fde780b2f50 2024-05-10T04:50:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7f87a3400700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f878406ad90 0x7f878406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.847+0000 7f9fef400700 1 -- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ff00b3f00 msgr2=0x7f9ff00aee60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:50:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7f9fef400700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9ff00b3f00 0x7f9ff00aee60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7f9fef400700 1 -- 172.21.15.82:0/3285920346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff0071620 msgr2=0x7f9ff0151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7f9fef400700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff0071620 0x7f9ff0151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7f9fef400700 1 -- 172.21.15.82:0/3285920346 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00094a0 con 0x7f9ff0148b80 2024-05-10T04:50:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7fde7d200700 1 --2- 172.21.15.82:0/362371558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7f9fef400700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ff0148b80 0x7f9ff00b08c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00e7c0 tx=0x7f9fdc00ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe298095800 con 0x7fe290058720 2024-05-10T04:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.849+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe270000fb0 con 0x7fe290058720 2024-05-10T04:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.848+0000 7fde7dc00700 1 --2- 172.21.15.82:0/362371558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780b2f50 0x7fde78161fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde78067a10 tx=0x7fde7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8b7e78c00d4ba5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.849+0000 7f87a8c00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f8784073000 0x7f8784075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.849+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc009550 con 0x7f9ff0148b80 2024-05-10T04:50:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.849+0000 7fde77e00700 1 -- 172.21.15.82:0/362371558 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e070 con 0x7fde780b2f50 2024-05-10T04:50:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.849+0000 7fde77e00700 1 -- 172.21.15.82:0/362371558 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000b9c0 con 0x7fde780b2f50 2024-05-10T04:50:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.849+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc013680 con 0x7f9ff0148b80 2024-05-10T04:50:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7fde77e00700 1 -- 172.21.15.82:0/362371558 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e070 con 0x7fde780b2f50 2024-05-10T04:50:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.849+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc009550 con 0x7f9ff0148b80 2024-05-10T04:50:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7fe28ea00700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe27806ac90 0x7fe27806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff00af3a0 con 0x7f9ff0148b80 2024-05-10T04:50:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff0151db0 con 0x7f9ff0148b80 2024-05-10T04:50:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe298090070 con 0x7fe290058720 2024-05-10T04:50:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7fe28ea00700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7fe278072e80 0x7fe2780752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2780759a0 con 0x7fe278072e80 2024-05-10T04:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2980ceb80 con 0x7fe290058720 2024-05-10T04:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fde80600700 1 -- 172.21.15.82:0/362371558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780b2f50 msgr2=0x7fde78161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fde80600700 1 --2- 172.21.15.82:0/362371558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780b2f50 0x7fde78161fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde78067a10 tx=0x7fde7000b330 comp rx=0 tx=0).stop 2024-05-10T04:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7f87a3400700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f878406ad90 0x7f878406d2a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87a40b6400 tx=0x7f8790008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.850+0000 7fe8bd400700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fe894072f50 0x7fe8940753a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fe8bca00700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe89406ad60 0x7fe89406d270 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8b808cd80 tx=0x7fe8a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fe296000700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7fe278072e80 0x7fe2780752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fe296a00700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe27806ac90 0x7fe27806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fde80600700 1 -- 172.21.15.82:0/362371558 shutdown_connections 2024-05-10T04:50:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fde80600700 1 --2- 172.21.15.82:0/362371558 >> v2:172.21.15.129:3300/0 conn(0x7fde780d0630 0x7fde780d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fde80600700 1 --2- 172.21.15.82:0/362371558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780b2f50 0x7fde78161fa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fde80600700 1 --2- 172.21.15.82:0/362371558 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.851+0000 7fde80600700 1 -- 172.21.15.82:0/362371558 >> 172.21.15.82:0/362371558 conn(0x7fde7806c3f0 msgr2=0x7fde7806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.852+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 <== osd.3 v2:172.21.15.82:6816/43967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe894075a70 con 0x7fe894072f50 2024-05-10T04:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.852+0000 7f87a8c00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f8784073000 0x7f8784075450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.852+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ff0166a50 con 0x7f9ff0148b80 2024-05-10T04:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.852+0000 7fde80600700 1 -- 172.21.15.82:0/362371558 shutdown_connections 2024-05-10T04:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.853+0000 7f88d4000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88cc0b2f50 0x7f88cc0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.853+0000 7f88d4000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc0d0b70 0x7f88cc0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.853+0000 7fde80600700 1 -- 172.21.15.82:0/362371558 wait complete. 2024-05-10T04:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.853+0000 7f88d4000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 0x7f88cc156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.853+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9fdc0137f0 con 0x7f9ff0148b80 2024-05-10T04:50:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.853+0000 7f88d0c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc0d0b70 0x7f88cc0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 <== osd.5 v2:172.21.15.129:6816/44259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8784075b20 con 0x7f8784073000 2024-05-10T04:50:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f88d0c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc0d0b70 0x7f88cc0cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46240/0 (socket says 172.21.15.82:46240) 2024-05-10T04:50:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f88d0c00700 1 -- 172.21.15.82:0/2265302818 learned_addr learned my addr 172.21.15.82:0/2265302818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.852+0000 7fe296000700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7fe278072e80 0x7fe2780752d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f88d4000700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0ca0a0 con 0x7f88cc0b2f50 2024-05-10T04:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f88d4000700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0cde40 con 0x7f88cc0d0b70 2024-05-10T04:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f88d4000700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c9490 con 0x7f88cc161fa0 2024-05-10T04:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f88d2000700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 0x7f88cc156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f88d1600700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88cc0b2f50 0x7f88cc0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.852+0000 7fe296a00700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe27806ac90 0x7fe27806d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe288000c00 tx=0x7fe288010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.855+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 <== osd.1 v2:172.21.15.82:6800/43969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe2780759a0 con 0x7fe278072e80 2024-05-10T04:50:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.854+0000 7f9fe6a00700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9fd006ad20 0x7f9fd006d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.855+0000 7f9feea00700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9fd006ad20 0x7f9fd006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.855+0000 7f88d0c00700 1 -- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 msgr2=0x7f88cc156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.855+0000 7f88d0c00700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f88cc161fa0 0x7f88cc156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.855+0000 7f88d0c00700 1 -- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88cc0b2f50 msgr2=0x7f88cc0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.855+0000 7f88d0c00700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88cc0b2f50 0x7f88cc0cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.855+0000 7f88d0c00700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00094a0 con 0x7f88cc0d0b70 2024-05-10T04:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.856+0000 7f88d1600700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88cc0b2f50 0x7f88cc0cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.856+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fdc088e70 con 0x7f9ff0148b80 2024-05-10T04:50:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.856+0000 7f9fe6a00700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7f9fd0072f90 0x7f9fd00753e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.856+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 --> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fd0075ab0 con 0x7f9fd0072f90 2024-05-10T04:50:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.856+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fdc08b490 con 0x7f9ff0148b80 2024-05-10T04:50:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7fde80600700 1 Processor -- start 2024-05-10T04:50:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7f88d0c00700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc0d0b70 0x7f88cc0cd900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f88c00090b0 tx=0x7f88c00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7f9fee000700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7f9fd0072f90 0x7f9fd00753e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7fde80600700 1 -- start start 2024-05-10T04:50:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7f9feea00700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9fd006ad20 0x7f9fd006d230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80012e0 tx=0x7f9fe8001aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.858+0000 7f9fee000700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7f9fd0072f90 0x7f9fd00753e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011630 con 0x7f88cc0d0b70 2024-05-10T04:50:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0011790 con 0x7f88cc0d0b70 2024-05-10T04:50:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7f88d4000700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc0c9770 con 0x7f88cc0d0b70 2024-05-10T04:50:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.857+0000 7f88d4000700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc0c9d30 con 0x7f88cc0d0b70 2024-05-10T04:50:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.858+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011b40 con 0x7f88cc0d0b70 2024-05-10T04:50:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.858+0000 7f88d4000700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88cc162c90 con 0x7f88cc0d0b70 2024-05-10T04:50:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.861+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 <== osd.6 v2:172.21.15.129:6808/44260 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9fd0075ab0 con 0x7f9fd0072f90 2024-05-10T04:50:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.861+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f88c0011ca0 con 0x7f88cc0d0b70 2024-05-10T04:50:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.862+0000 7f88c9600700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f88ac06ac90 0x7f88ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.863+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88c008b060 con 0x7f88cc0d0b70 2024-05-10T04:50:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.863+0000 7f88c9600700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7f88ac072e80 0x7f88ac0752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.863+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88ac0759a0 con 0x7f88ac072e80 2024-05-10T04:50:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.863+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88c008b3d0 con 0x7f88cc0d0b70 2024-05-10T04:50:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.864+0000 7f88d2000700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7f88ac072e80 0x7f88ac0752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.864+0000 7f88d1600700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f88ac06ac90 0x7f88ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.864+0000 7fde80600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde780b2f50 0x7fde78201f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.865+0000 7fde80600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780d0630 0x7fde7806f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.865+0000 7fde80600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.865+0000 7fde7dc00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde780b2f50 0x7fde78201f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.865+0000 7fde80600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78070840 con 0x7fde780d0630 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.866+0000 7fde7dc00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde780b2f50 0x7fde78201f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46256/0 (socket says 172.21.15.82:46256) 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.866+0000 7fde7dc00700 1 -- 172.21.15.82:0/78293541 learned_addr learned my addr 172.21.15.82:0/78293541 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.866+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78202490 con 0x7fde780b2f50 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.866+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde780aa800 con 0x7fde780d3030 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.866+0000 7fde7e600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.866+0000 7fde7d200700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780d0630 0x7fde7806f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.867+0000 7fde7dc00700 1 -- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 msgr2=0x7fde780b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.867+0000 7fde7dc00700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.867+0000 7fde7dc00700 1 -- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780d0630 msgr2=0x7fde7806f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.867+0000 7fde7dc00700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780d0630 0x7fde7806f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.867+0000 7fde7dc00700 1 -- 172.21.15.82:0/78293541 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009b30 con 0x7fde780b2f50 2024-05-10T04:50:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.867+0000 7fde7e600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde780d3030 0x7fde780b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.867+0000 7fde7d200700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde780d0630 0x7fde7806f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.865+0000 7f88d2000700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7f88ac072e80 0x7f88ac0752d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.866+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 <== osd.7 v2:172.21.15.129:6824/44261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f88ac0759a0 con 0x7f88ac072e80 2024-05-10T04:50:23.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.868+0000 7fde7dc00700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde780b2f50 0x7fde78201f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde780d1310 tx=0x7fde70004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.868+0000 7f88d1600700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f88ac06ac90 0x7f88ac06d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007fd0 tx=0x7f88b8007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.868+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e070 con 0x7fde780b2f50 2024-05-10T04:50:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.868+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde780aaae0 con 0x7fde780b2f50 2024-05-10T04:50:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.869+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70008e30 con 0x7fde780b2f50 2024-05-10T04:50:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.869+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7806dff0 con 0x7fde780b2f50 2024-05-10T04:50:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.869+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e070 con 0x7fde780b2f50 2024-05-10T04:50:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.870+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde54000fb0 con 0x7fde780b2f50 2024-05-10T04:50:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.872+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fde70009470 con 0x7fde780b2f50 2024-05-10T04:50:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.872+0000 7f8e49800700 1 -- 172.21.15.82:0/4066939372 --> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e1c002d30 con 0x7f8e24072f10 2024-05-10T04:50:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.873+0000 7f8e3be00700 1 -- 172.21.15.82:0/4066939372 <== osd.0 v2:172.21.15.82:6808/43965 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8e1c002d30 con 0x7f8e24072f10 2024-05-10T04:50:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.874+0000 7f8e39600700 1 -- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7f8e24072f10 msgr2=0x7f8e24075360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.874+0000 7f8e39600700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7f8e24072f10 0x7f8e24075360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.874+0000 7fde75600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde5806acf0 0x7fde5806d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.874+0000 7fde7d200700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde5806acf0 0x7fde5806d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.875+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde70058db0 con 0x7fde780b2f50 2024-05-10T04:50:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.875+0000 7fde75600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7fde58073b40 0x7fde58076030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7fde7d200700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde5806acf0 0x7fde5806d200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde780b8740 tx=0x7fde6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 --> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde58076700 con 0x7fde58073b40 2024-05-10T04:50:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde70058010 con 0x7fde780b2f50 2024-05-10T04:50:23.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7f8e39600700 1 -- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8e2406ad20 msgr2=0x7f8e2406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7f8e39600700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8e2406ad20 0x7f8e2406d230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e340045f0 tx=0x7f8e34008040 comp rx=0 tx=0).stop 2024-05-10T04:50:23.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7fde7e600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7fde58073b40 0x7fde58076030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7f8e39600700 1 -- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e440cc870 msgr2=0x7f8e441fba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7f8e39600700 1 --2- 172.21.15.82:0/4066939372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e440cc870 0x7f8e441fba30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000c430 tx=0x7f8e3000c740 comp rx=0 tx=0).stop 2024-05-10T04:50:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.876+0000 7f8e48e00700 1 -- 172.21.15.82:0/4066939372 reap_dead start 2024-05-10T04:50:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.877+0000 7fde7e600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7fde58073b40 0x7fde58076030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.877+0000 7f8e39600700 1 -- 172.21.15.82:0/4066939372 shutdown_connections 2024-05-10T04:50:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.877+0000 7f8e39600700 1 -- 172.21.15.82:0/4066939372 >> 172.21.15.82:0/4066939372 conn(0x7f8e440ce550 msgr2=0x7f8e440c4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.877+0000 7f8e39600700 1 -- 172.21.15.82:0/4066939372 shutdown_connections 2024-05-10T04:50:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.877+0000 7f8e39600700 1 -- 172.21.15.82:0/4066939372 wait complete. 2024-05-10T04:50:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.879+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 <== osd.4 v2:172.21.15.129:6800/44258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fde58076700 con 0x7fde58073b40 2024-05-10T04:50:23.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.882+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 --> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8b80d2b30 con 0x7fe894072f50 2024-05-10T04:50:23.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.882+0000 7fe8b4c00700 1 -- 172.21.15.82:0/1591455224 <== osd.3 v2:172.21.15.82:6816/43967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe8a8001e80 con 0x7fe894072f50 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.886+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fe894072f50 msgr2=0x7fe8940753a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.886+0000 7fe8bf400700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fe894072f50 0x7fe8940753a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.886+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe89406ad60 msgr2=0x7fe89406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.886+0000 7fe8bf400700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe89406ad60 0x7fe89406d270 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8b808cd80 tx=0x7fe8a0008040 comp rx=0 tx=0).stop 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.886+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8b80b5f10 msgr2=0x7fe8b8071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.886+0000 7fe8bf400700 1 --2- 172.21.15.82:0/1591455224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8b80b5f10 0x7fe8b8071670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80b6460 tx=0x7fe8b0004750 comp rx=0 tx=0).stop 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.886+0000 7fe8bd400700 1 -- 172.21.15.82:0/1591455224 reap_dead start 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.887+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 shutdown_connections 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.887+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 >> 172.21.15.82:0/1591455224 conn(0x7fe8b80d0a40 msgr2=0x7fe8b80cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.887+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 shutdown_connections 2024-05-10T04:50:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.888+0000 7fe8bf400700 1 -- 172.21.15.82:0/1591455224 wait complete. 2024-05-10T04:50:23.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.892+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 --> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f877c002d30 con 0x7f8784073000 2024-05-10T04:50:23.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.893+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 --> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09d0166770 con 0x7f09b0072f00 2024-05-10T04:50:23.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.893+0000 7f88d4000700 1 -- 172.21.15.82:0/2265302818 --> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88cc1629b0 con 0x7f88ac072e80 2024-05-10T04:50:23.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.893+0000 7f09c6a00700 1 -- 172.21.15.82:0/1581509138 <== osd.2 v2:172.21.15.82:6813/43970 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f09c0012b10 con 0x7f09b0072f00 2024-05-10T04:50:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f879be00700 1 -- 172.21.15.82:0/1211661817 <== osd.5 v2:172.21.15.129:6816/44259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f877c002d30 con 0x7f8784073000 2024-05-10T04:50:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7f09b0072f00 msgr2=0x7f09b0075350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f09d5600700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7f09b0072f00 0x7f09b0075350 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f8784073000 msgr2=0x7f8784075450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f87aac00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f8784073000 0x7f8784075450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f09b006ac90 msgr2=0x7f09b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f09d5600700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f09b006ac90 0x7f09b006d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09bc006fd0 tx=0x7f09bc006bc0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09d0071620 msgr2=0x7f09d014b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.894+0000 7f09d5600700 1 --2- 172.21.15.82:0/1581509138 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09d0071620 0x7f09d014b9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f09c800cb10 tx=0x7f09c800ced0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f88c9600700 1 -- 172.21.15.82:0/2265302818 <== osd.7 v2:172.21.15.129:6824/44261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f88c4009bb0 con 0x7f88ac072e80 2024-05-10T04:50:23.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f878406ad90 msgr2=0x7f878406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f87aac00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f878406ad90 0x7f878406d2a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f87a40b6400 tx=0x7f8790008030 comp rx=0 tx=0).stop 2024-05-10T04:50:23.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87a40b32b0 msgr2=0x7f87a4153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f87aac00700 1 --2- 172.21.15.82:0/1211661817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87a40b32b0 0x7f87a4153d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f879c00b9f0 tx=0x7f879c00bdb0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 --> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe270002d30 con 0x7fe278072e80 2024-05-10T04:50:23.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f87a8c00700 1 -- 172.21.15.82:0/1211661817 reap_dead start 2024-05-10T04:50:23.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f09cf400700 1 -- 172.21.15.82:0/1581509138 reap_dead start 2024-05-10T04:50:23.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 shutdown_connections 2024-05-10T04:50:23.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 >> 172.21.15.82:0/1581509138 conn(0x7f09d006b470 msgr2=0x7f09d01618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 shutdown_connections 2024-05-10T04:50:23.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 >> 172.21.15.82:0/1211661817 conn(0x7f87a40d0a40 msgr2=0x7f87a415fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f88bea00700 1 -- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7f88ac072e80 msgr2=0x7f88ac0752d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.895+0000 7f88bea00700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7f88ac072e80 0x7f88ac0752d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 shutdown_connections 2024-05-10T04:50:23.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7fe28ea00700 1 -- 172.21.15.82:0/363167120 <== osd.1 v2:172.21.15.82:6800/43969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe270002d30 con 0x7fe278072e80 2024-05-10T04:50:23.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f87aac00700 1 -- 172.21.15.82:0/1211661817 wait complete. 2024-05-10T04:50:23.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 shutdown_connections 2024-05-10T04:50:23.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f09d5600700 1 -- 172.21.15.82:0/1581509138 wait complete. 2024-05-10T04:50:23.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f88bea00700 1 -- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f88ac06ac90 msgr2=0x7f88ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f88bea00700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f88ac06ac90 0x7f88ac06d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007fd0 tx=0x7f88b8007de0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f88bea00700 1 -- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc0d0b70 msgr2=0x7f88cc0cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f88bea00700 1 --2- 172.21.15.82:0/2265302818 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f88cc0d0b70 0x7f88cc0cd900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f88c00090b0 tx=0x7f88c00047c0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7f88d2000700 1 -- 172.21.15.82:0/2265302818 reap_dead start 2024-05-10T04:50:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7fe278072e80 msgr2=0x7fe2780752d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.896+0000 7fe297e00700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7fe278072e80 0x7fe2780752d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.897+0000 7f88bea00700 1 -- 172.21.15.82:0/2265302818 shutdown_connections 2024-05-10T04:50:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.897+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe27806ac90 msgr2=0x7fe27806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.897+0000 7fe297e00700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe27806ac90 0x7fe27806d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe288000c00 tx=0x7fe288010000 comp rx=0 tx=0).stop 2024-05-10T04:50:23.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.897+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe290058720 msgr2=0x7fe2900da250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.897+0000 7fe297e00700 1 --2- 172.21.15.82:0/363167120 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe290058720 0x7fe2900da250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe2980644e0 tx=0x7fe298068750 comp rx=0 tx=0).stop 2024-05-10T04:50:23.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.897+0000 7fe297400700 1 -- 172.21.15.82:0/363167120 reap_dead start 2024-05-10T04:50:23.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.897+0000 7f88bea00700 1 -- 172.21.15.82:0/2265302818 >> 172.21.15.82:0/2265302818 conn(0x7f88cc06c3f0 msgr2=0x7f88cc161710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.898+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 --> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ff0166770 con 0x7f9fd0072f90 2024-05-10T04:50:23.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.898+0000 7f88bea00700 1 -- 172.21.15.82:0/2265302818 shutdown_connections 2024-05-10T04:50:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.898+0000 7f88bea00700 1 -- 172.21.15.82:0/2265302818 wait complete. 2024-05-10T04:50:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.898+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 shutdown_connections 2024-05-10T04:50:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.898+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 >> 172.21.15.82:0/363167120 conn(0x7fe29003ac70 msgr2=0x7fe2900e4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.898+0000 7f9fe6a00700 1 -- 172.21.15.82:0/3285920346 <== osd.6 v2:172.21.15.129:6808/44260 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9fe0011b00 con 0x7f9fd0072f90 2024-05-10T04:50:23.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.899+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 shutdown_connections 2024-05-10T04:50:23.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.899+0000 7fe297e00700 1 -- 172.21.15.82:0/363167120 wait complete. 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.900+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7f9fd0072f90 msgr2=0x7f9fd00753e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.900+0000 7f9ff5800700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7f9fd0072f90 0x7f9fd00753e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.900+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9fd006ad20 msgr2=0x7f9fd006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.900+0000 7f9ff5800700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9fd006ad20 0x7f9fd006d230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80012e0 tx=0x7f9fe8001aa0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.901+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ff0148b80 msgr2=0x7f9ff00b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.901+0000 7f9ff5800700 1 --2- 172.21.15.82:0/3285920346 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ff0148b80 0x7f9ff00b08c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00e7c0 tx=0x7f9fdc00ead0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.901+0000 7f9fef400700 1 -- 172.21.15.82:0/3285920346 reap_dead start 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.901+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 shutdown_connections 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.901+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 >> 172.21.15.82:0/3285920346 conn(0x7f9ff006b470 msgr2=0x7f9ff0160310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.902+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 shutdown_connections 2024-05-10T04:50:23.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.904+0000 7f9ff5800700 1 -- 172.21.15.82:0/3285920346 wait complete. 2024-05-10T04:50:23.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.917+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 --> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde54002d00 con 0x7fde58073b40 2024-05-10T04:50:23.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.920+0000 7fde75600700 1 -- 172.21.15.82:0/78293541 <== osd.4 v2:172.21.15.129:6800/44258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fde54002d00 con 0x7fde58073b40 2024-05-10T04:50:23.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.921+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7fde58073b40 msgr2=0x7fde58076030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.921+0000 7fde80600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7fde58073b40 0x7fde58076030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.921+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde5806acf0 msgr2=0x7fde5806d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.921+0000 7fde80600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde5806acf0 0x7fde5806d200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde780b8740 tx=0x7fde6c008040 comp rx=0 tx=0).stop 2024-05-10T04:50:23.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.921+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde780b2f50 msgr2=0x7fde78201f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.921+0000 7fde80600700 1 --2- 172.21.15.82:0/78293541 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde780b2f50 0x7fde78201f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde780d1310 tx=0x7fde70004ad0 comp rx=0 tx=0).stop 2024-05-10T04:50:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.923+0000 7fde7e600700 1 -- 172.21.15.82:0/78293541 reap_dead start 2024-05-10T04:50:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.923+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 shutdown_connections 2024-05-10T04:50:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.923+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 >> 172.21.15.82:0/78293541 conn(0x7fde7806c3f0 msgr2=0x7fde780b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.923+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 shutdown_connections 2024-05-10T04:50:23.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:23.923+0000 7fde80600700 1 -- 172.21.15.82:0/78293541 wait complete. 2024-05-10T04:50:23.939 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2024-05-10T04:50:23.939 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T04:50:23.940 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2024-05-10T04:50:23.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T04:50:23.942 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2024-05-10T04:50:23.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T04:50:23.948 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2024-05-10T04:50:23.949 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2024-05-10T04:50:23.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T04:50:23.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T04:50:23.950 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2024-05-10T04:50:23.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T04:50:23.955 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2024-05-10T04:50:23.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T04:50:23.970 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2024-05-10T04:50:23.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T04:50:24.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.408+0000 7f5e58a00700 1 Processor -- start 2024-05-10T04:50:24.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.409+0000 7f5e58a00700 1 -- start start 2024-05-10T04:50:24.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.410+0000 7f8d1ec00700 1 Processor -- start 2024-05-10T04:50:24.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.410+0000 7f8d1ec00700 1 -- start start 2024-05-10T04:50:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.412+0000 7f5e58a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5e54148b80 0x7f5e5406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.412+0000 7f5e58a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e540b3f00 0x7f5e540b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.413+0000 7f5e58a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e540cd910 con 0x7f5e54071620 2024-05-10T04:50:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.413+0000 7f5e58a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e54163e00 con 0x7f5e540b3f00 2024-05-10T04:50:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.413+0000 7f5e58a00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e54166490 con 0x7f5e54148b80 2024-05-10T04:50:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.413+0000 7f5e51400700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f5e54071620 0x7f5e54071a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:46372/0 (socket says 172.21.15.82:46372) 2024-05-10T04:50:24.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.413+0000 7f5e51400700 1 -- 172.21.15.82:0/3275128599 learned_addr learned my addr 172.21.15.82:0/3275128599 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:24.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.414+0000 7f5e52800700 1 --2- 172.21.15.82:0/3275128599 >> v2:172.21.15.82:3300/0 conn(0x7f5e540b3f00 0x7f5e540b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.414+0000 7f5e51e00700 1 --2- 172.21.15.82:0/3275128599 >> v2:172.21.15.129:3300/0 conn(0x7f5e54148b80 0x7f5e5406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.415+0000 7fdd2c400700 1 Processor -- start 2024-05-10T04:50:24.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.415+0000 7fdd2c400700 1 -- start start 2024-05-10T04:50:24.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.416+0000 7f8d1ec00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.416+0000 7f5e51e00700 1 -- 172.21.15.82:0/3275128599 >> v2:172.21.15.82:3300/0 conn(0x7f5e540b3f00 msgr2=0x7f5e540b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.416+0000 7f8d1d800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8d10037b90 0x7f8d10053b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43308/0 (socket says 172.21.15.82:43308) 2024-05-10T04:50:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.416+0000 7f8d1ec00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d10050f50 con 0x7f8d10037b90 2024-05-10T04:50:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f8d1d800700 1 -- 172.21.15.82:0/860630827 learned_addr learned my addr 172.21.15.82:0/860630827 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f8d1ce00700 1 --2- 172.21.15.82:0/860630827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f8d1ec00700 1 -- 172.21.15.82:0/860630827 --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1003a8a0 con 0x7f8d1004f390 2024-05-10T04:50:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f5e50a00700 1 -- 172.21.15.82:0/3275128599 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279763027 0 0) 0x7f5e540cd910 con 0x7f5e54071620 2024-05-10T04:50:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f8d1ec00700 1 -- 172.21.15.82:0/860630827 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d10053700 con 0x7f8d100e0970 2024-05-10T04:50:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f5e51e00700 1 --2- 172.21.15.82:0/3275128599 >> v2:172.21.15.82:3300/0 conn(0x7f5e540b3f00 0x7f5e540b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f5e51e00700 1 -- 172.21.15.82:0/3275128599 >> v1:172.21.15.129:6789/0 conn(0x7f5e54071620 legacy=0x7f5e54071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f5e51e00700 1 -- 172.21.15.82:0/3275128599 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54166770 con 0x7f5e54148b80 2024-05-10T04:50:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.417+0000 7f8d17e00700 1 -- 172.21.15.82:0/860630827 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178092703 0 0) 0x7f8d1003a8a0 con 0x7f8d1004f390 2024-05-10T04:50:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.418+0000 7f5e52800700 1 --2- 172.21.15.82:0/3275128599 >> v2:172.21.15.82:3300/0 conn(0x7f5e540b3f00 0x7f5e540b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.418+0000 7fdd2c400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdd240b2f50 0x7fdd24161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.418+0000 7fdd2c400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd240d0d40 0x7fdd240d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.418+0000 7f5e51e00700 1 --2- 172.21.15.82:0/3275128599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 0x7f5e5406eb60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e5406f7a0 tx=0x7f5e4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57afe60bdb920403 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7fdd2c400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd240d28c0 con 0x7fdd240d3030 2024-05-10T04:50:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7fdd2c400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240b3360 con 0x7fdd240d0d40 2024-05-10T04:50:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7fdd2c400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd241624e0 con 0x7fdd240b2f50 2024-05-10T04:50:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7f8d17e00700 1 -- 172.21.15.82:0/860630827 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d000035b0 con 0x7f8d1004f390 2024-05-10T04:50:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7f8d17e00700 1 -- 172.21.15.82:0/860630827 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564883006 0 0) 0x7f8d10050f50 con 0x7f8d10037b90 2024-05-10T04:50:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7f8d1ce00700 1 -- 172.21.15.82:0/860630827 >> v1:172.21.15.129:6789/0 conn(0x7f8d1004f390 legacy=0x7f8d1004f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7fdd29000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdd240d3030 0x7fdd240d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43324/0 (socket says 172.21.15.82:43324) 2024-05-10T04:50:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7fdd29000700 1 -- 172.21.15.82:0/3865934355 learned_addr learned my addr 172.21.15.82:0/3865934355 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7f8d1ce00700 1 -- 172.21.15.82:0/860630827 >> v1:172.21.15.82:6789/0 conn(0x7f8d10037b90 legacy=0x7f8d10053b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7f5e50a00700 1 -- 172.21.15.82:0/3275128599 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400e070 con 0x7f5e54148b80 2024-05-10T04:50:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.419+0000 7f5e50a00700 1 -- 172.21.15.82:0/3275128599 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4400bbd0 con 0x7f5e54148b80 2024-05-10T04:50:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.420+0000 7f5e50a00700 1 -- 172.21.15.82:0/3275128599 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44012430 con 0x7f5e54148b80 2024-05-10T04:50:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.420+0000 7f8d1ce00700 1 -- 172.21.15.82:0/860630827 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d100511a0 con 0x7f8d100e0970 2024-05-10T04:50:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.420+0000 7fdd2a400700 1 --2- 172.21.15.82:0/3865934355 >> v2:172.21.15.82:3300/0 conn(0x7fdd240d0d40 0x7fdd240d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.420+0000 7fdd29a00700 1 --2- 172.21.15.82:0/3865934355 >> v2:172.21.15.129:3300/0 conn(0x7fdd240b2f50 0x7fdd24161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.420+0000 7f8d1ce00700 1 --2- 172.21.15.82:0/860630827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100e0d80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009870 tx=0x7f8d04009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ef7ac5850cad527 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.420+0000 7fdd23e00700 1 -- 172.21.15.82:0/3865934355 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090599810 0 0) 0x7fdd240d28c0 con 0x7fdd240d3030 2024-05-10T04:50:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.420+0000 7fdd23e00700 1 -- 172.21.15.82:0/3865934355 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd0c0035b0 con 0x7fdd240d3030 2024-05-10T04:50:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7fdd2a400700 1 -- 172.21.15.82:0/3865934355 >> v2:172.21.15.129:3300/0 conn(0x7fdd240b2f50 msgr2=0x7fdd24161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7fdd2a400700 1 --2- 172.21.15.82:0/3865934355 >> v2:172.21.15.129:3300/0 conn(0x7fdd240b2f50 0x7fdd24161fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7fdd2a400700 1 -- 172.21.15.82:0/3865934355 >> v1:172.21.15.82:6789/0 conn(0x7fdd240d3030 legacy=0x7fdd240d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7fdd2a400700 1 -- 172.21.15.82:0/3865934355 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd240d2ba0 con 0x7fdd240d0d40 2024-05-10T04:50:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f5e58a00700 1 -- 172.21.15.82:0/3275128599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 msgr2=0x7f5e5406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f5e58a00700 1 --2- 172.21.15.82:0/3275128599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 0x7f5e5406eb60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e5406f7a0 tx=0x7f5e4400b330 comp rx=0 tx=0).stop 2024-05-10T04:50:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f8d17e00700 1 -- 172.21.15.82:0/860630827 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04011830 con 0x7f8d100e0970 2024-05-10T04:50:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f8d17e00700 1 -- 172.21.15.82:0/860630827 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04011990 con 0x7f8d100e0970 2024-05-10T04:50:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7fdd2a400700 1 --2- 172.21.15.82:0/3865934355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 0x7fdd240d3440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd2406d410 tx=0x7fdd1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec8524668075e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f5e58a00700 1 -- 172.21.15.82:0/3275128599 shutdown_connections 2024-05-10T04:50:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f5e58a00700 1 --2- 172.21.15.82:0/3275128599 >> v2:172.21.15.82:3300/0 conn(0x7f5e540b3f00 0x7f5e540b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f5e58a00700 1 --2- 172.21.15.82:0/3275128599 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 0x7f5e5406eb60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f5e58a00700 1 -- 172.21.15.82:0/3275128599 >> 172.21.15.82:0/3275128599 conn(0x7f5e5406b470 msgr2=0x7f5e540b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f5e58a00700 1 -- 172.21.15.82:0/3275128599 shutdown_connections 2024-05-10T04:50:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f8d17e00700 1 -- 172.21.15.82:0/860630827 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04011d20 con 0x7f8d100e0970 2024-05-10T04:50:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7fdd23e00700 1 -- 172.21.15.82:0/3865934355 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c00e070 con 0x7fdd240d0d40 2024-05-10T04:50:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7fdd23e00700 1 -- 172.21.15.82:0/3865934355 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c00bae0 con 0x7fdd240d0d40 2024-05-10T04:50:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7f5e58a00700 1 -- 172.21.15.82:0/3275128599 wait complete. 2024-05-10T04:50:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.421+0000 7fdd23e00700 1 -- 172.21.15.82:0/3865934355 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c00be90 con 0x7fdd240d0d40 2024-05-10T04:50:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.423+0000 7f8d1ec00700 1 -- 172.21.15.82:0/860630827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 msgr2=0x7f8d100e0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.423+0000 7f8d1ec00700 1 --2- 172.21.15.82:0/860630827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100e0d80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009870 tx=0x7f8d04009b80 comp rx=0 tx=0).stop 2024-05-10T04:50:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.423+0000 7fdd2c400700 1 -- 172.21.15.82:0/3865934355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 msgr2=0x7fdd240d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.423+0000 7fdd2c400700 1 --2- 172.21.15.82:0/3865934355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 0x7fdd240d3440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd2406d410 tx=0x7fdd1c00b330 comp rx=0 tx=0).stop 2024-05-10T04:50:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.424+0000 7fdd2c400700 1 -- 172.21.15.82:0/3865934355 shutdown_connections 2024-05-10T04:50:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.424+0000 7fdd2c400700 1 --2- 172.21.15.82:0/3865934355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 0x7fdd240d3440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.424+0000 7fdd2c400700 1 --2- 172.21.15.82:0/3865934355 >> v2:172.21.15.129:3300/0 conn(0x7fdd240b2f50 0x7fdd24161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.424+0000 7fdd2c400700 1 -- 172.21.15.82:0/3865934355 >> 172.21.15.82:0/3865934355 conn(0x7fdd2406c3f0 msgr2=0x7fdd2406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.425+0000 7fdd2c400700 1 -- 172.21.15.82:0/3865934355 shutdown_connections 2024-05-10T04:50:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.425+0000 7f5e58a00700 1 Processor -- start 2024-05-10T04:50:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.425+0000 7f5e58a00700 1 -- start start 2024-05-10T04:50:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.423+0000 7f8d1ec00700 1 -- 172.21.15.82:0/860630827 shutdown_connections 2024-05-10T04:50:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.423+0000 7f8d1ec00700 1 --2- 172.21.15.82:0/860630827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100e0d80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.423+0000 7f8d1ec00700 1 -- 172.21.15.82:0/860630827 >> 172.21.15.82:0/860630827 conn(0x7f8d10054d40 msgr2=0x7f8d10055150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.424+0000 7f8d1ec00700 1 -- 172.21.15.82:0/860630827 shutdown_connections 2024-05-10T04:50:24.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.424+0000 7f8d1ec00700 1 -- 172.21.15.82:0/860630827 wait complete. 2024-05-10T04:50:24.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.426+0000 7fdd2c400700 1 -- 172.21.15.82:0/3865934355 wait complete. 2024-05-10T04:50:24.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.426+0000 7fdcb1000700 1 Processor -- start 2024-05-10T04:50:24.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.426+0000 7fdcb1000700 1 -- start start 2024-05-10T04:50:24.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.427+0000 7f8d1ec00700 1 Processor -- start 2024-05-10T04:50:24.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.428+0000 7f8d1ec00700 1 -- start start 2024-05-10T04:50:24.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.428+0000 7f5e58a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e54071620 0x7f5e54145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.428+0000 7f5e58a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e540b3f00 0x7f5e5415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.428+0000 7f5e58a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 0x7f5e5415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.428+0000 7f5e58a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54203160 con 0x7f5e540b3f00 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.428+0000 7f5e58a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5415a780 con 0x7f5e54148b80 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.428+0000 7f5e58a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5415aa60 con 0x7f5e54071620 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.429+0000 7f5e51400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e540b3f00 0x7f5e5415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.429+0000 7f5e51e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e54071620 0x7f5e54145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.429+0000 7f5e51400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e540b3f00 0x7f5e5415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56148/0 (socket says 172.21.15.82:56148) 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.429+0000 7f5e51400700 1 -- 172.21.15.82:0/2074263562 learned_addr learned my addr 172.21.15.82:0/2074263562 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.429+0000 7f5e52800700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 0x7f5e5415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7f5e51e00700 1 -- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 msgr2=0x7f5e5415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.429+0000 7fdcb1000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac071d30 0x7fdcac06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.429+0000 7fdcb1000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdcac1629a0 0x7fdcac154b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fdcb1000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac15f3e0 con 0x7fdcac0cf210 2024-05-10T04:50:24.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fdcb1000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac15eab0 con 0x7fdcac1629a0 2024-05-10T04:50:24.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fdcb1000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac15ed90 con 0x7fdcac071d30 2024-05-10T04:50:24.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7f5e51e00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 0x7f5e5415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7f5e51e00700 1 -- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e540b3f00 msgr2=0x7f5e5415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fdca9e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdcac0cf210 0x7fdcac071620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43328/0 (socket says 172.21.15.82:43328) 2024-05-10T04:50:24.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fdca9e00700 1 -- 172.21.15.82:0/3533401227 learned_addr learned my addr 172.21.15.82:0/3533401227 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:24.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fdcaa800700 1 --2- 172.21.15.82:0/3533401227 >> v2:172.21.15.129:3300/0 conn(0x7fdcac1629a0 0x7fdcac154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fa724a00700 1 Processor -- start 2024-05-10T04:50:24.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479675257 0 0) 0x7fdcac15f3e0 con 0x7fdcac0cf210 2024-05-10T04:50:24.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.430+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc900035b0 con 0x7fdcac0cf210 2024-05-10T04:50:24.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.431+0000 7f57c7e00700 1 Processor -- start 2024-05-10T04:50:24.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.431+0000 7f5e51e00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e540b3f00 0x7f5e5415e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.431+0000 7f5e51e00700 1 -- 172.21.15.82:0/2074263562 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e44009a70 con 0x7f5e54071620 2024-05-10T04:50:24.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.431+0000 7fdca9400700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac071d30 0x7fdcac06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.431+0000 7f5e52800700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 0x7f5e5415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:24.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.431+0000 7f5e51400700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e540b3f00 0x7f5e5415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:24.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.431+0000 7fa724a00700 1 -- start start 2024-05-10T04:50:24.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.431+0000 7f5e51e00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e54071620 0x7f5e54145c50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e44016000 tx=0x7f5e44004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f57c7e00700 1 -- start start 2024-05-10T04:50:24.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7fdd2c400700 1 Processor -- start 2024-05-10T04:50:24.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f8d1ec00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d10037b90 0x7f8d100de480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f5e4a000700 1 -- 172.21.15.82:0/2074263562 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e44004800 con 0x7f5e54071620 2024-05-10T04:50:24.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f8d1ec00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d1004f390 0x7f8d1002d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f5e4a000700 1 -- 172.21.15.82:0/2074263562 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e44020070 con 0x7f5e54071620 2024-05-10T04:50:24.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f5e4a000700 1 -- 172.21.15.82:0/2074263562 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440276c0 con 0x7f5e54071620 2024-05-10T04:50:24.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f8d1d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d10037b90 0x7f8d100de480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7fdd2c400700 1 -- start start 2024-05-10T04:50:24.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f8d1ec00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f8d1ec00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100cac10 con 0x7f8d10037b90 2024-05-10T04:50:24.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f8d1ec00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100dcf60 con 0x7f8d1004f390 2024-05-10T04:50:24.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f8d1ec00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100dda50 con 0x7f8d100e0970 2024-05-10T04:50:24.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f8d1d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d10037b90 0x7f8d100de480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56152/0 (socket says 172.21.15.82:56152) 2024-05-10T04:50:24.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7f8d1e200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 470209727 0 0) 0x7fdc900035b0 con 0x7fdcac0cf210 2024-05-10T04:50:24.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac071d30 msgr2=0x7fdcac06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7fdca8a00700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac071d30 0x7fdcac06eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 >> v2:172.21.15.129:3300/0 conn(0x7fdcac1629a0 msgr2=0x7fdcac154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7fdca8a00700 1 --2- 172.21.15.82:0/3533401227 >> v2:172.21.15.129:3300/0 conn(0x7fdcac1629a0 0x7fdcac154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac15f070 con 0x7fdcac0cf210 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fdc9c001670 con 0x7fdcac0cf210 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 >> v1:172.21.15.82:6789/0 conn(0x7fdcac0cf210 legacy=0x7fdcac071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7fdca8a00700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc90003a00 0x7fdc90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7fdca8a00700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc90004850 0x7fdc90004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7fdca8a00700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdc900051a0 0x7fdc9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac15eab0 con 0x7fdc90004850 2024-05-10T04:50:24.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.432+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5415ad40 con 0x7f5e54071620 2024-05-10T04:50:24.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac15ed90 con 0x7fdc90003a00 2024-05-10T04:50:24.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9000bf50 con 0x7fdc900051a0 2024-05-10T04:50:24.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7fdca9e00700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc90003a00 0x7fdc90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7f8d1e200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100df7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:51662/0 (socket says 172.21.15.82:51662) 2024-05-10T04:50:24.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7f8d1e200700 1 -- 172.21.15.82:0/1446972796 learned_addr learned my addr 172.21.15.82:0/1446972796 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7f8d1ce00700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d1004f390 0x7f8d1002d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7fdca9400700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc90004850 0x7fdc90004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.433+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5415b300 con 0x7f5e54071620 2024-05-10T04:50:24.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7f8d1e200700 1 -- 172.21.15.82:0/1446972796 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d1004f390 msgr2=0x7f8d1002d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7f8d1e200700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d1004f390 0x7f8d1002d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7f8d1e200700 1 -- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d10037b90 msgr2=0x7f8d100de480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7f8d1e200700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d10037b90 0x7f8d100de480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7f8d1e200700 1 -- 172.21.15.82:0/1446972796 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d040094a0 con 0x7f8d100e0970 2024-05-10T04:50:24.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7fdca9e00700 1 -- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdc900051a0 msgr2=0x7fdc9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7fdca9e00700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdc900051a0 0x7fdc9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7fdca9e00700 1 -- 172.21.15.82:0/3533401227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc90004850 msgr2=0x7fdc90004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7f8d1d800700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d10037b90 0x7f8d100de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:24.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.434+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e540b2490 con 0x7f5e54071620 2024-05-10T04:50:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7fdca9e00700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc90004850 0x7fdc90004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7fdca9e00700 1 -- 172.21.15.82:0/3533401227 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac15f070 con 0x7fdc90003a00 2024-05-10T04:50:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.435+0000 7f8d1e200700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100df7e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c3c0 tx=0x7f8d0c001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7fa724a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa72006eb60 0x7fa7201629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7fa724a00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72015f3e0 con 0x7fa7200cf210 2024-05-10T04:50:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7fa724a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72015eab0 con 0x7fa720071d30 2024-05-10T04:50:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7fa724a00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72015ed90 con 0x7fa72006eb60 2024-05-10T04:50:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7fdca9400700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc90004850 0x7fdc90004c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7f57c7e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f57c00340e0 0x7f57c0006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7f57c7e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c00071f0 con 0x7f57c00dfdb0 2024-05-10T04:50:24.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7fa71e800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa72006eb60 0x7fa7201629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fa71e800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa72006eb60 0x7fa7201629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46330/0 (socket says 172.21.15.82:46330) 2024-05-10T04:50:24.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fa71e800700 1 -- 172.21.15.82:0/1467590630 learned_addr learned my addr 172.21.15.82:0/1467590630 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fdd2c400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd240b2f50 0x7fdd240c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fdd2c400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 0x7fdd24161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fdca9e00700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc90003a00 0x7fdc90003e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c2f0 tx=0x7fdc90005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ee1c8eb17160ee9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00ce50 con 0x7fdc90003a00 2024-05-10T04:50:24.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7f57c7e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c00074d0 con 0x7f57c00e08d0 2024-05-10T04:50:24.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.436+0000 7f57c7e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c004f600 con 0x7f57c00340e0 2024-05-10T04:50:24.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7f57c6a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f57c00340e0 0x7f57c0006ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7f57c6a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f57c00340e0 0x7f57c0006ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46344/0 (socket says 172.21.15.82:46344) 2024-05-10T04:50:24.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7f57c6a00700 1 -- 172.21.15.82:0/3377118594 learned_addr learned my addr 172.21.15.82:0/3377118594 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c005960 con 0x7fdc90003a00 2024-05-10T04:50:24.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fdca8a00700 1 -- 172.21.15.82:0/3533401227 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c005d10 con 0x7fdc90003a00 2024-05-10T04:50:24.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.437+0000 7fdd2c400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd240d3030 0x7fdd241f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fdd29a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd240b2f50 0x7fdd240c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fa71d400700 1 -- 172.21.15.82:0/1467590630 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295653091 0 0) 0x7fa72015f3e0 con 0x7fa7200cf210 2024-05-10T04:50:24.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fa71d400700 1 -- 172.21.15.82:0/1467590630 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7040035b0 con 0x7fa7200cf210 2024-05-10T04:50:24.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fdd2c400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240c8d60 con 0x7fdd240d0d40 2024-05-10T04:50:24.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fdd2c400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd241f58e0 con 0x7fdd240d3030 2024-05-10T04:50:24.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fdd2c400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240c7e90 con 0x7fdd240b2f50 2024-05-10T04:50:24.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7f57c6a00700 1 -- 172.21.15.82:0/3377118594 >> v1:172.21.15.129:6789/0 conn(0x7f57c00e08d0 legacy=0x7f57c004fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7f57c6a00700 1 -- 172.21.15.82:0/3377118594 >> v1:172.21.15.82:6789/0 conn(0x7f57c00dfdb0 legacy=0x7f57c00e01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fa71e800700 1 -- 172.21.15.82:0/1467590630 >> v1:172.21.15.129:6789/0 conn(0x7fa720071d30 legacy=0x7fa720154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fa71e800700 1 -- 172.21.15.82:0/1467590630 >> v1:172.21.15.82:6789/0 conn(0x7fa7200cf210 legacy=0x7fa720071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fdd29a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd240b2f50 0x7fdd240c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:51692/0 (socket says 172.21.15.82:51692) 2024-05-10T04:50:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fdcb1000700 1 -- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc90003a00 msgr2=0x7fdc90003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fdcb1000700 1 --2- 172.21.15.82:0/3533401227 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdc90003a00 0x7fdc90003e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c2f0 tx=0x7fdc90005880 comp rx=0 tx=0).stop 2024-05-10T04:50:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7fdcaa800700 1 -- 172.21.15.82:0/3533401227 reap_dead start 2024-05-10T04:50:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.438+0000 7f57c6a00700 1 -- 172.21.15.82:0/3377118594 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00077b0 con 0x7f57c00340e0 2024-05-10T04:50:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fdcb1000700 1 -- 172.21.15.82:0/3533401227 shutdown_connections 2024-05-10T04:50:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fdcb1000700 1 -- 172.21.15.82:0/3533401227 >> 172.21.15.82:0/3533401227 conn(0x7fdcac06b050 msgr2=0x7fdcac06b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fdd29a00700 1 -- 172.21.15.82:0/1873038844 learned_addr learned my addr 172.21.15.82:0/1873038844 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fdd29000700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 0x7fdd24161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fdd2a400700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd240d3030 0x7fdd241f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fa71e800700 1 -- 172.21.15.82:0/1467590630 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72015f070 con 0x7fa72006eb60 2024-05-10T04:50:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fa71e800700 1 --2- 172.21.15.82:0/1467590630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa72006eb60 0x7fa7201629a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa718009e50 tx=0x7fa71800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a64de12eecc0dc5d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fdcb1000700 1 -- 172.21.15.82:0/3533401227 shutdown_connections 2024-05-10T04:50:24.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7f57c6a00700 1 --2- 172.21.15.82:0/3377118594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00340e0 0x7f57c0006ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f57c806a560 tx=0x7f57c8062730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19f53f4780463d72 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.439+0000 7fdcb1000700 1 -- 172.21.15.82:0/3533401227 wait complete. 2024-05-10T04:50:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.440+0000 7f5e4a000700 1 -- 172.21.15.82:0/2074263562 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e44027820 con 0x7f5e54071620 2024-05-10T04:50:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.440+0000 7f57c5600700 1 -- 172.21.15.82:0/3377118594 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8071050 con 0x7f57c00340e0 2024-05-10T04:50:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.440+0000 7fa71d400700 1 -- 172.21.15.82:0/1467590630 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71800e070 con 0x7fa72006eb60 2024-05-10T04:50:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.440+0000 7fa71d400700 1 -- 172.21.15.82:0/1467590630 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa718003a20 con 0x7fa72006eb60 2024-05-10T04:50:24.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.440+0000 7fa71d400700 1 -- 172.21.15.82:0/1467590630 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718003dd0 con 0x7fa72006eb60 2024-05-10T04:50:24.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.440+0000 7f57c5600700 1 -- 172.21.15.82:0/3377118594 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8068880 con 0x7f57c00340e0 2024-05-10T04:50:24.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.440+0000 7f57c5600700 1 -- 172.21.15.82:0/3377118594 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c808f610 con 0x7f57c00340e0 2024-05-10T04:50:24.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7f57c7e00700 1 -- 172.21.15.82:0/3377118594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00340e0 msgr2=0x7f57c0006ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7f57c7e00700 1 --2- 172.21.15.82:0/3377118594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00340e0 0x7f57c0006ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f57c806a560 tx=0x7f57c8062730 comp rx=0 tx=0).stop 2024-05-10T04:50:24.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7f5e4a000700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406ace0 0x7f5e3406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7f5e4a000700 1 -- 172.21.15.82:0/2074263562 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e44022070 con 0x7f5e54071620 2024-05-10T04:50:24.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7f5e51400700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406ace0 0x7f5e3406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7fdd29a00700 1 -- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd240d3030 msgr2=0x7fdd241f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7fdd29a00700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd240d3030 0x7fdd241f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7fdd29a00700 1 -- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 msgr2=0x7fdd24161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7fdd2a400700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd240d3030 0x7fdd241f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7fdd29a00700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 0x7fdd24161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7fdd29a00700 1 -- 172.21.15.82:0/1873038844 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c009a70 con 0x7fdd240b2f50 2024-05-10T04:50:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7fa724a00700 1 -- 172.21.15.82:0/1467590630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa72006eb60 msgr2=0x7fa7201629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7fa724a00700 1 --2- 172.21.15.82:0/1467590630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa72006eb60 0x7fa7201629a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa718009e50 tx=0x7fa71800b330 comp rx=0 tx=0).stop 2024-05-10T04:50:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.441+0000 7fdd29000700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 0x7fdd24161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7f57c7e00700 1 -- 172.21.15.82:0/3377118594 shutdown_connections 2024-05-10T04:50:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7f57c7e00700 1 --2- 172.21.15.82:0/3377118594 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00340e0 0x7f57c0006ac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7f57c7e00700 1 -- 172.21.15.82:0/3377118594 >> 172.21.15.82:0/3377118594 conn(0x7f57c0054d10 msgr2=0x7f57c0055120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7fdd29a00700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd240b2f50 0x7fdd240c7890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800c7c0 tx=0x7fdd1800cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7f57c7e00700 1 -- 172.21.15.82:0/3377118594 shutdown_connections 2024-05-10T04:50:24.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7f57c7e00700 1 -- 172.21.15.82:0/3377118594 wait complete. 2024-05-10T04:50:24.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7fa724a00700 1 -- 172.21.15.82:0/1467590630 shutdown_connections 2024-05-10T04:50:24.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.442+0000 7fa724a00700 1 --2- 172.21.15.82:0/1467590630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa72006eb60 0x7fa7201629a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7fa724a00700 1 -- 172.21.15.82:0/1467590630 >> 172.21.15.82:0/1467590630 conn(0x7fa72006b050 msgr2=0x7fa72006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7f5e51400700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406ace0 0x7f5e3406d1f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007cd0 tx=0x7f5e40007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7fa724a00700 1 -- 172.21.15.82:0/1467590630 shutdown_connections 2024-05-10T04:50:24.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7f8d15600700 1 -- 172.21.15.82:0/1446972796 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0052d0 con 0x7f8d100e0970 2024-05-10T04:50:24.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7fdd21600700 1 -- 172.21.15.82:0/1873038844 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18004220 con 0x7fdd240b2f50 2024-05-10T04:50:24.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7f8d15600700 1 -- 172.21.15.82:0/1446972796 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c005450 con 0x7f8d100e0970 2024-05-10T04:50:24.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7f8d15600700 1 -- 172.21.15.82:0/1446972796 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0038c0 con 0x7f8d100e0970 2024-05-10T04:50:24.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7fa724a00700 1 -- 172.21.15.82:0/1467590630 wait complete. 2024-05-10T04:50:24.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.444+0000 7fdcb1000700 1 Processor -- start 2024-05-10T04:50:24.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.445+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d100dd1b0 con 0x7f8d100e0970 2024-05-10T04:50:24.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.445+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d100dd770 con 0x7f8d100e0970 2024-05-10T04:50:24.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.447+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d100532a0 con 0x7f8d100e0970 2024-05-10T04:50:24.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.445+0000 7f5e4a000700 1 -- 172.21.15.82:0/2074263562 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5e44056ec0 con 0x7f5e54071620 2024-05-10T04:50:24.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.447+0000 7fa724a00700 1 Processor -- start 2024-05-10T04:50:24.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7fdd21600700 1 -- 172.21.15.82:0/1873038844 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd18004380 con 0x7fdd240b2f50 2024-05-10T04:50:24.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.443+0000 7fdd21600700 1 -- 172.21.15.82:0/1873038844 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180036a0 con 0x7fdd240b2f50 2024-05-10T04:50:24.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.445+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd240c80e0 con 0x7fdd240b2f50 2024-05-10T04:50:24.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.445+0000 7fdcb1000700 1 -- start start 2024-05-10T04:50:24.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.447+0000 7fa724a00700 1 -- start start 2024-05-10T04:50:24.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.445+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd240c86a0 con 0x7fdd240b2f50 2024-05-10T04:50:24.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.446+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd240c8ea0 con 0x7fdd240b2f50 2024-05-10T04:50:24.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.448+0000 7fdcb1000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac0c66b0 0x7fdcac0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.448+0000 7fdcb1000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcac0b1b20 0x7fdcac14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.448+0000 7fdcb1000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcac14dc90 0x7fdcac0c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.448+0000 7fdcb1000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac1571b0 con 0x7fdcac0b1b20 2024-05-10T04:50:24.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.448+0000 7fdcb1000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac14e0a0 con 0x7fdcac14dc90 2024-05-10T04:50:24.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.448+0000 7fdcb1000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c5610 con 0x7fdcac0c66b0 2024-05-10T04:50:24.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.448+0000 7f57c7e00700 1 Processor -- start 2024-05-10T04:50:24.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.449+0000 7fdcaa800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcac14dc90 0x7fdcac0c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.449+0000 7fdcaa800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcac14dc90 0x7fdcac0c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46368/0 (socket says 172.21.15.82:46368) 2024-05-10T04:50:24.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.449+0000 7fdcaa800700 1 -- 172.21.15.82:0/4087295998 learned_addr learned my addr 172.21.15.82:0/4087295998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.450+0000 7fa724a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa72006eb60 0x7fa72014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.450+0000 7fa724a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7200cf210 0x7fa720147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.450+0000 7fdd21600700 1 -- 172.21.15.82:0/1873038844 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdd18003800 con 0x7fdd240b2f50 2024-05-10T04:50:24.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.450+0000 7fa724a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720148390 0x7fa7200b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.451+0000 7fdca9e00700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac0c66b0 0x7fdcac0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.450+0000 7fa717e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7200cf210 0x7fa720147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.451+0000 7fa717e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7200cf210 0x7fa720147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46378/0 (socket says 172.21.15.82:46378) 2024-05-10T04:50:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.451+0000 7fa724a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72014c430 con 0x7fa720148390 2024-05-10T04:50:24.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.451+0000 7fa71de00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa72006eb60 0x7fa72014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.451+0000 7fa71de00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa72006eb60 0x7fa72014de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:51708/0 (socket says 172.21.15.82:51708) 2024-05-10T04:50:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.451+0000 7fa71de00700 1 -- 172.21.15.82:0/2166150895 learned_addr learned my addr 172.21.15.82:0/2166150895 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa720148930 con 0x7fa7200cf210 2024-05-10T04:50:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fa71e800700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720148390 0x7fa7200b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa720149790 con 0x7fa72006eb60 2024-05-10T04:50:24.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fdd21600700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd0406ad60 0x7fdd0406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fdd21600700 1 -- 172.21.15.82:0/1873038844 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd18088c70 con 0x7fdd240b2f50 2024-05-10T04:50:24.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.451+0000 7f8d15600700 1 -- 172.21.15.82:0/1446972796 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d0c003a20 con 0x7f8d100e0970 2024-05-10T04:50:24.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.453+0000 7fa71de00700 1 -- 172.21.15.82:0/2166150895 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7200cf210 msgr2=0x7fa720147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.453+0000 7fdd29000700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd0406ad60 0x7fdd0406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.453+0000 7fa71de00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7200cf210 0x7fa720147e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.453+0000 7fa71de00700 1 -- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720148390 msgr2=0x7fa7200b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.451+0000 7fdca9400700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcac0b1b20 0x7fdcac14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.453+0000 7fa71de00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720148390 0x7fa7200b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fdcaa800700 1 -- 172.21.15.82:0/4087295998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac0c66b0 msgr2=0x7fdcac0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fdcaa800700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac0c66b0 0x7fdcac0b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fdcaa800700 1 -- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcac0b1b20 msgr2=0x7fdcac14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fdcaa800700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcac0b1b20 0x7fdcac14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7fdcaa800700 1 -- 172.21.15.82:0/4087295998 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0c58f0 con 0x7fdcac14dc90 2024-05-10T04:50:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.452+0000 7f57c7e00700 1 -- start start 2024-05-10T04:50:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.453+0000 7fa71de00700 1 -- 172.21.15.82:0/2166150895 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718009b30 con 0x7fa72006eb60 2024-05-10T04:50:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.454+0000 7fa71e800700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720148390 0x7fa7200b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.454+0000 7fa71de00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa72006eb60 0x7fa72014de90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa71000c530 tx=0x7fa71000c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.454+0000 7fdcaa800700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcac14dc90 0x7fdcac0c4a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdcac163070 tx=0x7fdca4009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.455+0000 7fdd29000700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd0406ad60 0x7fdd0406d270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd240cf270 tx=0x7fdd10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.455+0000 7f8d15600700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cf806ad60 0x7f8cf806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.455+0000 7fdca2000700 1 -- 172.21.15.82:0/4087295998 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4010040 con 0x7fdcac14dc90 2024-05-10T04:50:24.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.455+0000 7fdca2000700 1 -- 172.21.15.82:0/4087295998 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca400b9c0 con 0x7fdcac14dc90 2024-05-10T04:50:24.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.455+0000 7fdca2000700 1 -- 172.21.15.82:0/4087295998 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4010040 con 0x7fdcac14dc90 2024-05-10T04:50:24.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.455+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0c5bd0 con 0x7fdcac14dc90 2024-05-10T04:50:24.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.455+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac0c6190 con 0x7fdcac14dc90 2024-05-10T04:50:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.455+0000 7f8d15600700 1 -- 172.21.15.82:0/1446972796 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d0c088a80 con 0x7f8d100e0970 2024-05-10T04:50:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.456+0000 7f8d1d800700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cf806ad60 0x7f8cf806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.456+0000 7f57c7e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57c00340e0 0x7f57c00da050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.456+0000 7f57c7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c00dfdb0 0x7f57c00d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.456+0000 7f57c7e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00e08d0 0x7f57c00d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.456+0000 7f57c7e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00d5890 con 0x7f57c00dfdb0 2024-05-10T04:50:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.456+0000 7f57c7e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00dade0 con 0x7f57c00e08d0 2024-05-10T04:50:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.456+0000 7f57c7e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00db030 con 0x7f57c00340e0 2024-05-10T04:50:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.457+0000 7f57c7400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00e08d0 0x7f57c00d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.457+0000 7f57c7400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00e08d0 0x7f57c00d70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46384/0 (socket says 172.21.15.82:46384) 2024-05-10T04:50:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.457+0000 7f57c7400700 1 -- 172.21.15.82:0/2240666497 learned_addr learned my addr 172.21.15.82:0/2240666497 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.456+0000 7f8d15600700 1 -- 172.21.15.82:0/1446972796 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8d0c088e60 con 0x7f8d100e0970 2024-05-10T04:50:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.457+0000 7f8d1d800700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cf806ad60 0x7f8cf806d270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d18000eb0 tx=0x7f8d1806e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.457+0000 7f57c7400700 1 -- 172.21.15.82:0/2240666497 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57c00340e0 msgr2=0x7f57c00da050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:50:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.457+0000 7f57c7400700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57c00340e0 0x7f57c00da050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.457+0000 7f57c7400700 1 -- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c00dfdb0 msgr2=0x7f57c00d2fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T04:50:24.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.457+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac0c6500 con 0x7fdcac14dc90 2024-05-10T04:50:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.458+0000 7f57c6000700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c00dfdb0 0x7f57c00d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.458+0000 7f57c7400700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c00dfdb0 0x7f57c00d2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.458+0000 7f57c7400700 1 -- 172.21.15.82:0/2240666497 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c804f600 con 0x7f57c00e08d0 2024-05-10T04:50:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.458+0000 7f57c6000700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c00dfdb0 0x7f57c00d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.459+0000 7f57c7400700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00e08d0 0x7f57c00d70c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f57b800b410 tx=0x7f57b800b7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.459+0000 7f57bea00700 1 -- 172.21.15.82:0/2240666497 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8011830 con 0x7f57c00e08d0 2024-05-10T04:50:24.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.459+0000 7f57bea00700 1 -- 172.21.15.82:0/2240666497 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8011990 con 0x7f57c00e08d0 2024-05-10T04:50:24.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.459+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c00db310 con 0x7f57c00e08d0 2024-05-10T04:50:24.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.459+0000 7f57bea00700 1 -- 172.21.15.82:0/2240666497 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8011d40 con 0x7f57c00e08d0 2024-05-10T04:50:24.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.459+0000 7fdca2000700 1 -- 172.21.15.82:0/4087295998 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdca400bb30 con 0x7fdcac14dc90 2024-05-10T04:50:24.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.459+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c00db8d0 con 0x7f57c00e08d0 2024-05-10T04:50:24.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.460+0000 7fdd21600700 1 -- 172.21.15.82:0/1873038844 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdd240c8ea0 con 0x7fdd240b2f50 2024-05-10T04:50:24.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.462+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0005590 con 0x7f57c00e08d0 2024-05-10T04:50:24.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.461+0000 7fa716000700 1 -- 172.21.15.82:0/2166150895 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100052d0 con 0x7fa72006eb60 2024-05-10T04:50:24.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.462+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72014e3d0 con 0x7fa72006eb60 2024-05-10T04:50:24.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.462+0000 7fa716000700 1 -- 172.21.15.82:0/2166150895 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa710005450 con 0x7fa72006eb60 2024-05-10T04:50:24.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.462+0000 7fa716000700 1 -- 172.21.15.82:0/2166150895 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100038c0 con 0x7fa72006eb60 2024-05-10T04:50:24.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.462+0000 7fdca2000700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdc8806acf0 0x7fdc8806d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.463+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa720148b80 con 0x7fa72006eb60 2024-05-10T04:50:24.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.462+0000 7fdca2000700 1 -- 172.21.15.82:0/4087295998 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdca4089190 con 0x7fdcac14dc90 2024-05-10T04:50:24.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.463+0000 7f57bea00700 1 -- 172.21.15.82:0/2240666497 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f57b801a400 con 0x7f57c00e08d0 2024-05-10T04:50:24.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.463+0000 7fdca9e00700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdc8806acf0 0x7fdc8806d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.464+0000 7f57bea00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f57a406ac90 0x7f57a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.465+0000 7fdca9e00700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdc8806acf0 0x7fdc8806d200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0cf960 tx=0x7fdc9c007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.464+0000 7f57bea00700 1 -- 172.21.15.82:0/2240666497 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57b8089080 con 0x7f57c00e08d0 2024-05-10T04:50:24.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.465+0000 7f57c6a00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f57a406ac90 0x7f57a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.466+0000 7f57c6a00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f57a406ac90 0x7f57a406d1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57c000bf70 tx=0x7f57c806e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.466+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa720149900 con 0x7fa72006eb60 2024-05-10T04:50:24.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.467+0000 7fdca2000700 1 -- 172.21.15.82:0/4087295998 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdca4054400 con 0x7fdcac14dc90 2024-05-10T04:50:24.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.468+0000 7fa716000700 1 -- 172.21.15.82:0/2166150895 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa710003a20 con 0x7fa72006eb60 2024-05-10T04:50:24.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.470+0000 7fa716000700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6fc06ad60 0x7fa6fc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.470+0000 7fa716000700 1 -- 172.21.15.82:0/2166150895 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7100887d0 con 0x7fa72006eb60 2024-05-10T04:50:24.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.470+0000 7fa717e00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6fc06ad60 0x7fa6fc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.471+0000 7fa717e00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6fc06ad60 0x7fa6fc06d270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7200aef70 tx=0x7fa708009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.477+0000 7f57bea00700 1 -- 172.21.15.82:0/2240666497 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f57b80541c0 con 0x7f57c00e08d0 2024-05-10T04:50:24.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.479+0000 7fa716000700 1 -- 172.21.15.82:0/2166150895 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa710053990 con 0x7fa72006eb60 2024-05-10T04:50:24.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.498+0000 7f44ca200700 1 Processor -- start 2024-05-10T04:50:24.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.499+0000 7f44ca200700 1 -- start start 2024-05-10T04:50:24.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.502+0000 7fee7d800700 1 Processor -- start 2024-05-10T04:50:24.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.502+0000 7f44ca200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40d38d0 0x7f44c40b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.502+0000 7f44ca200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c40b7020 con 0x7f44c40d2a40 2024-05-10T04:50:24.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.502+0000 7f44ca200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c40d2f20 con 0x7f44c40d0e10 2024-05-10T04:50:24.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.502+0000 7f44ca200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40d3200 con 0x7f44c40d38d0 2024-05-10T04:50:24.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.502+0000 7f44c3400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f44c40d2a40 0x7f44c40d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43352/0 (socket says 172.21.15.82:43352) 2024-05-10T04:50:24.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.502+0000 7f44c3400700 1 -- 172.21.15.82:0/159724364 learned_addr learned my addr 172.21.15.82:0/159724364 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:24.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.503+0000 7f44c2a00700 1 --2- 172.21.15.82:0/159724364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40d38d0 0x7f44c40b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.503+0000 7f44c2a00700 1 -- 172.21.15.82:0/159724364 >> v1:172.21.15.129:6789/0 conn(0x7f44c40d0e10 legacy=0x7f44c40b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.503+0000 7f44c2a00700 1 -- 172.21.15.82:0/159724364 >> v1:172.21.15.82:6789/0 conn(0x7f44c40d2a40 legacy=0x7f44c40d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.503+0000 7f44c2000700 1 -- 172.21.15.82:0/159724364 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817140038 0 0) 0x7f44c40d2f20 con 0x7f44c40d0e10 2024-05-10T04:50:24.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.503+0000 7f44c2a00700 1 -- 172.21.15.82:0/159724364 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40d34e0 con 0x7f44c40d38d0 2024-05-10T04:50:24.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.504+0000 7f44c2a00700 1 --2- 172.21.15.82:0/159724364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40d38d0 0x7f44c40b74b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009870 tx=0x7f44b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d8365aec5065eb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.505+0000 7f44c2000700 1 -- 172.21.15.82:0/159724364 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4011830 con 0x7f44c40d38d0 2024-05-10T04:50:24.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.505+0000 7f44c2000700 1 -- 172.21.15.82:0/159724364 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4011990 con 0x7f44c40d38d0 2024-05-10T04:50:24.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.505+0000 7f44c2000700 1 -- 172.21.15.82:0/159724364 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4011d20 con 0x7f44c40d38d0 2024-05-10T04:50:24.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.503+0000 7fee7d800700 1 -- start start 2024-05-10T04:50:24.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.506+0000 7f44ca200700 1 -- 172.21.15.82:0/159724364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40d38d0 msgr2=0x7f44c40b74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.506+0000 7f44ca200700 1 --2- 172.21.15.82:0/159724364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40d38d0 0x7f44c40b74b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009870 tx=0x7f44b4009b80 comp rx=0 tx=0).stop 2024-05-10T04:50:24.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.506+0000 7f44ca200700 1 -- 172.21.15.82:0/159724364 shutdown_connections 2024-05-10T04:50:24.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.506+0000 7f44ca200700 1 --2- 172.21.15.82:0/159724364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40d38d0 0x7f44c40b74b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7f44ca200700 1 -- 172.21.15.82:0/159724364 >> 172.21.15.82:0/159724364 conn(0x7f44c406c3f0 msgr2=0x7f44c406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7fee7d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee7815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7fee7d800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fee7806f0b0 0x7fee7806f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7fee7d800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee780b45c0 con 0x7fee7806e7d0 2024-05-10T04:50:24.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7fee77400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee7815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7fee7d800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7815b360 con 0x7fee7806f0b0 2024-05-10T04:50:24.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7fee7d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7815b640 con 0x7fee7815a730 2024-05-10T04:50:24.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7fee77400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee7815ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:51726/0 (socket says 172.21.15.82:51726) 2024-05-10T04:50:24.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.507+0000 7fee77400700 1 -- 172.21.15.82:0/4205536469 learned_addr learned my addr 172.21.15.82:0/4205536469 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.508+0000 7fee7ce00700 1 --2- 172.21.15.82:0/4205536469 >> v2:172.21.15.129:3300/0 conn(0x7fee7806f0b0 0x7fee7806f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.508+0000 7f44ca200700 1 -- 172.21.15.82:0/159724364 shutdown_connections 2024-05-10T04:50:24.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.508+0000 7fee77400700 1 -- 172.21.15.82:0/4205536469 >> v2:172.21.15.129:3300/0 conn(0x7fee7806f0b0 msgr2=0x7fee7806f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.508+0000 7fee77400700 1 --2- 172.21.15.82:0/4205536469 >> v2:172.21.15.129:3300/0 conn(0x7fee7806f0b0 0x7fee7806f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.508+0000 7f44ca200700 1 -- 172.21.15.82:0/159724364 wait complete. 2024-05-10T04:50:24.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.508+0000 7fee77400700 1 -- 172.21.15.82:0/4205536469 >> v1:172.21.15.82:6789/0 conn(0x7fee7806e7d0 legacy=0x7fee780b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:24.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.509+0000 7fee77400700 1 -- 172.21.15.82:0/4205536469 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780b2900 con 0x7fee7815a730 2024-05-10T04:50:24.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.509+0000 7fee77400700 1 --2- 172.21.15.82:0/4205536469 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee7815ab40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee6400c660 tx=0x7fee6400c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69fc6a6c4d6dbc2d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.511+0000 7fee76a00700 1 -- 172.21.15.82:0/4205536469 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64004230 con 0x7fee7815a730 2024-05-10T04:50:24.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.511+0000 7fee76a00700 1 -- 172.21.15.82:0/4205536469 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee64004390 con 0x7fee7815a730 2024-05-10T04:50:24.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.511+0000 7fee76a00700 1 -- 172.21.15.82:0/4205536469 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee640036a0 con 0x7fee7815a730 2024-05-10T04:50:24.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.513+0000 7fee7d800700 1 -- 172.21.15.82:0/4205536469 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 msgr2=0x7fee7815ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.513+0000 7fee7d800700 1 --2- 172.21.15.82:0/4205536469 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee7815ab40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee6400c660 tx=0x7fee6400c970 comp rx=0 tx=0).stop 2024-05-10T04:50:24.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.513+0000 7fee7d800700 1 -- 172.21.15.82:0/4205536469 shutdown_connections 2024-05-10T04:50:24.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.513+0000 7fee7d800700 1 --2- 172.21.15.82:0/4205536469 >> v2:172.21.15.129:3300/0 conn(0x7fee7806f0b0 0x7fee7806f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.513+0000 7fee7d800700 1 --2- 172.21.15.82:0/4205536469 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee7815ab40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.513+0000 7fee7d800700 1 -- 172.21.15.82:0/4205536469 >> 172.21.15.82:0/4205536469 conn(0x7fee780cf850 msgr2=0x7fee780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.513+0000 7fee7d800700 1 -- 172.21.15.82:0/4205536469 shutdown_connections 2024-05-10T04:50:24.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.514+0000 7f44ca200700 1 Processor -- start 2024-05-10T04:50:24.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.514+0000 7fee7d800700 1 -- 172.21.15.82:0/4205536469 wait complete. 2024-05-10T04:50:24.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.518+0000 7fee7d800700 1 Processor -- start 2024-05-10T04:50:24.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.515+0000 7f44ca200700 1 -- start start 2024-05-10T04:50:24.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.518+0000 7f44ca200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44c40d0e10 0x7f44c40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.518+0000 7f44ca200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44c40d2a40 0x7f44c415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.518+0000 7f44ca200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40ca5d0 0x7f44c40ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.518+0000 7f44ca200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40ca1b0 con 0x7f44c40d2a40 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.518+0000 7f44ca200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4163a00 con 0x7f44c40d0e10 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.518+0000 7f44ca200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40c88a0 con 0x7f44c40ca5d0 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.519+0000 7f44c3400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44c40d0e10 0x7f44c40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.519+0000 7f44c3400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44c40d0e10 0x7f44c40c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:46396/0 (socket says 172.21.15.82:46396) 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.519+0000 7f44c3400700 1 -- 172.21.15.82:0/1647144548 learned_addr learned my addr 172.21.15.82:0/1647144548 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.519+0000 7f44c3e00700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40ca5d0 0x7f44c40ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.520+0000 7f44c2a00700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44c40d2a40 0x7f44c415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.519+0000 7fee7d800700 1 -- start start 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.520+0000 7f44c3400700 1 -- 172.21.15.82:0/1647144548 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40ca5d0 msgr2=0x7f44c40ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.520+0000 7f44c3400700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40ca5d0 0x7f44c40ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.520+0000 7f44c3400700 1 -- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44c40d2a40 msgr2=0x7f44c415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.520+0000 7f44c3400700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44c40d2a40 0x7f44c415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.520+0000 7f44c3400700 1 -- 172.21.15.82:0/1647144548 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40094a0 con 0x7f44c40d0e10 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.520+0000 7f44c3400700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44c40d0e10 0x7f44c40c82a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00cc20 tx=0x7f44bc00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.520+0000 7f44bb400700 1 -- 172.21.15.82:0/1647144548 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00aae0 con 0x7f44c40d0e10 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.521+0000 7f44bb400700 1 -- 172.21.15.82:0/1647144548 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc00ac40 con 0x7f44c40d0e10 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.521+0000 7f44bb400700 1 -- 172.21.15.82:0/1647144548 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc012400 con 0x7f44c40d0e10 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.521+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c415e5b0 con 0x7f44c40d0e10 2024-05-10T04:50:24.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.521+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c40c9810 con 0x7f44c40d0e10 2024-05-10T04:50:24.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.523+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c4074af0 con 0x7f44c40d0e10 2024-05-10T04:50:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.524+0000 7fee7d800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee7806e7d0 0x7fee7813dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.524+0000 7fee7d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee7806f0b0 0x7fee78143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.524+0000 7fee7d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee78144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.524+0000 7fee7d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee781452d0 con 0x7fee7806f0b0 2024-05-10T04:50:24.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.524+0000 7fee7d800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee781462a0 con 0x7fee7806e7d0 2024-05-10T04:50:24.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.524+0000 7fee7d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee78143040 con 0x7fee7815a730 2024-05-10T04:50:24.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee7ce00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee78144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee7ce00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee78144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:51736/0 (socket says 172.21.15.82:51736) 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee7ce00700 1 -- 172.21.15.82:0/1372856403 learned_addr learned my addr 172.21.15.82:0/1372856403 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee77400700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee7806f0b0 0x7fee78143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee7ce00700 1 -- 172.21.15.82:0/1372856403 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee7806e7d0 msgr2=0x7fee7813dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee7ce00700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee7806e7d0 0x7fee7813dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee7ce00700 1 -- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee7806f0b0 msgr2=0x7fee78143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee7ce00700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee7806f0b0 0x7fee78143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.525+0000 7fee7ce00700 1 -- 172.21.15.82:0/1372856403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64007e10 con 0x7fee7815a730 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.526+0000 7fee7ce00700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee78144240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fee7000efc0 tx=0x7fee7000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.526+0000 7fee6fe00700 1 -- 172.21.15.82:0/1372856403 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70009b20 con 0x7fee7815a730 2024-05-10T04:50:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.526+0000 7fee6fe00700 1 -- 172.21.15.82:0/1372856403 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000f040 con 0x7fee7815a730 2024-05-10T04:50:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.526+0000 7fee6fe00700 1 -- 172.21.15.82:0/1372856403 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70009e50 con 0x7fee7815a730 2024-05-10T04:50:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.526+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee78144850 con 0x7fee7815a730 2024-05-10T04:50:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.526+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee781457c0 con 0x7fee7815a730 2024-05-10T04:50:24.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.528+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee780b3b80 con 0x7fee7815a730 2024-05-10T04:50:24.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.529+0000 7f44bb400700 1 -- 172.21.15.82:0/1647144548 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44bc012560 con 0x7f44c40d0e10 2024-05-10T04:50:24.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.530+0000 7f44bb400700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f44a006ad90 0x7f44a006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.531+0000 7fee6fe00700 1 -- 172.21.15.82:0/1372856403 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fee70014480 con 0x7fee7815a730 2024-05-10T04:50:24.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.530+0000 7f44bb400700 1 -- 172.21.15.82:0/1647144548 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44bc088f70 con 0x7f44c40d0e10 2024-05-10T04:50:24.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.531+0000 7f44c2a00700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f44a006ad90 0x7f44a006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.532+0000 7fee6fe00700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee5806acc0 0x7fee5806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:24.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.532+0000 7fee6fe00700 1 -- 172.21.15.82:0/1372856403 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee7008a220 con 0x7fee7815a730 2024-05-10T04:50:24.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.533+0000 7f44c2a00700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f44a006ad90 0x7f44a006d2a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f44b40097c0 tx=0x7f44b4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.535+0000 7fee77e00700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee5806acc0 0x7fee5806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:24.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.535+0000 7f44bb400700 1 -- 172.21.15.82:0/1647144548 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f44bc0541e0 con 0x7f44c40d0e10 2024-05-10T04:50:24.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.538+0000 7fee6fe00700 1 -- 172.21.15.82:0/1372856403 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fee70055350 con 0x7fee7815a730 2024-05-10T04:50:24.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.538+0000 7fee77e00700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee5806acc0 0x7fee5806d1d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee68001710 tx=0x7fee68007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.902+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e5415aba0 con 0x7f5e54071620 2024-05-10T04:50:24.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.904+0000 7f5e4a000700 1 -- 172.21.15.82:0/2074263562 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e5415aba0 con 0x7f5e54071620 2024-05-10T04:50:24.904 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2024-05-10T04:50:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.908+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406ace0 msgr2=0x7f5e3406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.908+0000 7f5e58a00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406ace0 0x7f5e3406d1f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007cd0 tx=0x7f5e40007c20 comp rx=0 tx=0).stop 2024-05-10T04:50:24.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.908+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e54071620 msgr2=0x7f5e54145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.908+0000 7f5e58a00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e54071620 0x7f5e54145c50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e44016000 tx=0x7f5e44004ad0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.909+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 shutdown_connections 2024-05-10T04:50:24.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.909+0000 7f5e58a00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406ace0 0x7f5e3406d1f0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007cd0 tx=0x7f5e40007c20 comp rx=0 tx=0).stop 2024-05-10T04:50:24.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.909+0000 7f5e58a00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e54148b80 0x7f5e5415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.909+0000 7f5e58a00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e54071620 0x7f5e54145c50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.909+0000 7f5e58a00700 1 --2- 172.21.15.82:0/2074263562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e540b3f00 0x7f5e5415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.909+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 >> 172.21.15.82:0/2074263562 conn(0x7f5e5406b470 msgr2=0x7f5e54147c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.909+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 shutdown_connections 2024-05-10T04:50:24.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.909+0000 7f5e58a00700 1 -- 172.21.15.82:0/2074263562 wait complete. 2024-05-10T04:50:24.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.920+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d100055c0 con 0x7f8d100e0970 2024-05-10T04:50:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.923+0000 7f8d15600700 1 -- 172.21.15.82:0/1446972796 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d0c017090 con 0x7f8d100e0970 2024-05-10T04:50:24.927 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2024-05-10T04:50:24.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.928+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cf806ad60 msgr2=0x7f8cf806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.928+0000 7f8d1ec00700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cf806ad60 0x7f8cf806d270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d18000eb0 tx=0x7f8d1806e040 comp rx=0 tx=0).stop 2024-05-10T04:50:24.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.928+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 msgr2=0x7f8d100df7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.928+0000 7f8d1ec00700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100df7e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c3c0 tx=0x7f8d0c001e70 comp rx=0 tx=0).stop 2024-05-10T04:50:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.929+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 shutdown_connections 2024-05-10T04:50:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.929+0000 7f8d1ec00700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cf806ad60 0x7f8cf806d270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.929+0000 7f8d1ec00700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d100e0970 0x7f8d100df7e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.929+0000 7f8d1ec00700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d10037b90 0x7f8d100de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.929+0000 7f8d1ec00700 1 --2- 172.21.15.82:0/1446972796 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d1004f390 0x7f8d1002d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.929+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 >> 172.21.15.82:0/1446972796 conn(0x7f8d10054d40 msgr2=0x7f8d1004f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.930+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 shutdown_connections 2024-05-10T04:50:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.930+0000 7f8d1ec00700 1 -- 172.21.15.82:0/1446972796 wait complete. 2024-05-10T04:50:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.932+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdd240c8ea0 con 0x7fdd240b2f50 2024-05-10T04:50:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.933+0000 7fdd21600700 1 -- 172.21.15.82:0/1873038844 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd240c8ea0 con 0x7fdd240b2f50 2024-05-10T04:50:24.934 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2024-05-10T04:50:24.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.937+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd0406ad60 msgr2=0x7fdd0406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.937+0000 7fdd2c400700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd0406ad60 0x7fdd0406d270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd240cf270 tx=0x7fdd10009040 comp rx=0 tx=0).stop 2024-05-10T04:50:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.937+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd240b2f50 msgr2=0x7fdd240c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.937+0000 7fdd2c400700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd240b2f50 0x7fdd240c7890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800c7c0 tx=0x7fdd1800cad0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.938+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 shutdown_connections 2024-05-10T04:50:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.938+0000 7fdd2c400700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd0406ad60 0x7fdd0406d270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.938+0000 7fdd2c400700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd240d3030 0x7fdd241f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.938+0000 7fdd2c400700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd240b2f50 0x7fdd240c7890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.938+0000 7fdd2c400700 1 --2- 172.21.15.82:0/1873038844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd240d0d40 0x7fdd24161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.938+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 >> 172.21.15.82:0/1873038844 conn(0x7fdd2406c3f0 msgr2=0x7fdd240d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.939+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 shutdown_connections 2024-05-10T04:50:24.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.939+0000 7fdd2c400700 1 -- 172.21.15.82:0/1873038844 wait complete. 2024-05-10T04:50:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.941+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdcac074af0 con 0x7fdcac14dc90 2024-05-10T04:50:24.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.942+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f57c0053710 con 0x7f57c00e08d0 2024-05-10T04:50:24.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.942+0000 7fdca2000700 1 -- 172.21.15.82:0/4087295998 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdca4057a20 con 0x7fdcac14dc90 2024-05-10T04:50:24.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.942+0000 7f57bea00700 1 -- 172.21.15.82:0/2240666497 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57b80577e0 con 0x7f57c00e08d0 2024-05-10T04:50:24.946 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2024-05-10T04:50:24.946 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2024-05-10T04:50:24.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.947+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f57a406ac90 msgr2=0x7f57a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.947+0000 7f57c7e00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f57a406ac90 0x7f57a406d1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57c000bf70 tx=0x7f57c806e000 comp rx=0 tx=0).stop 2024-05-10T04:50:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.947+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00e08d0 msgr2=0x7f57c00d70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.947+0000 7f57c7e00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00e08d0 0x7f57c00d70c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f57b800b410 tx=0x7f57b800b7d0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.948+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 shutdown_connections 2024-05-10T04:50:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.948+0000 7f57c7e00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f57a406ac90 0x7f57a406d1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.948+0000 7f57c7e00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f57c00e08d0 0x7f57c00d70c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.948+0000 7f57c7e00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f57c00340e0 0x7f57c00da050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.948+0000 7f57c7e00700 1 --2- 172.21.15.82:0/2240666497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57c00dfdb0 0x7f57c00d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.948+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 >> 172.21.15.82:0/2240666497 conn(0x7f57c0054d10 msgr2=0x7f57c00dd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.949+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 shutdown_connections 2024-05-10T04:50:24.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.949+0000 7f57c7e00700 1 -- 172.21.15.82:0/2240666497 wait complete. 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.949+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdc8806acf0 msgr2=0x7fdc8806d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.949+0000 7fdcb1000700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdc8806acf0 0x7fdc8806d200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0cf960 tx=0x7fdc9c007000 comp rx=0 tx=0).stop 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.949+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcac14dc90 msgr2=0x7fdcac0c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.949+0000 7fdcb1000700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcac14dc90 0x7fdcac0c4a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdcac163070 tx=0x7fdca4009f50 comp rx=0 tx=0).stop 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.950+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 shutdown_connections 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.950+0000 7fdcb1000700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdc8806acf0 0x7fdc8806d200 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.950+0000 7fdcb1000700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcac14dc90 0x7fdcac0c4a30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.950+0000 7fdcb1000700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcac0c66b0 0x7fdcac0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.950+0000 7fdcb1000700 1 --2- 172.21.15.82:0/4087295998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcac0b1b20 0x7fdcac14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.950+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 >> 172.21.15.82:0/4087295998 conn(0x7fdcac06b050 msgr2=0x7fdcac15bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.951+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 shutdown_connections 2024-05-10T04:50:24.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.951+0000 7fdcb1000700 1 -- 172.21.15.82:0/4087295998 wait complete. 2024-05-10T04:50:24.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.953+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa720074af0 con 0x7fa72006eb60 2024-05-10T04:50:24.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.954+0000 7fa716000700 1 -- 172.21.15.82:0/2166150895 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa710056fb0 con 0x7fa72006eb60 2024-05-10T04:50:24.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-05-10T04:50:24.958 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2024-05-10T04:50:24.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.962+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6fc06ad60 msgr2=0x7fa6fc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.962+0000 7fa724a00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6fc06ad60 0x7fa6fc06d270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7200aef70 tx=0x7fa708009040 comp rx=0 tx=0).stop 2024-05-10T04:50:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.962+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa72006eb60 msgr2=0x7fa72014de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.962+0000 7fa724a00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa72006eb60 0x7fa72014de90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa71000c530 tx=0x7fa71000c840 comp rx=0 tx=0).stop 2024-05-10T04:50:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.963+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 shutdown_connections 2024-05-10T04:50:24.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.963+0000 7fa724a00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6fc06ad60 0x7fa6fc06d270 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.963+0000 7fa724a00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa720148390 0x7fa7200b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.963+0000 7fa724a00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa72006eb60 0x7fa72014de90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.963+0000 7fa724a00700 1 --2- 172.21.15.82:0/2166150895 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa7200cf210 0x7fa720147e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.963+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 >> 172.21.15.82:0/2166150895 conn(0x7fa72006b050 msgr2=0x7fa7200ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.963+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 shutdown_connections 2024-05-10T04:50:24.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.963+0000 7fa724a00700 1 -- 172.21.15.82:0/2166150895 wait complete. 2024-05-10T04:50:24.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-05-10T04:50:24.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.982+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f44c40ce7f0 con 0x7f44c40d0e10 2024-05-10T04:50:24.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.983+0000 7f44bb400700 1 -- 172.21.15.82:0/1647144548 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44bc057800 con 0x7f44c40d0e10 2024-05-10T04:50:24.984 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2024-05-10T04:50:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f44a006ad90 msgr2=0x7f44a006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f44a006ad90 0x7f44a006d2a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f44b40097c0 tx=0x7f44b4008030 comp rx=0 tx=0).stop 2024-05-10T04:50:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44c40d0e10 msgr2=0x7f44c40c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44c40d0e10 0x7f44c40c82a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00cc20 tx=0x7f44bc00a060 comp rx=0 tx=0).stop 2024-05-10T04:50:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 shutdown_connections 2024-05-10T04:50:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f44a006ad90 0x7f44a006d2a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f44c40ca5d0 0x7f44c40ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f44c40d0e10 0x7f44c40c82a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 --2- 172.21.15.82:0/1647144548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44c40d2a40 0x7f44c415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 >> 172.21.15.82:0/1647144548 conn(0x7f44c406c3f0 msgr2=0x7f44c40b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.986+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 shutdown_connections 2024-05-10T04:50:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.987+0000 7f44ca200700 1 -- 172.21.15.82:0/1647144548 wait complete. 2024-05-10T04:50:24.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-05-10T04:50:24.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.992+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fee78074af0 con 0x7fee7815a730 2024-05-10T04:50:24.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.992+0000 7fee6fe00700 1 -- 172.21.15.82:0/1372856403 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee70018020 con 0x7fee7815a730 2024-05-10T04:50:24.993 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2024-05-10T04:50:24.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee5806acc0 msgr2=0x7fee5806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee5806acc0 0x7fee5806d1d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee68001710 tx=0x7fee68007a40 comp rx=0 tx=0).stop 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 msgr2=0x7fee78144240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee78144240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fee7000efc0 tx=0x7fee7000c3a0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 shutdown_connections 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee5806acc0 0x7fee5806d1d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee7815a730 0x7fee78144240 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee7806e7d0 0x7fee7813dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 --2- 172.21.15.82:0/1372856403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee7806f0b0 0x7fee78143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 >> 172.21.15.82:0/1372856403 conn(0x7fee780cf850 msgr2=0x7fee780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:24.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 shutdown_connections 2024-05-10T04:50:24.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:24.996+0000 7fee7d800700 1 -- 172.21.15.82:0/1372856403 wait complete. 2024-05-10T04:50:24.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-05-10T04:50:25.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-05-10T04:50:25.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-05-10T04:50:25.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-05-10T04:50:25.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T04:50:25.977 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T04:50:25.991 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T04:50:25.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T04:50:25.999 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T04:50:26.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T04:50:26.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T04:50:26.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T04:50:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.394+0000 7fc9c6600700 1 Processor -- start 2024-05-10T04:50:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.394+0000 7fc9c6600700 1 -- start start 2024-05-10T04:50:26.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.398+0000 7fc9c6600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc9b8058bb0 0x7fc9b805c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.398+0000 7fc9c6600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b8041390 0x7fc9b80417a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.398+0000 7fc9c6600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b805cc30 con 0x7fc9b803c860 2024-05-10T04:50:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.398+0000 7fc9c6600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b803cc70 con 0x7fc9b8058bb0 2024-05-10T04:50:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.398+0000 7fc9c6600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80e83e0 con 0x7fc9b8041390 2024-05-10T04:50:26.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.399+0000 7fc9bf400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc9b803c860 0x7fc9b80584a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36606/0 (socket says 172.21.15.82:36606) 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.399+0000 7fc9bf400700 1 -- 172.21.15.82:0/3225138415 learned_addr learned my addr 172.21.15.82:0/3225138415 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.400+0000 7fc9bea00700 1 --2- 172.21.15.82:0/3225138415 >> v2:172.21.15.129:3300/0 conn(0x7fc9b8058bb0 0x7fc9b805c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.400+0000 7fc9bfe00700 1 --2- 172.21.15.82:0/3225138415 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b8041390 0x7fc9b80417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.400+0000 7fc9be000700 1 -- 172.21.15.82:0/3225138415 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304026713 0 0) 0x7fc9b805cc30 con 0x7fc9b803c860 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.400+0000 7fc9be000700 1 -- 172.21.15.82:0/3225138415 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a80035b0 con 0x7fc9b803c860 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.400+0000 7fc9bfe00700 1 -- 172.21.15.82:0/3225138415 >> v2:172.21.15.129:3300/0 conn(0x7fc9b8058bb0 msgr2=0x7fc9b805c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.400+0000 7fc9bfe00700 1 --2- 172.21.15.82:0/3225138415 >> v2:172.21.15.129:3300/0 conn(0x7fc9b8058bb0 0x7fc9b805c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.400+0000 7fc9bfe00700 1 -- 172.21.15.82:0/3225138415 >> v1:172.21.15.82:6789/0 conn(0x7fc9b803c860 legacy=0x7fc9b80584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.400+0000 7fc9bfe00700 1 -- 172.21.15.82:0/3225138415 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b805cf10 con 0x7fc9b8041390 2024-05-10T04:50:26.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.402+0000 7fc9bfe00700 1 --2- 172.21.15.82:0/3225138415 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b8041390 0x7fc9b80417a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0069bf0 tx=0x7fc9c0062770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a1e38fd83e794d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.406+0000 7fc9be000700 1 -- 172.21.15.82:0/3225138415 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0068880 con 0x7fc9b8041390 2024-05-10T04:50:26.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.406+0000 7fc9be000700 1 -- 172.21.15.82:0/3225138415 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0073280 con 0x7fc9b8041390 2024-05-10T04:50:26.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.406+0000 7fc9be000700 1 -- 172.21.15.82:0/3225138415 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0092620 con 0x7fc9b8041390 2024-05-10T04:50:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.407+0000 7fc9c6600700 1 -- 172.21.15.82:0/3225138415 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b8041390 msgr2=0x7fc9b80417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.407+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3225138415 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b8041390 0x7fc9b80417a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0069bf0 tx=0x7fc9c0062770 comp rx=0 tx=0).stop 2024-05-10T04:50:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.408+0000 7fc9c6600700 1 -- 172.21.15.82:0/3225138415 shutdown_connections 2024-05-10T04:50:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.408+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3225138415 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b8041390 0x7fc9b80417a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.408+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3225138415 >> v2:172.21.15.129:3300/0 conn(0x7fc9b8058bb0 0x7fc9b805c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.408+0000 7fc9c6600700 1 -- 172.21.15.82:0/3225138415 >> 172.21.15.82:0/3225138415 conn(0x7fc9b8059fe0 msgr2=0x7fc9b805a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.408+0000 7fc9c6600700 1 -- 172.21.15.82:0/3225138415 shutdown_connections 2024-05-10T04:50:26.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.408+0000 7fc9c6600700 1 -- 172.21.15.82:0/3225138415 wait complete. 2024-05-10T04:50:26.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.413+0000 7fc9c6600700 1 Processor -- start 2024-05-10T04:50:26.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.413+0000 7fc9c6600700 1 -- start start 2024-05-10T04:50:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.417+0000 7fc9c6600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b803c860 0x7fc9b80e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.417+0000 7fc9c6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b8041390 0x7fc9b8056010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.418+0000 7fc9bf400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b803c860 0x7fc9b80e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.418+0000 7fc9bf400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b803c860 0x7fc9b80e3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:58868/0 (socket says 172.21.15.82:58868) 2024-05-10T04:50:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.418+0000 7fc9c6600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9b81720a0 0x7fc9b8056550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.418+0000 7fc9bf400700 1 -- 172.21.15.82:0/3459981154 learned_addr learned my addr 172.21.15.82:0/3459981154 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.418+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80ea500 con 0x7fc9b8041390 2024-05-10T04:50:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.419+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8186270 con 0x7fc9b81720a0 2024-05-10T04:50:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.419+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8170620 con 0x7fc9b803c860 2024-05-10T04:50:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.419+0000 7fc9bea00700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b8041390 0x7fc9b8056010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.421+0000 7fc9bf400700 1 -- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9b81720a0 msgr2=0x7fc9b8056550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.422+0000 7fc9bfe00700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9b81720a0 0x7fc9b8056550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.422+0000 7fc9bf400700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9b81720a0 0x7fc9b8056550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.422+0000 7fc9bf400700 1 -- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b8041390 msgr2=0x7fc9b8056010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.422+0000 7fc9bf400700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b8041390 0x7fc9b8056010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.422+0000 7fc9bf400700 1 -- 172.21.15.82:0/3459981154 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0073ea0 con 0x7fc9b803c860 2024-05-10T04:50:26.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.422+0000 7fc9bea00700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b8041390 0x7fc9b8056010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:26.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.422+0000 7fc9bfe00700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9b81720a0 0x7fc9b8056550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:26.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.422+0000 7fc9bf400700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b803c860 0x7fc9b80e3a20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005910 tx=0x7fc9ac00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.423+0000 7fc9b3400700 1 -- 172.21.15.82:0/3459981154 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac005d70 con 0x7fc9b803c860 2024-05-10T04:50:26.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.423+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b80e8ff0 con 0x7fc9b803c860 2024-05-10T04:50:26.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.423+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b80e89a0 con 0x7fc9b803c860 2024-05-10T04:50:26.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.424+0000 7fc9b3400700 1 -- 172.21.15.82:0/3459981154 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac0070d0 con 0x7fc9b803c860 2024-05-10T04:50:26.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.424+0000 7fc9b3400700 1 -- 172.21.15.82:0/3459981154 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac005d70 con 0x7fc9b803c860 2024-05-10T04:50:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.430+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b80e9180 con 0x7fc9b803c860 2024-05-10T04:50:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.431+0000 7fc9b3400700 1 -- 172.21.15.82:0/3459981154 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc9ac007240 con 0x7fc9b803c860 2024-05-10T04:50:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.433+0000 7fc9b3400700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc9a006acf0 0x7fc9a006d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.433+0000 7fc9b3400700 1 -- 172.21.15.82:0/3459981154 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9ac0881c0 con 0x7fc9b803c860 2024-05-10T04:50:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.434+0000 7fc9bea00700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc9a006acf0 0x7fc9a006d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.435+0000 7fc9bea00700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc9a006acf0 0x7fc9a006d200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8172030 tx=0x7fc9b4009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.438+0000 7fc9b3400700 1 -- 172.21.15.82:0/3459981154 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc9ac0534e0 con 0x7fc9b803c860 2024-05-10T04:50:26.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.467+0000 7fe5d5400700 1 Processor -- start 2024-05-10T04:50:26.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.468+0000 7fe5d5400700 1 -- start start 2024-05-10T04:50:26.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.472+0000 7fe5d5400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe5d00af010 0x7fe5d006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.472+0000 7fe5d5400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe5d0071d30 0x7fe5d00b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.472+0000 7fe5d5400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d015e800 con 0x7fe5d015a4f0 2024-05-10T04:50:26.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.473+0000 7fe5d5400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d015dfa0 con 0x7fe5d00af010 2024-05-10T04:50:26.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.473+0000 7fe5d5400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d006f330 con 0x7fe5d0071d30 2024-05-10T04:50:26.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.473+0000 7fe5cde00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe5d015a4f0 0x7fe5d0071620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36612/0 (socket says 172.21.15.82:36612) 2024-05-10T04:50:26.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.473+0000 7fe5cde00700 1 -- 172.21.15.82:0/3175853234 learned_addr learned my addr 172.21.15.82:0/3175853234 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:26.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.474+0000 7fe5cf200700 1 --2- 172.21.15.82:0/3175853234 >> v2:172.21.15.129:3300/0 conn(0x7fe5d0071d30 0x7fe5d00b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.474+0000 7fe5ce800700 1 --2- 172.21.15.82:0/3175853234 >> v2:172.21.15.82:3300/0 conn(0x7fe5d00af010 0x7fe5d006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.475+0000 7fe5cd400700 1 -- 172.21.15.82:0/3175853234 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054647584 0 0) 0x7fe5d015e800 con 0x7fe5d015a4f0 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.475+0000 7fe5cd400700 1 -- 172.21.15.82:0/3175853234 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b40057c0 con 0x7fe5d015a4f0 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.475+0000 7fe5cf200700 1 -- 172.21.15.82:0/3175853234 >> v2:172.21.15.82:3300/0 conn(0x7fe5d00af010 msgr2=0x7fe5d006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.475+0000 7fe5cd400700 1 -- 172.21.15.82:0/3175853234 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433631355 0 0) 0x7fe5b40057c0 con 0x7fe5d015a4f0 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.475+0000 7fe5cf200700 1 --2- 172.21.15.82:0/3175853234 >> v2:172.21.15.82:3300/0 conn(0x7fe5d00af010 0x7fe5d006eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.475+0000 7fe5cf200700 1 -- 172.21.15.82:0/3175853234 >> v1:172.21.15.82:6789/0 conn(0x7fe5d015a4f0 legacy=0x7fe5d0071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.475+0000 7fe5cf200700 1 -- 172.21.15.82:0/3175853234 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d015e1b0 con 0x7fe5d0071d30 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.476+0000 7fe5ce800700 1 --2- 172.21.15.82:0/3175853234 >> v2:172.21.15.82:3300/0 conn(0x7fe5d00af010 0x7fe5d006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.476+0000 7fe5cf200700 1 --2- 172.21.15.82:0/3175853234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0071d30 0x7fe5d00b4020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00cc0f0 tx=0x7fe5c8009df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b87528654595e54 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.477+0000 7fe5cd400700 1 -- 172.21.15.82:0/3175853234 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0001650 con 0x7fe5d0071d30 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.477+0000 7fe5cd400700 1 -- 172.21.15.82:0/3175853234 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c8003a20 con 0x7fe5d0071d30 2024-05-10T04:50:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.477+0000 7fe5cd400700 1 -- 172.21.15.82:0/3175853234 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8003db0 con 0x7fe5d0071d30 2024-05-10T04:50:26.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.478+0000 7fe5d5400700 1 -- 172.21.15.82:0/3175853234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0071d30 msgr2=0x7fe5d00b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.478+0000 7fe5d5400700 1 --2- 172.21.15.82:0/3175853234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0071d30 0x7fe5d00b4020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00cc0f0 tx=0x7fe5c8009df0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.478+0000 7fe952e00700 1 Processor -- start 2024-05-10T04:50:26.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.478+0000 7fe5d5400700 1 -- 172.21.15.82:0/3175853234 shutdown_connections 2024-05-10T04:50:26.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.478+0000 7fe5d5400700 1 --2- 172.21.15.82:0/3175853234 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0071d30 0x7fe5d00b4020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.478+0000 7fe5d5400700 1 --2- 172.21.15.82:0/3175853234 >> v2:172.21.15.82:3300/0 conn(0x7fe5d00af010 0x7fe5d006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.478+0000 7fe5d5400700 1 -- 172.21.15.82:0/3175853234 >> 172.21.15.82:0/3175853234 conn(0x7fe5d006b050 msgr2=0x7fe5d006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.478+0000 7f7109a00700 1 Processor -- start 2024-05-10T04:50:26.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.479+0000 7fe952e00700 1 -- start start 2024-05-10T04:50:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.479+0000 7f7109a00700 1 -- start start 2024-05-10T04:50:26.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.481+0000 7fe952e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944059060 0x7fe94403efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.482+0000 7fe952e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe94405c510 0x7fe94403f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.479+0000 7fe5d5400700 1 -- 172.21.15.82:0/3175853234 shutdown_connections 2024-05-10T04:50:26.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.481+0000 7f7109a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71040b2f50 0x7f7104161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.481+0000 7f7109a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d3030 0x7f71040d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.479+0000 7fe5d5400700 1 -- 172.21.15.82:0/3175853234 wait complete. 2024-05-10T04:50:26.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.482+0000 7fe952e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe944040e80 con 0x7fe944043240 2024-05-10T04:50:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.482+0000 7fe952e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe944040be0 con 0x7fe94405c510 2024-05-10T04:50:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7f7109a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71040d28c0 con 0x7f71040d0630 2024-05-10T04:50:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7fe5d5400700 1 Processor -- start 2024-05-10T04:50:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.482+0000 7fe952e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe944059de0 con 0x7fe944059060 2024-05-10T04:50:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7f7109a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71040b3360 con 0x7f71040b2f50 2024-05-10T04:50:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7f7103400700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f71040d0630 0x7f71040d0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:37880/0 (socket says 172.21.15.82:37880) 2024-05-10T04:50:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7f7103400700 1 -- 172.21.15.82:0/2990604048 learned_addr learned my addr 172.21.15.82:0/2990604048 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7fe5d5400700 1 -- start start 2024-05-10T04:50:26.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7fe951a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944059060 0x7fe94403efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.484+0000 7fd91a400700 1 Processor -- start 2024-05-10T04:50:26.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.484+0000 7f7102a00700 1 --2- 172.21.15.82:0/2990604048 >> v2:172.21.15.82:3300/0 conn(0x7f71040b2f50 0x7f7104161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.484+0000 7fd91a400700 1 -- start start 2024-05-10T04:50:26.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7fe951000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe94405c510 0x7fe94403f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.484+0000 7fe951000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe94405c510 0x7fe94403f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:49730/0 (socket says 172.21.15.82:49730) 2024-05-10T04:50:26.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.484+0000 7fe951000700 1 -- 172.21.15.82:0/233070197 learned_addr learned my addr 172.21.15.82:0/233070197 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.483+0000 7fe952400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe944043240 0x7fe944057b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36626/0 (socket says 172.21.15.82:36626) 2024-05-10T04:50:26.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.484+0000 7f7102000700 1 -- 172.21.15.82:0/2990604048 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606538312 0 0) 0x7f71040d28c0 con 0x7f71040d0630 2024-05-10T04:50:26.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.484+0000 7f7109a00700 1 -- 172.21.15.82:0/2990604048 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71041624e0 con 0x7f71040d3030 2024-05-10T04:50:26.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.485+0000 7fe951a00700 1 -- 172.21.15.82:0/233070197 >> v2:172.21.15.129:3300/0 conn(0x7fe94405c510 msgr2=0x7fe94403f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:26.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.485+0000 7fe951a00700 1 --2- 172.21.15.82:0/233070197 >> v2:172.21.15.129:3300/0 conn(0x7fe94405c510 0x7fe94403f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.485+0000 7fe951a00700 1 -- 172.21.15.82:0/233070197 >> v1:172.21.15.82:6789/0 conn(0x7fe944043240 legacy=0x7fe944057b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.485+0000 7f7102000700 1 -- 172.21.15.82:0/2990604048 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e80035b0 con 0x7f71040d0630 2024-05-10T04:50:26.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.485+0000 7fe951a00700 1 -- 172.21.15.82:0/233070197 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944059540 con 0x7fe944059060 2024-05-10T04:50:26.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.485+0000 7fe951a00700 1 --2- 172.21.15.82:0/233070197 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944059060 0x7fe94403efb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe940009840 tx=0x7fe940009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d031ffc7c45d3e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7fe94be00700 1 -- 172.21.15.82:0/233070197 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940011830 con 0x7fe944059060 2024-05-10T04:50:26.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7f7102a00700 1 -- 172.21.15.82:0/2990604048 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d3030 msgr2=0x7f71040d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:26.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7f70fa000700 1 --2- 172.21.15.82:0/2990604048 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d3030 0x7f71040d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7fe94be00700 1 -- 172.21.15.82:0/233070197 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe940011990 con 0x7fe944059060 2024-05-10T04:50:26.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7fe94be00700 1 -- 172.21.15.82:0/233070197 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940011d20 con 0x7fe944059060 2024-05-10T04:50:26.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7f7102a00700 1 --2- 172.21.15.82:0/2990604048 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d3030 0x7f71040d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7f7102a00700 1 -- 172.21.15.82:0/2990604048 >> v1:172.21.15.129:6789/0 conn(0x7f71040d0630 legacy=0x7f71040d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7f7102a00700 1 -- 172.21.15.82:0/2990604048 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040d2ba0 con 0x7f71040b2f50 2024-05-10T04:50:26.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.486+0000 7f70fa000700 1 --2- 172.21.15.82:0/2990604048 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d3030 0x7f71040d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.487+0000 7fe5d5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5d00af010 0x7fe5d01ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.487+0000 7fe5d5400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5d015a4f0 0x7fe5d015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.487+0000 7fe5d5400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0154210 0x7fe5d0154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.487+0000 7fe952e00700 1 -- 172.21.15.82:0/233070197 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944059060 msgr2=0x7fe94403efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.487+0000 7fe952e00700 1 --2- 172.21.15.82:0/233070197 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944059060 0x7fe94403efb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe940009840 tx=0x7fe940009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.487+0000 7fe5d5400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0150660 con 0x7fe5d00af010 2024-05-10T04:50:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.487+0000 7f7102a00700 1 --2- 172.21.15.82:0/2990604048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 0x7f7104161fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009840 tx=0x7f70ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4299fa8f0bbae540 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fe5d5400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d01568a0 con 0x7fe5d0154210 2024-05-10T04:50:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fe5cde00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5d015a4f0 0x7fe5d015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fe5cde00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5d015a4f0 0x7fe5d015d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:58892/0 (socket says 172.21.15.82:58892) 2024-05-10T04:50:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fe5cde00700 1 -- 172.21.15.82:0/2429523767 learned_addr learned my addr 172.21.15.82:0/2429523767 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7f7102000700 1 -- 172.21.15.82:0/2990604048 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011830 con 0x7f71040b2f50 2024-05-10T04:50:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fe5cf200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0154210 0x7fe5d0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0156ae0 con 0x7fe5d015a4f0 2024-05-10T04:50:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fe5ce800700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5d00af010 0x7fe5d01ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7f7102000700 1 -- 172.21.15.82:0/2990604048 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec011990 con 0x7f71040b2f50 2024-05-10T04:50:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fd91a400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd91415cda0 0x7fd91406b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fd91a400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914166850 0x7fd914166c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fd91a400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd914163bb0 con 0x7fd914162b50 2024-05-10T04:50:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fd91a400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd914166430 con 0x7fd91415cda0 2024-05-10T04:50:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fd91a400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141671a0 con 0x7fd914166850 2024-05-10T04:50:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fd919a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914166850 0x7fd914166c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7f7102000700 1 -- 172.21.15.82:0/2990604048 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011d20 con 0x7f71040b2f50 2024-05-10T04:50:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.488+0000 7fd919a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914166850 0x7fd914166c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:58894/0 (socket says 172.21.15.82:58894) 2024-05-10T04:50:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7fd919a00700 1 -- 172.21.15.82:0/624849810 learned_addr learned my addr 172.21.15.82:0/624849810 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7fd919a00700 1 -- 172.21.15.82:0/624849810 >> v2:172.21.15.129:3300/0 conn(0x7fd91415cda0 msgr2=0x7fd91406b230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:50:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7fd919a00700 1 --2- 172.21.15.82:0/624849810 >> v2:172.21.15.129:3300/0 conn(0x7fd91415cda0 0x7fd91406b230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7fd919a00700 1 -- 172.21.15.82:0/624849810 >> v1:172.21.15.129:6789/0 conn(0x7fd914162b50 legacy=0x7fd9140bb110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:50:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7fe952e00700 1 -- 172.21.15.82:0/233070197 shutdown_connections 2024-05-10T04:50:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7fe952e00700 1 --2- 172.21.15.82:0/233070197 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944059060 0x7fe94403efb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7fe952e00700 1 --2- 172.21.15.82:0/233070197 >> v2:172.21.15.129:3300/0 conn(0x7fe94405c510 0x7fe94403f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7fe952e00700 1 -- 172.21.15.82:0/233070197 >> 172.21.15.82:0/233070197 conn(0x7fe944059fb0 msgr2=0x7fe94405a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fd919a00700 1 -- 172.21.15.82:0/624849810 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91406b770 con 0x7fd914166850 2024-05-10T04:50:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fe5ce800700 1 -- 172.21.15.82:0/2429523767 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5d015a4f0 msgr2=0x7fe5d015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fe5ce800700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5d015a4f0 0x7fe5d015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fe5ce800700 1 -- 172.21.15.82:0/2429523767 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0154210 msgr2=0x7fe5d0154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fe5ce800700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0154210 0x7fe5d0154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fe5ce800700 1 -- 172.21.15.82:0/2429523767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8009770 con 0x7fe5d00af010 2024-05-10T04:50:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fe952e00700 1 -- 172.21.15.82:0/233070197 shutdown_connections 2024-05-10T04:50:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fe952e00700 1 -- 172.21.15.82:0/233070197 wait complete. 2024-05-10T04:50:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7f7109a00700 1 -- 172.21.15.82:0/2990604048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 msgr2=0x7f7104161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.489+0000 7f7109a00700 1 --2- 172.21.15.82:0/2990604048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 0x7f7104161fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009840 tx=0x7f70ec009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7f7109a00700 1 -- 172.21.15.82:0/2990604048 shutdown_connections 2024-05-10T04:50:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7f7109a00700 1 --2- 172.21.15.82:0/2990604048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 0x7f7104161fa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fd919a00700 1 --2- 172.21.15.82:0/624849810 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914166850 0x7fd914166c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd9000098f0 tx=0x7fd900009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d593579b226f0f5e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7fe5ce800700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5d00af010 0x7fe5d01ef4a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800e830 tx=0x7fe5b800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7f7109a00700 1 --2- 172.21.15.82:0/2990604048 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d3030 0x7f71040d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7f7109a00700 1 -- 172.21.15.82:0/2990604048 >> 172.21.15.82:0/2990604048 conn(0x7f710406c3f0 msgr2=0x7f710406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.490+0000 7f7109a00700 1 -- 172.21.15.82:0/2990604048 shutdown_connections 2024-05-10T04:50:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.491+0000 7f7109a00700 1 -- 172.21.15.82:0/2990604048 wait complete. 2024-05-10T04:50:26.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.491+0000 7fe5c6a00700 1 -- 172.21.15.82:0/2429523767 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8013610 con 0x7fe5d00af010 2024-05-10T04:50:26.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.491+0000 7fd913400700 1 -- 172.21.15.82:0/624849810 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900004230 con 0x7fd914166850 2024-05-10T04:50:26.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.491+0000 7fd913400700 1 -- 172.21.15.82:0/624849810 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900004390 con 0x7fd914166850 2024-05-10T04:50:26.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.491+0000 7fd913400700 1 -- 172.21.15.82:0/624849810 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9000036a0 con 0x7fd914166850 2024-05-10T04:50:26.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.491+0000 7fe5c6a00700 1 -- 172.21.15.82:0/2429523767 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8013770 con 0x7fe5d00af010 2024-05-10T04:50:26.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.491+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d01ef9e0 con 0x7fe5d00af010 2024-05-10T04:50:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.492+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d0156d30 con 0x7fe5d00af010 2024-05-10T04:50:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.492+0000 7fd91a400700 1 -- 172.21.15.82:0/624849810 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914166850 msgr2=0x7fd914166c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.492+0000 7fd91a400700 1 --2- 172.21.15.82:0/624849810 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914166850 0x7fd914166c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd9000098f0 tx=0x7fd900009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:26.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.493+0000 7fd91a400700 1 -- 172.21.15.82:0/624849810 shutdown_connections 2024-05-10T04:50:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.493+0000 7fd91a400700 1 --2- 172.21.15.82:0/624849810 >> v2:172.21.15.129:3300/0 conn(0x7fd91415cda0 0x7fd91406b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.493+0000 7fd91a400700 1 --2- 172.21.15.82:0/624849810 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914166850 0x7fd914166c60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.493+0000 7fd91a400700 1 -- 172.21.15.82:0/624849810 >> 172.21.15.82:0/624849810 conn(0x7fd9140b9ff0 msgr2=0x7fd9140ba430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.493+0000 7fd91a400700 1 -- 172.21.15.82:0/624849810 shutdown_connections 2024-05-10T04:50:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.493+0000 7fe5c6a00700 1 -- 172.21.15.82:0/2429523767 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8013b00 con 0x7fe5d00af010 2024-05-10T04:50:26.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.494+0000 7fe952e00700 1 Processor -- start 2024-05-10T04:50:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.495+0000 7f7109a00700 1 Processor -- start 2024-05-10T04:50:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.494+0000 7fe952e00700 1 -- start start 2024-05-10T04:50:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.496+0000 7fe952e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944043240 0x7fe9440d8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe952e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe944059060 0x7fe9440e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe952e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe94405c510 0x7fe9440568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe952e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe944055f90 con 0x7fe944059060 2024-05-10T04:50:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe952e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440e2ef0 con 0x7fe94405c510 2024-05-10T04:50:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe952e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440e39e0 con 0x7fe944043240 2024-05-10T04:50:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.494+0000 7fd91a400700 1 -- 172.21.15.82:0/624849810 wait complete. 2024-05-10T04:50:26.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe5c6a00700 1 -- 172.21.15.82:0/2429523767 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe5b8013c60 con 0x7fe5d00af010 2024-05-10T04:50:26.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe951a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944043240 0x7fe9440d8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a80052e0 con 0x7fe5d00af010 2024-05-10T04:50:26.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.497+0000 7fe952400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe94405c510 0x7fe9440568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.498+0000 7fe952400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe94405c510 0x7fe9440568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:49752/0 (socket says 172.21.15.82:49752) 2024-05-10T04:50:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.498+0000 7f7109a00700 1 -- start start 2024-05-10T04:50:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.498+0000 7fd91a400700 1 Processor -- start 2024-05-10T04:50:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.499+0000 7fd91a400700 1 -- start start 2024-05-10T04:50:26.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.498+0000 7f1fc5a00700 1 Processor -- start 2024-05-10T04:50:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.498+0000 7f1fc5a00700 1 -- start start 2024-05-10T04:50:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.498+0000 7fe951a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944043240 0x7fe9440d8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:58900/0 (socket says 172.21.15.82:58900) 2024-05-10T04:50:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.499+0000 7fe951a00700 1 -- 172.21.15.82:0/3105331827 learned_addr learned my addr 172.21.15.82:0/3105331827 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.498+0000 7fe951000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe944059060 0x7fe9440e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7fe951a00700 1 -- 172.21.15.82:0/3105331827 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe94405c510 msgr2=0x7fe9440568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7fe951a00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe94405c510 0x7fe9440568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7f1fc5a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc00d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7fe951a00700 1 -- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe944059060 msgr2=0x7fe9440e24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7fd91a400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd91415cda0 0x7fd914151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7fd91a400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914162b50 0x7fd914164250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7fd91a400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd914166850 0x7fd914159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7fd919000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd91415cda0 0x7fd914151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7fd919000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd91415cda0 0x7fd914151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:49778/0 (socket says 172.21.15.82:49778) 2024-05-10T04:50:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7fd919000700 1 -- 172.21.15.82:0/874847576 learned_addr learned my addr 172.21.15.82:0/874847576 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91415e9a0 con 0x7fd914166850 2024-05-10T04:50:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.499+0000 7fe5c6a00700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe5ac06acc0 0x7fe5ac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.499+0000 7fe5c6a00700 1 -- 172.21.15.82:0/2429523767 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5b8089150 con 0x7fe5d00af010 2024-05-10T04:50:26.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.500+0000 7fe5cde00700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe5ac06acc0 0x7fe5ac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7f1fc5a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1fc00cedc0 0x7f1fc00d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7f1fc5a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc00b7020 con 0x7f1fc01629c0 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7f1fc5a00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc00d2f20 con 0x7f1fc00cedc0 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7f1fc5a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00d3200 con 0x7f1fc00d2a40 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7f1fbe000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1fc00cedc0 0x7f1fc00d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7f1fbe000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1fc00cedc0 0x7f1fc00d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:49768/0 (socket says 172.21.15.82:49768) 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7f1fbe000700 1 -- 172.21.15.82:0/2974786524 learned_addr learned my addr 172.21.15.82:0/2974786524 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7f1fbea00700 1 --2- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc00d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7f1fbe000700 1 -- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 msgr2=0x7f1fc00d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7f1fbe000700 1 --2- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc00d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7f1fbe000700 1 -- 172.21.15.82:0/2974786524 >> v1:172.21.15.129:6789/0 conn(0x7f1fc01629c0 legacy=0x7f1fc00b57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7f1fbe000700 1 -- 172.21.15.82:0/2974786524 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00d34e0 con 0x7f1fc00cedc0 2024-05-10T04:50:26.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.502+0000 7f1fbea00700 1 --2- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc00d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:26.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.501+0000 7fe951a00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe944059060 0x7fe9440e24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7fe5cde00700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe5ac06acc0 0x7fe5ac06d1d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5d01585d0 tx=0x7fe5c0007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f1fbe000700 1 --2- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc00cedc0 0x7f1fc00d0c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0098f0 tx=0x7f1fac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbba1fdf022027ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f1fbd600700 1 -- 172.21.15.82:0/2974786524 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00b8a0 con 0x7f1fc00cedc0 2024-05-10T04:50:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f1fbd600700 1 -- 172.21.15.82:0/2974786524 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac00ba00 con 0x7f1fc00cedc0 2024-05-10T04:50:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7fe951a00700 1 -- 172.21.15.82:0/3105331827 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9400094a0 con 0x7fe944043240 2024-05-10T04:50:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7fe952400700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe94405c510 0x7fe9440568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:26.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f1fbd600700 1 -- 172.21.15.82:0/2974786524 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00bd90 con 0x7f1fc00cedc0 2024-05-10T04:50:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7109a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 0x7f71041fb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7fd913e00700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914162b50 0x7fd914164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7109a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d0630 0x7f710414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd914164ac0 con 0x7fd91415cda0 2024-05-10T04:50:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd914164d10 con 0x7fd914162b50 2024-05-10T04:50:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7fe951a00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944043240 0x7fe9440d8b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe940009fd0 tx=0x7fe940004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7109a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71040d3030 0x7f710414ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7109a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710406f250 con 0x7f71040b2f50 2024-05-10T04:50:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7109a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710414f1f0 con 0x7f71040d3030 2024-05-10T04:50:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7109a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7104150050 con 0x7f71040d0630 2024-05-10T04:50:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7103400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71040d3030 0x7f710414ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7103400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71040d3030 0x7f710414ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:49788/0 (socket says 172.21.15.82:49788) 2024-05-10T04:50:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.503+0000 7f7103400700 1 -- 172.21.15.82:0/973676533 learned_addr learned my addr 172.21.15.82:0/973676533 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7f7103400700 1 -- 172.21.15.82:0/973676533 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d0630 msgr2=0x7f710414e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:50:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7fd919a00700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd914166850 0x7fd914159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7f1fc5a00700 1 -- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc00cedc0 msgr2=0x7f1fc00d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc00cedc0 0x7f1fc00d0c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0098f0 tx=0x7f1fac009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7fd913e00700 1 -- 172.21.15.82:0/874847576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd91415cda0 msgr2=0x7fd914151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7fd913e00700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd91415cda0 0x7fd914151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7fd913e00700 1 -- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd914166850 msgr2=0x7fd914159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7f7103400700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d0630 0x7f710414e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7f7103400700 1 -- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 msgr2=0x7f71041fb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7f1fc5a00700 1 -- 172.21.15.82:0/2974786524 shutdown_connections 2024-05-10T04:50:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc00d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/2974786524 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc00cedc0 0x7f1fc00d0c40 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0098f0 tx=0x7f1fac009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7f1fc5a00700 1 -- 172.21.15.82:0/2974786524 >> 172.21.15.82:0/2974786524 conn(0x7f1fc006c3f0 msgr2=0x7f1fc006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7f1fc5a00700 1 -- 172.21.15.82:0/2974786524 shutdown_connections 2024-05-10T04:50:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7fd913e00700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd914166850 0x7fd914159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.504+0000 7f7102a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 0x7f71041fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7fd913e00700 1 -- 172.21.15.82:0/874847576 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900009550 con 0x7fd914162b50 2024-05-10T04:50:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7fd919a00700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd914166850 0x7fd914159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.506+0000 7fd913e00700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914162b50 0x7fd914164250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00be20 tx=0x7fd90c009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.507+0000 7fd910c00700 1 -- 172.21.15.82:0/874847576 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00cd10 con 0x7fd914162b50 2024-05-10T04:50:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7fe949600700 1 -- 172.21.15.82:0/3105331827 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe940004510 con 0x7fe944043240 2024-05-10T04:50:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7fe949600700 1 -- 172.21.15.82:0/3105331827 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94001e070 con 0x7fe944043240 2024-05-10T04:50:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7fe949600700 1 -- 172.21.15.82:0/3105331827 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9400038e0 con 0x7fe944043240 2024-05-10T04:50:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9440e3140 con 0x7fe944043240 2024-05-10T04:50:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9440e3700 con 0x7fe944043240 2024-05-10T04:50:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7f7103400700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 0x7f71041fb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7f7103400700 1 -- 172.21.15.82:0/973676533 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec0094a0 con 0x7f71040d3030 2024-05-10T04:50:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.507+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd914164ff0 con 0x7fd914162b50 2024-05-10T04:50:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.506+0000 7f7103400700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71040d3030 0x7f710414ebf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00caa0 tx=0x7f70fc00ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.506+0000 7f7102a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 0x7f71041fb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.506+0000 7f70fb400700 1 -- 172.21.15.82:0/973676533 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00aa40 con 0x7f71040d3030 2024-05-10T04:50:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.507+0000 7fd910c00700 1 -- 172.21.15.82:0/874847576 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c00ce70 con 0x7fd914162b50 2024-05-10T04:50:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.507+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9141655b0 con 0x7fd914162b50 2024-05-10T04:50:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.506+0000 7f70fb400700 1 -- 172.21.15.82:0/973676533 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc00aba0 con 0x7f71040d3030 2024-05-10T04:50:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.506+0000 7f70fb400700 1 -- 172.21.15.82:0/973676533 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc012400 con 0x7f71040d3030 2024-05-10T04:50:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.508+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710414f440 con 0x7f71040d3030 2024-05-10T04:50:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.508+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710414fa00 con 0x7f71040d3030 2024-05-10T04:50:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.505+0000 7f1fc5a00700 1 -- 172.21.15.82:0/2974786524 wait complete. 2024-05-10T04:50:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.510+0000 7f1fc5a00700 1 Processor -- start 2024-05-10T04:50:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.508+0000 7fd910c00700 1 -- 172.21.15.82:0/874847576 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c014660 con 0x7fd914162b50 2024-05-10T04:50:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.511+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7104074af0 con 0x7f71040d3030 2024-05-10T04:50:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.510+0000 7f1fc5a00700 1 -- start start 2024-05-10T04:50:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.511+0000 7fe949600700 1 -- 172.21.15.82:0/3105331827 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe940003a40 con 0x7fe944043240 2024-05-10T04:50:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.512+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ec0052e0 con 0x7fd914162b50 2024-05-10T04:50:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.512+0000 7fe5c6a00700 1 -- 172.21.15.82:0/2429523767 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe5b8054290 con 0x7fe5d00af010 2024-05-10T04:50:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.512+0000 7f70fb400700 1 -- 172.21.15.82:0/973676533 <== mon.1 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f70fc012560 con 0x7f71040d3030 2024-05-10T04:50:26.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.512+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9280052e0 con 0x7fe944043240 2024-05-10T04:50:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.512+0000 7fe949600700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe92c06ad60 0x7fe92c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.513+0000 7fe949600700 1 -- 172.21.15.82:0/3105331827 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe94008a110 con 0x7fe944043240 2024-05-10T04:50:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.513+0000 7fe951000700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe92c06ad60 0x7fe92c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7fd910c00700 1 -- 172.21.15.82:0/874847576 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd90c006d50 con 0x7fd914162b50 2024-05-10T04:50:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f70fb400700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f70e006ad90 0x7f70e006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f70fb400700 1 -- 172.21.15.82:0/973676533 <== mon.1 v2:172.21.15.129:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70fc088f90 con 0x7f71040d3030 2024-05-10T04:50:26.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7fe951000700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe92c06ad60 0x7fe92c06d270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9440e3dc0 tx=0x7fe938008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f1fc5a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc01f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f1fc5a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc01629c0 0x7f1fc0200cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f7102a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f70e006ad90 0x7f70e006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f1fc5a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc01f48f0 0x7f1fc01f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f1fc5a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc01f6140 con 0x7f1fc01629c0 2024-05-10T04:50:26.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f1fc5a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00c95a0 con 0x7f1fc01f48f0 2024-05-10T04:50:26.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.514+0000 7f1fc5a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00b4e20 con 0x7f1fc00d2a40 2024-05-10T04:50:26.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbe000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc01629c0 0x7f1fc0200cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbe000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc01629c0 0x7f1fc0200cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42624/0 (socket says 172.21.15.82:42624) 2024-05-10T04:50:26.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbe000700 1 -- 172.21.15.82:0/3423911665 learned_addr learned my addr 172.21.15.82:0/3423911665 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7fd910c00700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8f406ac90 0x7fd8f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbf400700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc01f48f0 0x7f1fc01f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbea00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc01f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbe000700 1 -- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 msgr2=0x7f1fc01f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbe000700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc01f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbe000700 1 -- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc01f48f0 msgr2=0x7f1fc01f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbe000700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc01f48f0 0x7f1fc01f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.515+0000 7f1fbe000700 1 -- 172.21.15.82:0/3423911665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac009550 con 0x7f1fc01629c0 2024-05-10T04:50:26.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.516+0000 7fd910c00700 1 -- 172.21.15.82:0/874847576 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd90c037020 con 0x7fd914162b50 2024-05-10T04:50:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.516+0000 7f1fbf400700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc01f48f0 0x7f1fc01f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.516+0000 7f1fbe000700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc01629c0 0x7f1fc0200cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1fac013000 tx=0x7f1fac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.517+0000 7f1fb6a00700 1 -- 172.21.15.82:0/3423911665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac004450 con 0x7f1fc01629c0 2024-05-10T04:50:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.517+0000 7f1fb6a00700 1 -- 172.21.15.82:0/3423911665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac0045b0 con 0x7f1fc01629c0 2024-05-10T04:50:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.517+0000 7f1fb6a00700 1 -- 172.21.15.82:0/3423911665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0038a0 con 0x7f1fc01629c0 2024-05-10T04:50:26.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.517+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc00c90d0 con 0x7f1fc01629c0 2024-05-10T04:50:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.517+0000 7f7102a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f70e006ad90 0x7f70e006d2a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009840 tx=0x7f70ec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.517+0000 7fd919000700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8f406ac90 0x7fd8f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.517+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc01f5e60 con 0x7f1fc01629c0 2024-05-10T04:50:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.518+0000 7fd919000700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8f406ac90 0x7fd8f406d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9040099f0 tx=0x7fd904009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.519+0000 7f70fb400700 1 -- 172.21.15.82:0/973676533 <== mon.1 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f70fc054200 con 0x7f71040d3030 2024-05-10T04:50:26.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.519+0000 7fe949600700 1 -- 172.21.15.82:0/3105331827 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe940055320 con 0x7fe944043240 2024-05-10T04:50:26.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.519+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc00cec30 con 0x7f1fc01629c0 2024-05-10T04:50:26.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.520+0000 7f1fb6a00700 1 -- 172.21.15.82:0/3423911665 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1fac003a00 con 0x7f1fc01629c0 2024-05-10T04:50:26.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.522+0000 7f1fb6a00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1fa006ac90 0x7f1fa006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.522+0000 7f1fb6a00700 1 -- 172.21.15.82:0/3423911665 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fac08a3a0 con 0x7f1fc01629c0 2024-05-10T04:50:26.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.524+0000 7fd910c00700 1 -- 172.21.15.82:0/874847576 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd90c0bc900 con 0x7fd914162b50 2024-05-10T04:50:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.523+0000 7f1fbea00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1fa006ac90 0x7f1fa006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.524+0000 7f1fbea00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1fa006ac90 0x7f1fa006d1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c900 tx=0x7f1fb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.530+0000 7f1fb6a00700 1 -- 172.21.15.82:0/3423911665 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1fac055590 con 0x7f1fc01629c0 2024-05-10T04:50:26.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.539+0000 7fefe9e00700 1 Processor -- start 2024-05-10T04:50:26.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.540+0000 7fefe9e00700 1 -- start start 2024-05-10T04:50:26.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.543+0000 7fefe9e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fefe415d550 0x7fefe409a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.543+0000 7fefe9e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 0x7fefe40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.543+0000 7fefe9e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40d0660 con 0x7fefe4099c30 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.543+0000 7fefe9e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40cfa50 con 0x7fefe415d550 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.543+0000 7fefe9e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cfd30 con 0x7fefe40cc6a0 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.544+0000 7fefe3e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fefe4099c30 0x7fefe409a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36630/0 (socket says 172.21.15.82:36630) 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.544+0000 7fefe3e00700 1 -- 172.21.15.82:0/1248644241 learned_addr learned my addr 172.21.15.82:0/1248644241 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.545+0000 7fefe8a00700 1 --2- 172.21.15.82:0/1248644241 >> v2:172.21.15.129:3300/0 conn(0x7fefe415d550 0x7fefe409a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.546+0000 7fefe8a00700 1 -- 172.21.15.82:0/1248644241 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 msgr2=0x7fefe40ccab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.546+0000 7fefe8a00700 1 --2- 172.21.15.82:0/1248644241 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 0x7fefe40ccab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.546+0000 7fefe8a00700 1 -- 172.21.15.82:0/1248644241 >> v1:172.21.15.82:6789/0 conn(0x7fefe4099c30 legacy=0x7fefe409a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.546+0000 7fefe8a00700 1 -- 172.21.15.82:0/1248644241 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40d0010 con 0x7fefe415d550 2024-05-10T04:50:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.546+0000 7fefe8a00700 1 --2- 172.21.15.82:0/1248644241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe415d550 0x7fefe409a980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fefd8013150 tx=0x7fefd8013460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95ca3ec54a979ac8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.547+0000 7fefe3400700 1 -- 172.21.15.82:0/1248644241 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8016070 con 0x7fefe415d550 2024-05-10T04:50:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.547+0000 7fefe3400700 1 -- 172.21.15.82:0/1248644241 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8013cc0 con 0x7fefe415d550 2024-05-10T04:50:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.547+0000 7fefe3400700 1 -- 172.21.15.82:0/1248644241 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8004030 con 0x7fefe415d550 2024-05-10T04:50:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.548+0000 7fefe9e00700 1 -- 172.21.15.82:0/1248644241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe415d550 msgr2=0x7fefe409a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.548+0000 7fefe9e00700 1 --2- 172.21.15.82:0/1248644241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe415d550 0x7fefe409a980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fefd8013150 tx=0x7fefd8013460 comp rx=0 tx=0).stop 2024-05-10T04:50:26.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.548+0000 7fefe9e00700 1 -- 172.21.15.82:0/1248644241 shutdown_connections 2024-05-10T04:50:26.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.548+0000 7fefe9e00700 1 --2- 172.21.15.82:0/1248644241 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 0x7fefe40ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.548+0000 7fefe9e00700 1 --2- 172.21.15.82:0/1248644241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe415d550 0x7fefe409a980 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.548+0000 7fefe9e00700 1 -- 172.21.15.82:0/1248644241 >> 172.21.15.82:0/1248644241 conn(0x7fefe40b35c0 msgr2=0x7fefe40b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.548+0000 7fefe9e00700 1 -- 172.21.15.82:0/1248644241 shutdown_connections 2024-05-10T04:50:26.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.549+0000 7fefe9e00700 1 -- 172.21.15.82:0/1248644241 wait complete. 2024-05-10T04:50:26.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.554+0000 7f94abe00700 1 Processor -- start 2024-05-10T04:50:26.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.555+0000 7f94abe00700 1 -- start start 2024-05-10T04:50:26.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.555+0000 7fefe9e00700 1 Processor -- start 2024-05-10T04:50:26.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.555+0000 7fefe9e00700 1 -- start start 2024-05-10T04:50:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.558+0000 7fefe9e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe4099c30 0x7fefe41572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.558+0000 7fefe9e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 0x7fefe4159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.559+0000 7fefe9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe415d550 0x7fefe4159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.559+0000 7fefe9e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4157810 con 0x7fefe415d550 2024-05-10T04:50:26.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.559+0000 7fefe9e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe415ab40 con 0x7fefe4099c30 2024-05-10T04:50:26.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.559+0000 7fefe9e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c75e0 con 0x7fefe40cc6a0 2024-05-10T04:50:26.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.560+0000 7fefe3e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 0x7fefe4159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.560+0000 7fefe8a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe4099c30 0x7fefe41572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.560+0000 7fefe8a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe4099c30 0x7fefe41572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:49808/0 (socket says 172.21.15.82:49808) 2024-05-10T04:50:26.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.560+0000 7fefe8a00700 1 -- 172.21.15.82:0/964871291 learned_addr learned my addr 172.21.15.82:0/964871291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7fefe3e00700 1 -- 172.21.15.82:0/964871291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe4099c30 msgr2=0x7fefe41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7f94abe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f949c004ee0 0x7f949c0504b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7f94abe00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c008020 con 0x7f949c007c10 2024-05-10T04:50:26.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7f94abe00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c051e60 con 0x7f949c0e3760 2024-05-10T04:50:26.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7f94abe00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c0526c0 con 0x7f949c004ee0 2024-05-10T04:50:26.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7fefe3e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe4099c30 0x7fefe41572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7fefe3e00700 1 -- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe415d550 msgr2=0x7fefe4159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7f94a9e00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f949c0e3760 0x7f949c0540b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:37906/0 (socket says 172.21.15.82:37906) 2024-05-10T04:50:26.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7f94a9e00700 1 -- 172.21.15.82:0/3728233401 learned_addr learned my addr 172.21.15.82:0/3728233401 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:26.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7f94a8a00700 1 --2- 172.21.15.82:0/3728233401 >> v2:172.21.15.82:3300/0 conn(0x7f949c004ee0 0x7f949c0504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.561+0000 7fefe9400700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe415d550 0x7fefe4159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.562+0000 7fefe3e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe415d550 0x7fefe4159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.562+0000 7fefe3e00700 1 -- 172.21.15.82:0/964871291 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8011d40 con 0x7fefe40cc6a0 2024-05-10T04:50:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.562+0000 7fefe9400700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe415d550 0x7fefe4159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.562+0000 7f94a8a00700 1 -- 172.21.15.82:0/3728233401 >> v1:172.21.15.129:6789/0 conn(0x7f949c0e3760 legacy=0x7f949c0540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.562+0000 7f94a8a00700 1 -- 172.21.15.82:0/3728233401 >> v1:172.21.15.82:6789/0 conn(0x7f949c007c10 legacy=0x7f949c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.563+0000 7fefe3e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 0x7fefe4159a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fefd000c550 tx=0x7fefd000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.563+0000 7f94a8a00700 1 -- 172.21.15.82:0/3728233401 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c053bd0 con 0x7f949c004ee0 2024-05-10T04:50:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.563+0000 7fefe0c00700 1 -- 172.21.15.82:0/964871291 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004c80 con 0x7fefe40cc6a0 2024-05-10T04:50:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.564+0000 7fefe0c00700 1 -- 172.21.15.82:0/964871291 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0004de0 con 0x7fefe40cc6a0 2024-05-10T04:50:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.564+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe415a610 con 0x7fefe40cc6a0 2024-05-10T04:50:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.564+0000 7fefe0c00700 1 -- 172.21.15.82:0/964871291 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004c80 con 0x7fefe40cc6a0 2024-05-10T04:50:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.564+0000 7f94a8a00700 1 --2- 172.21.15.82:0/3728233401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c004ee0 0x7f949c0504b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9498009840 tx=0x7f9498009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592cb8b5a973e8ae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.565+0000 7f94a3e00700 1 -- 172.21.15.82:0/3728233401 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498004230 con 0x7f949c004ee0 2024-05-10T04:50:26.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.565+0000 7f94a3e00700 1 -- 172.21.15.82:0/3728233401 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9498004390 con 0x7f949c004ee0 2024-05-10T04:50:26.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.565+0000 7f94a3e00700 1 -- 172.21.15.82:0/3728233401 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980036a0 con 0x7f949c004ee0 2024-05-10T04:50:26.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.566+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe40c57c0 con 0x7fefe40cc6a0 2024-05-10T04:50:26.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.566+0000 7f94abe00700 1 -- 172.21.15.82:0/3728233401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c004ee0 msgr2=0x7f949c0504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.566+0000 7f94abe00700 1 --2- 172.21.15.82:0/3728233401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c004ee0 0x7f949c0504b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9498009840 tx=0x7f9498009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:26.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.566+0000 7f94abe00700 1 -- 172.21.15.82:0/3728233401 shutdown_connections 2024-05-10T04:50:26.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.566+0000 7f94abe00700 1 --2- 172.21.15.82:0/3728233401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c004ee0 0x7f949c0504b0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9498009840 tx=0x7f9498009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:26.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.566+0000 7f94abe00700 1 -- 172.21.15.82:0/3728233401 >> 172.21.15.82:0/3728233401 conn(0x7f949c055e60 msgr2=0x7f949c056270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.570+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40c5620 con 0x7fefe40cc6a0 2024-05-10T04:50:26.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.570+0000 7fefe0c00700 1 -- 172.21.15.82:0/964871291 <== mon.2 v2:172.21.15.129:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fefd00070d0 con 0x7fefe40cc6a0 2024-05-10T04:50:26.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.568+0000 7f94abe00700 1 -- 172.21.15.82:0/3728233401 shutdown_connections 2024-05-10T04:50:26.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.568+0000 7f94abe00700 1 -- 172.21.15.82:0/3728233401 wait complete. 2024-05-10T04:50:26.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.572+0000 7fefe0c00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fefc406acf0 0x7fefc406d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.572+0000 7f94abe00700 1 Processor -- start 2024-05-10T04:50:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.572+0000 7fefe0c00700 1 -- 172.21.15.82:0/964871291 <== mon.2 v2:172.21.15.129:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefd00884c0 con 0x7fefe40cc6a0 2024-05-10T04:50:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.573+0000 7f94abe00700 1 -- start start 2024-05-10T04:50:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.573+0000 7fefe8a00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fefc406acf0 0x7fefc406d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.575+0000 7fefe8a00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fefc406acf0 0x7fefc406d200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fefd8000c00 tx=0x7fefd8011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.576+0000 7fefe0c00700 1 -- 172.21.15.82:0/964871291 <== mon.2 v2:172.21.15.129:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fefe40c5620 con 0x7fefe40cc6a0 2024-05-10T04:50:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.576+0000 7f94abe00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f949c007c10 0x7f949c0df060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.577+0000 7f94abe00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f949c0e3760 0x7f949c0368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.577+0000 7f94abe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0389a0 0x7f949c038db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.577+0000 7f94abe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c1866c0 con 0x7f949c0389a0 2024-05-10T04:50:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.577+0000 7f94abe00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0df990 con 0x7f949c0e3760 2024-05-10T04:50:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.577+0000 7f94abe00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c186b20 con 0x7f949c007c10 2024-05-10T04:50:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.578+0000 7f94a9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0389a0 0x7f949c038db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.578+0000 7f94a8a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f949c0e3760 0x7f949c0368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.578+0000 7f94a8a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f949c0e3760 0x7f949c0368f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:49812/0 (socket says 172.21.15.82:49812) 2024-05-10T04:50:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.578+0000 7f94a9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0389a0 0x7f949c038db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42642/0 (socket says 172.21.15.82:42642) 2024-05-10T04:50:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.578+0000 7f94a8a00700 1 -- 172.21.15.82:0/2439642228 learned_addr learned my addr 172.21.15.82:0/2439642228 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.578+0000 7f94a9400700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f949c007c10 0x7f949c0df060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.579+0000 7f94a9e00700 1 -- 172.21.15.82:0/2439642228 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f949c007c10 msgr2=0x7f949c0df060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.579+0000 7f94a9e00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f949c007c10 0x7f949c0df060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.579+0000 7f94a9e00700 1 -- 172.21.15.82:0/2439642228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f949c0e3760 msgr2=0x7f949c0368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.579+0000 7f94a9e00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f949c0e3760 0x7f949c0368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.579+0000 7f94a9e00700 1 -- 172.21.15.82:0/2439642228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980094a0 con 0x7f949c0389a0 2024-05-10T04:50:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.580+0000 7f94a9e00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0389a0 0x7f949c038db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f94a40644e0 tx=0x7f94a40743a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.580+0000 7f94a1600700 1 -- 172.21.15.82:0/2439642228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a40731c0 con 0x7f949c0389a0 2024-05-10T04:50:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.581+0000 7f94a1600700 1 -- 172.21.15.82:0/2439642228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a40687d0 con 0x7f949c0389a0 2024-05-10T04:50:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.581+0000 7f94a1600700 1 -- 172.21.15.82:0/2439642228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4074c00 con 0x7f949c0389a0 2024-05-10T04:50:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.581+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c0395f0 con 0x7f949c0389a0 2024-05-10T04:50:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.581+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c039b20 con 0x7f949c0389a0 2024-05-10T04:50:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.583+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c006700 con 0x7f949c0389a0 2024-05-10T04:50:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.594+0000 7f94a1600700 1 -- 172.21.15.82:0/2439642228 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94a406c110 con 0x7f949c0389a0 2024-05-10T04:50:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.599+0000 7f94a1600700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f948806ac90 0x7f948806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:26.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.600+0000 7f94a1600700 1 -- 172.21.15.82:0/2439642228 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94a4103720 con 0x7f949c0389a0 2024-05-10T04:50:26.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.600+0000 7f94a9400700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f948806ac90 0x7f948806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:26.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.600+0000 7f94a1600700 1 -- 172.21.15.82:0/2439642228 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f94a4105c90 con 0x7f949c0389a0 2024-05-10T04:50:26.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.601+0000 7f94a9400700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f948806ac90 0x7f948806d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f949c0e72d0 tx=0x7f9494008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.904+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9b8006700 con 0x7fc9b803c860 2024-05-10T04:50:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.904+0000 7fc9b3400700 1 -- 172.21.15.82:0/3459981154 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9ac056b00 con 0x7fc9b803c860 2024-05-10T04:50:26.908 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2024-05-10T04:50:26.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.908+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc9a006acf0 msgr2=0x7fc9a006d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.908+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc9a006acf0 0x7fc9a006d200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8172030 tx=0x7fc9b4009210 comp rx=0 tx=0).stop 2024-05-10T04:50:26.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.908+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b803c860 msgr2=0x7fc9b80e3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.908+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b803c860 0x7fc9b80e3a20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac005910 tx=0x7fc9ac00c7b0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.909+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 shutdown_connections 2024-05-10T04:50:26.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.909+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc9a006acf0 0x7fc9a006d200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.909+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc9b81720a0 0x7fc9b8056550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.909+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc9b803c860 0x7fc9b80e3a20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.909+0000 7fc9c6600700 1 --2- 172.21.15.82:0/3459981154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b8041390 0x7fc9b8056010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.909+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 >> 172.21.15.82:0/3459981154 conn(0x7fc9b8059fe0 msgr2=0x7fc9b80586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.910+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 shutdown_connections 2024-05-10T04:50:26.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.910+0000 7fc9c6600700 1 -- 172.21.15.82:0/3459981154 wait complete. 2024-05-10T04:50:26.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2024-05-10T04:50:26.955 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:26.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.976+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8ec005590 con 0x7fd914162b50 2024-05-10T04:50:26.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.977+0000 7fd910c00700 1 -- 172.21.15.82:0/874847576 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd90c019090 con 0x7fd914162b50 2024-05-10T04:50:26.978 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2024-05-10T04:50:26.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe5a8005590 con 0x7fe5d00af010 2024-05-10T04:50:26.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8f406ac90 msgr2=0x7fd8f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8f406ac90 0x7fd8f406d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9040099f0 tx=0x7fd904009190 comp rx=0 tx=0).stop 2024-05-10T04:50:26.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914162b50 msgr2=0x7fd914164250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914162b50 0x7fd914164250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00be20 tx=0x7fd90c009f70 comp rx=0 tx=0).stop 2024-05-10T04:50:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fe5c6a00700 1 -- 172.21.15.82:0/2429523767 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5b80578b0 con 0x7fe5d00af010 2024-05-10T04:50:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 shutdown_connections 2024-05-10T04:50:26.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8f406ac90 0x7fd8f406d1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.983 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2024-05-10T04:50:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd914166850 0x7fd914159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd91415cda0 0x7fd914151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 --2- 172.21.15.82:0/874847576 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd914162b50 0x7fd914164250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 >> 172.21.15.82:0/874847576 conn(0x7fd9140b9ff0 msgr2=0x7fd9140ba400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.981+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 shutdown_connections 2024-05-10T04:50:26.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.982+0000 7fd91a400700 1 -- 172.21.15.82:0/874847576 wait complete. 2024-05-10T04:50:26.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.984+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe928005590 con 0x7fe944043240 2024-05-10T04:50:26.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.985+0000 7fe949600700 1 -- 172.21.15.82:0/3105331827 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe940058940 con 0x7fe944043240 2024-05-10T04:50:26.986 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe5ac06acc0 msgr2=0x7fe5ac06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe5ac06acc0 0x7fe5ac06d1d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5d01585d0 tx=0x7fe5c0007a80 comp rx=0 tx=0).stop 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5d00af010 msgr2=0x7fe5d01ef4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5d00af010 0x7fe5d01ef4a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800e830 tx=0x7fe5b800ebf0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 shutdown_connections 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe5ac06acc0 0x7fe5ac06d1d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5d0154210 0x7fe5d0154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5d00af010 0x7fe5d01ef4a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 --2- 172.21.15.82:0/2429523767 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5d015a4f0 0x7fe5d015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.986+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 >> 172.21.15.82:0/2429523767 conn(0x7fe5d006b050 msgr2=0x7fe5d006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.987+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 shutdown_connections 2024-05-10T04:50:26.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.987+0000 7fe5d5400700 1 -- 172.21.15.82:0/2429523767 wait complete. 2024-05-10T04:50:26.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.987+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71040b34a0 con 0x7f71040d3030 2024-05-10T04:50:26.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.989+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe92c06ad60 msgr2=0x7fe92c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.989+0000 7fe952e00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe92c06ad60 0x7fe92c06d270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9440e3dc0 tx=0x7fe938008040 comp rx=0 tx=0).stop 2024-05-10T04:50:26.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.989+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944043240 msgr2=0x7fe9440d8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.989+0000 7fe952e00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944043240 0x7fe9440d8b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe940009fd0 tx=0x7fe940004750 comp rx=0 tx=0).stop 2024-05-10T04:50:26.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.989+0000 7f70fb400700 1 -- 172.21.15.82:0/973676533 <== mon.1 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70fc057820 con 0x7f71040d3030 2024-05-10T04:50:26.991 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2024-05-10T04:50:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.990+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 shutdown_connections 2024-05-10T04:50:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.990+0000 7fe952e00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe92c06ad60 0x7fe92c06d270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.990+0000 7fe952e00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe94405c510 0x7fe9440568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.990+0000 7fe952e00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe944043240 0x7fe9440d8b10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.990+0000 7fe952e00700 1 --2- 172.21.15.82:0/3105331827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe944059060 0x7fe9440e24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.990+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 >> 172.21.15.82:0/3105331827 conn(0x7fe944059fb0 msgr2=0x7fe9440ea480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.990+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 shutdown_connections 2024-05-10T04:50:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.990+0000 7fe952e00700 1 -- 172.21.15.82:0/3105331827 wait complete. 2024-05-10T04:50:26.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f70e006ad90 msgr2=0x7f70e006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f70e006ad90 0x7f70e006d2a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009840 tx=0x7f70ec008030 comp rx=0 tx=0).stop 2024-05-10T04:50:26.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71040d3030 msgr2=0x7f710414ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:26.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71040d3030 0x7f710414ebf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00caa0 tx=0x7f70fc00ce60 comp rx=0 tx=0).stop 2024-05-10T04:50:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 shutdown_connections 2024-05-10T04:50:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f70e006ad90 0x7f70e006d2a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71040d3030 0x7f710414ebf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71040b2f50 0x7f71041fb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 --2- 172.21.15.82:0/973676533 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71040d0630 0x7f710414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 >> 172.21.15.82:0/973676533 conn(0x7f710406c3f0 msgr2=0x7f71040c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:26.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 shutdown_connections 2024-05-10T04:50:26.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.994+0000 7f7109a00700 1 -- 172.21.15.82:0/973676533 wait complete. 2024-05-10T04:50:26.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.995+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1fc00b4f90 con 0x7f1fc01629c0 2024-05-10T04:50:26.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:26.996+0000 7f1fb6a00700 1 -- 172.21.15.82:0/3423911665 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fac058bb0 con 0x7f1fc01629c0 2024-05-10T04:50:26.997 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2024-05-10T04:50:27.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.001+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1fa006ac90 msgr2=0x7f1fa006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.001+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1fa006ac90 0x7f1fa006d1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c900 tx=0x7f1fb0008040 comp rx=0 tx=0).stop 2024-05-10T04:50:27.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.001+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc01629c0 msgr2=0x7f1fc0200cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.001+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc01629c0 0x7f1fc0200cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1fac013000 tx=0x7f1fac004750 comp rx=0 tx=0).stop 2024-05-10T04:50:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.002+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 shutdown_connections 2024-05-10T04:50:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.002+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1fa006ac90 0x7f1fa006d1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.002+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fc01f48f0 0x7f1fc01f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.002+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1fc00d2a40 0x7f1fc01f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.002+0000 7f1fc5a00700 1 --2- 172.21.15.82:0/3423911665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fc01629c0 0x7f1fc0200cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.002+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 >> 172.21.15.82:0/3423911665 conn(0x7f1fc006c3f0 msgr2=0x7f1fc0161030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:27.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.002+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 shutdown_connections 2024-05-10T04:50:27.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.002+0000 7f1fc5a00700 1 -- 172.21.15.82:0/3423911665 wait complete. 2024-05-10T04:50:27.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-05-10T04:50:27.025 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:27.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2024-05-10T04:50:27.029 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:27.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2024-05-10T04:50:27.037 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:27.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2024-05-10T04:50:27.040 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:27.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.045+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fefe40c5620 con 0x7fefe40cc6a0 2024-05-10T04:50:27.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.045+0000 7fefe0c00700 1 -- 172.21.15.82:0/964871291 <== mon.2 v2:172.21.15.129:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fefe40c5620 con 0x7fefe40cc6a0 2024-05-10T04:50:27.046 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2024-05-10T04:50:27.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2024-05-10T04:50:27.047 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:27.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.046+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f949c000f10 con 0x7f949c0389a0 2024-05-10T04:50:27.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.047+0000 7f94a1600700 1 -- 172.21.15.82:0/2439642228 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94a40ce860 con 0x7f949c0389a0 2024-05-10T04:50:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2024-05-10T04:50:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fefc406acf0 msgr2=0x7fefc406d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fefc406acf0 0x7fefc406d200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fefd8000c00 tx=0x7fefd8011000 comp rx=0 tx=0).stop 2024-05-10T04:50:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 msgr2=0x7fefe4159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 0x7fefe4159a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fefd000c550 tx=0x7fefd000c860 comp rx=0 tx=0).stop 2024-05-10T04:50:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f948806ac90 msgr2=0x7f948806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f948806ac90 0x7f948806d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f949c0e72d0 tx=0x7f9494008040 comp rx=0 tx=0).stop 2024-05-10T04:50:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0389a0 msgr2=0x7f949c038db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0389a0 0x7f949c038db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f94a40644e0 tx=0x7f94a40743a0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 shutdown_connections 2024-05-10T04:50:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fefc406acf0 0x7fefc406d200 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe415d550 0x7fefe4159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fefe4099c30 0x7fefe41572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 --2- 172.21.15.82:0/964871291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fefe40cc6a0 0x7fefe4159a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 >> 172.21.15.82:0/964871291 conn(0x7fefe40b35c0 msgr2=0x7fefe4070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 shutdown_connections 2024-05-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f948806ac90 0x7f948806d1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949c0389a0 0x7f949c038db0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f949c007c10 0x7f949c0df060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 shutdown_connections 2024-05-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 --2- 172.21.15.82:0/2439642228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f949c0e3760 0x7f949c0368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 >> 172.21.15.82:0/2439642228 conn(0x7f949c055e60 msgr2=0x7f949c054e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7fefe9e00700 1 -- 172.21.15.82:0/964871291 wait complete. 2024-05-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 shutdown_connections 2024-05-10T04:50:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.050+0000 7f94abe00700 1 -- 172.21.15.82:0/2439642228 wait complete. 2024-05-10T04:50:27.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2024-05-10T04:50:27.077 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:27.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2024-05-10T04:50:27.078 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:27.078 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T04:50:27.078 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:50:27.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.381+0000 7f3c58800700 1 Processor -- start 2024-05-10T04:50:27.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.381+0000 7f3c58800700 1 -- start start 2024-05-10T04:50:27.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.382+0000 7f3c58800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3c5015bfe0 0x7f3c5015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c58800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c50161fb0 0x7f3c501623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c58800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c50162a70 con 0x7f3c500b5890 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c58800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5015c3f0 con 0x7f3c5015bfe0 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c58800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c50162d50 con 0x7f3c50161fb0 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c55e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3c5015bfe0 0x7f3c5015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c55e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3c5015bfe0 0x7f3c5015f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42652/0 (socket says 172.21.15.82:42652) 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c55e00700 1 -- 172.21.15.82:0/742687874 learned_addr learned my addr 172.21.15.82:0/742687874 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c55400700 1 --2- 172.21.15.82:0/742687874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c50161fb0 0x7f3c501623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c55e00700 1 -- 172.21.15.82:0/742687874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c50161fb0 msgr2=0x7f3c501623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c55e00700 1 --2- 172.21.15.82:0/742687874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c50161fb0 0x7f3c501623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c55e00700 1 -- 172.21.15.82:0/742687874 >> v1:172.21.15.129:6789/0 conn(0x7f3c500b5890 legacy=0x7f3c500b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.383+0000 7f3c55e00700 1 -- 172.21.15.82:0/742687874 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5015ecf0 con 0x7f3c5015bfe0 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.384+0000 7f3c55e00700 1 --2- 172.21.15.82:0/742687874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5015bfe0 0x7f3c5015f4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3c440098f0 tx=0x7f3c44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343c4eba75b8ea4a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.384+0000 7f3c54a00700 1 -- 172.21.15.82:0/742687874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400b8a0 con 0x7f3c5015bfe0 2024-05-10T04:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.384+0000 7f3c54a00700 1 -- 172.21.15.82:0/742687874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400ba00 con 0x7f3c5015bfe0 2024-05-10T04:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.384+0000 7f3c54a00700 1 -- 172.21.15.82:0/742687874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400bd90 con 0x7f3c5015bfe0 2024-05-10T04:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.384+0000 7f3c58800700 1 -- 172.21.15.82:0/742687874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5015bfe0 msgr2=0x7f3c5015f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.385+0000 7f3c58800700 1 --2- 172.21.15.82:0/742687874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5015bfe0 0x7f3c5015f4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3c440098f0 tx=0x7f3c44009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.385+0000 7f3c58800700 1 -- 172.21.15.82:0/742687874 shutdown_connections 2024-05-10T04:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.385+0000 7f3c58800700 1 --2- 172.21.15.82:0/742687874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c5015bfe0 0x7f3c5015f4f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.385+0000 7f3c58800700 1 --2- 172.21.15.82:0/742687874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c50161fb0 0x7f3c501623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.385+0000 7f3c58800700 1 -- 172.21.15.82:0/742687874 >> 172.21.15.82:0/742687874 conn(0x7f3c500d0a70 msgr2=0x7f3c500d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.385+0000 7f3c58800700 1 -- 172.21.15.82:0/742687874 shutdown_connections 2024-05-10T04:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.385+0000 7f3c58800700 1 -- 172.21.15.82:0/742687874 wait complete. 2024-05-10T04:50:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.387+0000 7f3c58800700 1 Processor -- start 2024-05-10T04:50:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.387+0000 7f3c58800700 1 -- start start 2024-05-10T04:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c58800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c500b5890 0x7f3c500c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c58800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c5015bfe0 0x7f3c5014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c58800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c50161fb0 0x7f3c5006c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c58800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5014b890 con 0x7f3c50161fb0 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c58800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5014b280 con 0x7f3c500b5890 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c58800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5014cff0 con 0x7f3c5015bfe0 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c56800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c50161fb0 0x7f3c5006c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c55400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c5015bfe0 0x7f3c5014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c55e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c500b5890 0x7f3c500c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c56800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c50161fb0 0x7f3c5006c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42664/0 (socket says 172.21.15.82:42664) 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c56800700 1 -- 172.21.15.82:0/3893180839 learned_addr learned my addr 172.21.15.82:0/3893180839 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c56800700 1 -- 172.21.15.82:0/3893180839 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c5015bfe0 msgr2=0x7f3c5014ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c56800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c5015bfe0 0x7f3c5014ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c56800700 1 -- 172.21.15.82:0/3893180839 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c500b5890 msgr2=0x7f3c500c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.389+0000 7f3c56800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c500b5890 0x7f3c500c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.390+0000 7f3c56800700 1 -- 172.21.15.82:0/3893180839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44009550 con 0x7f3c50161fb0 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.390+0000 7f3c56800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c50161fb0 0x7f3c5006c140 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00cb20 tx=0x7f3c4c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.390+0000 7f3c4a000700 1 -- 172.21.15.82:0/3893180839 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c003c00 con 0x7f3c50161fb0 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.390+0000 7f3c4a000700 1 -- 172.21.15.82:0/3893180839 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c003d60 con 0x7f3c50161fb0 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.390+0000 7f3c4a000700 1 -- 172.21.15.82:0/3893180839 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00a9e0 con 0x7f3c50161fb0 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.390+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c500c7fb0 con 0x7f3c50161fb0 2024-05-10T04:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.390+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c500c8200 con 0x7f3c50161fb0 2024-05-10T04:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.391+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5014b9d0 con 0x7f3c50161fb0 2024-05-10T04:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.392+0000 7f3c4a000700 1 -- 172.21.15.82:0/3893180839 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c4c00ab40 con 0x7f3c50161fb0 2024-05-10T04:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.393+0000 7f3c4a000700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3c3406acc0 0x7f3c3406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.393+0000 7f3c4a000700 1 -- 172.21.15.82:0/3893180839 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c4c089240 con 0x7f3c50161fb0 2024-05-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.393+0000 7f3c55e00700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3c3406acc0 0x7f3c3406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.394+0000 7f3c55e00700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3c3406acc0 0x7f3c3406d1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c44014040 tx=0x7f3c44008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:27.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.398+0000 7f3c4a000700 1 -- 172.21.15.82:0/3893180839 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3c5014b9d0 con 0x7f3c50161fb0 2024-05-10T04:50:27.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.597+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c500b9b30 con 0x7f3c3406acc0 2024-05-10T04:50:27.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.605+0000 7f3c4a000700 1 -- 172.21.15.82:0/3893180839 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264577 (secure 0 0 0) 0x7f3c500b9b30 con 0x7f3c3406acc0 2024-05-10T04:50:27.609 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3c3406acc0 msgr2=0x7f3c3406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3c3406acc0 0x7f3c3406d1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c44014040 tx=0x7f3c44008030 comp rx=0 tx=0).stop 2024-05-10T04:50:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c50161fb0 msgr2=0x7f3c5006c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c50161fb0 0x7f3c5006c140 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00cb20 tx=0x7f3c4c00ce30 comp rx=0 tx=0).stop 2024-05-10T04:50:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 shutdown_connections 2024-05-10T04:50:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3c3406acc0 0x7f3c3406d1d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c50161fb0 0x7f3c5006c140 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3c500b5890 0x7f3c500c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 --2- 172.21.15.82:0/3893180839 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3c5015bfe0 0x7f3c5014ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 >> 172.21.15.82:0/3893180839 conn(0x7f3c500d0a70 msgr2=0x7f3c500b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 shutdown_connections 2024-05-10T04:50:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.609+0000 7f3c58800700 1 -- 172.21.15.82:0/3893180839 wait complete. 2024-05-10T04:50:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:50:27.637 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-10T04:50:26.971115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002106"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317468+0000","last_change":"2024-05-10T04:50:16.116571+0000","last_active":"2024-05-10T04:50:17.317468+0000","last_peered":"2024-05-10T04:50:17.317468+0000","last_clean":"2024-05-10T04:50:17.317468+0000","last_became_active":"2024-05-10T04:50:16.114134+0000","last_became_peered":"2024-05-10T04:50:16.114134+0000","last_unstale":"2024-05-10T04:50:17.317468+0000","last_undegraded":"2024-05-10T04:50:17.317468+0000","last_fullsized":"2024-05-10T04:50:17.317468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:48.157294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076993+0000","last_change":"2024-05-10T04:50:16.105444+0000","last_active":"2024-05-10T04:50:17.076993+0000","last_peered":"2024-05-10T04:50:17.076993+0000","last_clean":"2024-05-10T04:50:17.076993+0000","last_became_active":"2024-05-10T04:50:16.105168+0000","last_became_peered":"2024-05-10T04:50:16.105168+0000","last_unstale":"2024-05-10T04:50:17.076993+0000","last_undegraded":"2024-05-10T04:50:17.076993+0000","last_fullsized":"2024-05-10T04:50:17.076993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315713+0000","last_change":"2024-05-10T04:50:16.095062+0000","last_active":"2024-05-10T04:50:17.315713+0000","last_peered":"2024-05-10T04:50:17.315713+0000","last_clean":"2024-05-10T04:50:17.315713+0000","last_became_active":"2024-05-10T04:50:16.094786+0000","last_became_peered":"2024-05-10T04:50:16.094786+0000","last_unstale":"2024-05-10T04:50:17.315713+0000","last_undegraded":"2024-05-10T04:50:17.315713+0000","last_fullsized":"2024-05-10T04:50:17.315713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:32.856707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077027+0000","last_change":"2024-05-10T04:50:16.105222+0000","last_active":"2024-05-10T04:50:17.077027+0000","last_peered":"2024-05-10T04:50:17.077027+0000","last_clean":"2024-05-10T04:50:17.077027+0000","last_became_active":"2024-05-10T04:50:16.104534+0000","last_became_peered":"2024-05-10T04:50:16.104534+0000","last_unstale":"2024-05-10T04:50:17.077027+0000","last_undegraded":"2024-05-10T04:50:17.077027+0000","last_fullsized":"2024-05-10T04:50:17.077027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:13.581090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316177+0000","last_change":"2024-05-10T04:50:16.116857+0000","last_active":"2024-05-10T04:50:17.316177+0000","last_peered":"2024-05-10T04:50:17.316177+0000","last_clean":"2024-05-10T04:50:17.316177+0000","last_became_active":"2024-05-10T04:50:16.114914+0000","last_became_peered":"2024-05-10T04:50:16.114914+0000","last_unstale":"2024-05-10T04:50:17.316177+0000","last_undegraded":"2024-05-10T04:50:17.316177+0000","last_fullsized":"2024-05-10T04:50:17.316177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076793+0000","last_change":"2024-05-10T04:50:16.092687+0000","last_active":"2024-05-10T04:50:17.076793+0000","last_peered":"2024-05-10T04:50:17.076793+0000","last_clean":"2024-05-10T04:50:17.076793+0000","last_became_active":"2024-05-10T04:50:16.092377+0000","last_became_peered":"2024-05-10T04:50:16.092377+0000","last_unstale":"2024-05-10T04:50:17.076793+0000","last_undegraded":"2024-05-10T04:50:17.076793+0000","last_fullsized":"2024-05-10T04:50:17.076793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316827+0000","last_change":"2024-05-10T04:50:16.112968+0000","last_active":"2024-05-10T04:50:17.316827+0000","last_peered":"2024-05-10T04:50:17.316827+0000","last_clean":"2024-05-10T04:50:17.316827+0000","last_became_active":"2024-05-10T04:50:16.112691+0000","last_became_peered":"2024-05-10T04:50:16.112691+0000","last_unstale":"2024-05-10T04:50:17.316827+0000","last_undegraded":"2024-05-10T04:50:17.316827+0000","last_fullsized":"2024-05-10T04:50:17.316827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:32:24.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315078+0000","last_change":"2024-05-10T04:50:16.104549+0000","last_active":"2024-05-10T04:50:17.315078+0000","last_peered":"2024-05-10T04:50:17.315078+0000","last_clean":"2024-05-10T04:50:17.315078+0000","last_became_active":"2024-05-10T04:50:16.104213+0000","last_became_peered":"2024-05-10T04:50:16.104213+0000","last_unstale":"2024-05-10T04:50:17.315078+0000","last_undegraded":"2024-05-10T04:50:17.315078+0000","last_fullsized":"2024-05-10T04:50:17.315078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317412+0000","last_change":"2024-05-10T04:50:16.118415+0000","last_active":"2024-05-10T04:50:17.317412+0000","last_peered":"2024-05-10T04:50:17.317412+0000","last_clean":"2024-05-10T04:50:17.317412+0000","last_became_active":"2024-05-10T04:50:16.118045+0000","last_became_peered":"2024-05-10T04:50:16.118045+0000","last_unstale":"2024-05-10T04:50:17.317412+0000","last_undegraded":"2024-05-10T04:50:17.317412+0000","last_fullsized":"2024-05-10T04:50:17.317412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:07.192432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316747+0000","last_change":"2024-05-10T04:50:16.108768+0000","last_active":"2024-05-10T04:50:17.316747+0000","last_peered":"2024-05-10T04:50:17.316747+0000","last_clean":"2024-05-10T04:50:17.316747+0000","last_became_active":"2024-05-10T04:50:16.108457+0000","last_became_peered":"2024-05-10T04:50:16.108457+0000","last_unstale":"2024-05-10T04:50:17.316747+0000","last_undegraded":"2024-05-10T04:50:17.316747+0000","last_fullsized":"2024-05-10T04:50:17.316747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315861+0000","last_change":"2024-05-10T04:50:16.119907+0000","last_active":"2024-05-10T04:50:17.315861+0000","last_peered":"2024-05-10T04:50:17.315861+0000","last_clean":"2024-05-10T04:50:17.315861+0000","last_became_active":"2024-05-10T04:50:16.119573+0000","last_became_peered":"2024-05-10T04:50:16.119573+0000","last_unstale":"2024-05-10T04:50:17.315861+0000","last_undegraded":"2024-05-10T04:50:17.315861+0000","last_fullsized":"2024-05-10T04:50:17.315861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316976+0000","last_change":"2024-05-10T04:50:16.096302+0000","last_active":"2024-05-10T04:50:17.316976+0000","last_peered":"2024-05-10T04:50:17.316976+0000","last_clean":"2024-05-10T04:50:17.316976+0000","last_became_active":"2024-05-10T04:50:16.095997+0000","last_became_peered":"2024-05-10T04:50:16.095997+0000","last_unstale":"2024-05-10T04:50:17.316976+0000","last_undegraded":"2024-05-10T04:50:17.316976+0000","last_fullsized":"2024-05-10T04:50:17.316976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:25.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315424+0000","last_change":"2024-05-10T04:50:16.106646+0000","last_active":"2024-05-10T04:50:17.315424+0000","last_peered":"2024-05-10T04:50:17.315424+0000","last_clean":"2024-05-10T04:50:17.315424+0000","last_became_active":"2024-05-10T04:50:16.106365+0000","last_became_peered":"2024-05-10T04:50:16.106365+0000","last_unstale":"2024-05-10T04:50:17.315424+0000","last_undegraded":"2024-05-10T04:50:17.315424+0000","last_fullsized":"2024-05-10T04:50:17.315424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315522+0000","last_change":"2024-05-10T04:50:16.091792+0000","last_active":"2024-05-10T04:50:17.315522+0000","last_peered":"2024-05-10T04:50:17.315522+0000","last_clean":"2024-05-10T04:50:17.315522+0000","last_became_active":"2024-05-10T04:50:16.091437+0000","last_became_peered":"2024-05-10T04:50:16.091437+0000","last_unstale":"2024-05-10T04:50:17.315522+0000","last_undegraded":"2024-05-10T04:50:17.315522+0000","last_fullsized":"2024-05-10T04:50:17.315522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076423+0000","last_change":"2024-05-10T04:50:16.106200+0000","last_active":"2024-05-10T04:50:17.076423+0000","last_peered":"2024-05-10T04:50:17.076423+0000","last_clean":"2024-05-10T04:50:17.076423+0000","last_became_active":"2024-05-10T04:50:16.099204+0000","last_became_peered":"2024-05-10T04:50:16.099204+0000","last_unstale":"2024-05-10T04:50:17.076423+0000","last_undegraded":"2024-05-10T04:50:17.076423+0000","last_fullsized":"2024-05-10T04:50:17.076423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076460+0000","last_change":"2024-05-10T04:50:16.091018+0000","last_active":"2024-05-10T04:50:17.076460+0000","last_peered":"2024-05-10T04:50:17.076460+0000","last_clean":"2024-05-10T04:50:17.076460+0000","last_became_active":"2024-05-10T04:50:16.090683+0000","last_became_peered":"2024-05-10T04:50:16.090683+0000","last_unstale":"2024-05-10T04:50:17.076460+0000","last_undegraded":"2024-05-10T04:50:17.076460+0000","last_fullsized":"2024-05-10T04:50:17.076460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077320+0000","last_change":"2024-05-10T04:50:16.100477+0000","last_active":"2024-05-10T04:50:17.077320+0000","last_peered":"2024-05-10T04:50:17.077320+0000","last_clean":"2024-05-10T04:50:17.077320+0000","last_became_active":"2024-05-10T04:50:16.099915+0000","last_became_peered":"2024-05-10T04:50:16.099915+0000","last_unstale":"2024-05-10T04:50:17.077320+0000","last_undegraded":"2024-05-10T04:50:17.077320+0000","last_fullsized":"2024-05-10T04:50:17.077320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:32:24.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077731+0000","last_change":"2024-05-10T04:50:16.100503+0000","last_active":"2024-05-10T04:50:17.077731+0000","last_peered":"2024-05-10T04:50:17.077731+0000","last_clean":"2024-05-10T04:50:17.077731+0000","last_became_active":"2024-05-10T04:50:16.100054+0000","last_became_peered":"2024-05-10T04:50:16.100054+0000","last_unstale":"2024-05-10T04:50:17.077731+0000","last_undegraded":"2024-05-10T04:50:17.077731+0000","last_fullsized":"2024-05-10T04:50:17.077731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317151+0000","last_change":"2024-05-10T04:50:16.111998+0000","last_active":"2024-05-10T04:50:17.317151+0000","last_peered":"2024-05-10T04:50:17.317151+0000","last_clean":"2024-05-10T04:50:17.317151+0000","last_became_active":"2024-05-10T04:50:16.111151+0000","last_became_peered":"2024-05-10T04:50:16.111151+0000","last_unstale":"2024-05-10T04:50:17.317151+0000","last_undegraded":"2024-05-10T04:50:17.317151+0000","last_fullsized":"2024-05-10T04:50:17.317151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.659081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316335+0000","last_change":"2024-05-10T04:50:15.516274+0000","last_active":"2024-05-10T04:50:17.316335+0000","last_peered":"2024-05-10T04:50:17.316335+0000","last_clean":"2024-05-10T04:50:17.316335+0000","last_became_active":"2024-05-10T04:50:15.515938+0000","last_became_peered":"2024-05-10T04:50:15.515938+0000","last_unstale":"2024-05-10T04:50:17.316335+0000","last_undegraded":"2024-05-10T04:50:17.316335+0000","last_fullsized":"2024-05-10T04:50:17.316335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.492940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315956+0000","last_change":"2024-05-10T04:50:16.103965+0000","last_active":"2024-05-10T04:50:17.315956+0000","last_peered":"2024-05-10T04:50:17.315956+0000","last_clean":"2024-05-10T04:50:17.315956+0000","last_became_active":"2024-05-10T04:50:16.100297+0000","last_became_peered":"2024-05-10T04:50:16.100297+0000","last_unstale":"2024-05-10T04:50:17.315956+0000","last_undegraded":"2024-05-10T04:50:17.315956+0000","last_fullsized":"2024-05-10T04:50:17.315956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316052+0000","last_change":"2024-05-10T04:50:15.511208+0000","last_active":"2024-05-10T04:50:17.316052+0000","last_peered":"2024-05-10T04:50:17.316052+0000","last_clean":"2024-05-10T04:50:17.316052+0000","last_became_active":"2024-05-10T04:50:15.510946+0000","last_became_peered":"2024-05-10T04:50:15.510946+0000","last_unstale":"2024-05-10T04:50:17.316052+0000","last_undegraded":"2024-05-10T04:50:17.316052+0000","last_fullsized":"2024-05-10T04:50:17.316052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.492940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316317+0000","last_change":"2024-05-10T04:50:16.103854+0000","last_active":"2024-05-10T04:50:17.316317+0000","last_peered":"2024-05-10T04:50:17.316317+0000","last_clean":"2024-05-10T04:50:17.316317+0000","last_became_active":"2024-05-10T04:50:16.103319+0000","last_became_peered":"2024-05-10T04:50:16.103319+0000","last_unstale":"2024-05-10T04:50:17.316317+0000","last_undegraded":"2024-05-10T04:50:17.316317+0000","last_fullsized":"2024-05-10T04:50:17.316317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:02.917774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317628+0000","last_change":"2024-05-10T04:50:15.520375+0000","last_active":"2024-05-10T04:50:17.317628+0000","last_peered":"2024-05-10T04:50:17.317628+0000","last_clean":"2024-05-10T04:50:17.317628+0000","last_became_active":"2024-05-10T04:50:15.520023+0000","last_became_peered":"2024-05-10T04:50:15.520023+0000","last_unstale":"2024-05-10T04:50:17.317628+0000","last_undegraded":"2024-05-10T04:50:17.317628+0000","last_fullsized":"2024-05-10T04:50:17.317628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076711+0000","last_change":"2024-05-10T04:50:16.092652+0000","last_active":"2024-05-10T04:50:17.076711+0000","last_peered":"2024-05-10T04:50:17.076711+0000","last_clean":"2024-05-10T04:50:17.076711+0000","last_became_active":"2024-05-10T04:50:16.092325+0000","last_became_peered":"2024-05-10T04:50:16.092325+0000","last_unstale":"2024-05-10T04:50:17.076711+0000","last_undegraded":"2024-05-10T04:50:17.076711+0000","last_fullsized":"2024-05-10T04:50:17.076711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317137+0000","last_change":"2024-05-10T04:50:15.519068+0000","last_active":"2024-05-10T04:50:17.317137+0000","last_peered":"2024-05-10T04:50:17.317137+0000","last_clean":"2024-05-10T04:50:17.317137+0000","last_became_active":"2024-05-10T04:50:15.518747+0000","last_became_peered":"2024-05-10T04:50:15.518747+0000","last_unstale":"2024-05-10T04:50:17.317137+0000","last_undegraded":"2024-05-10T04:50:17.317137+0000","last_fullsized":"2024-05-10T04:50:17.317137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:35.682289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077225+0000","last_change":"2024-05-10T04:50:16.105958+0000","last_active":"2024-05-10T04:50:17.077225+0000","last_peered":"2024-05-10T04:50:17.077225+0000","last_clean":"2024-05-10T04:50:17.077225+0000","last_became_active":"2024-05-10T04:50:16.104254+0000","last_became_peered":"2024-05-10T04:50:16.104254+0000","last_unstale":"2024-05-10T04:50:17.077225+0000","last_undegraded":"2024-05-10T04:50:17.077225+0000","last_fullsized":"2024-05-10T04:50:17.077225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.659081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315602+0000","last_change":"2024-05-10T04:50:15.517690+0000","last_active":"2024-05-10T04:50:17.315602+0000","last_peered":"2024-05-10T04:50:17.315602+0000","last_clean":"2024-05-10T04:50:17.315602+0000","last_became_active":"2024-05-10T04:50:15.517371+0000","last_became_peered":"2024-05-10T04:50:15.517371+0000","last_unstale":"2024-05-10T04:50:17.315602+0000","last_undegraded":"2024-05-10T04:50:17.315602+0000","last_fullsized":"2024-05-10T04:50:17.315602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316653+0000","last_change":"2024-05-10T04:50:16.093622+0000","last_active":"2024-05-10T04:50:17.316653+0000","last_peered":"2024-05-10T04:50:17.316653+0000","last_clean":"2024-05-10T04:50:17.316653+0000","last_became_active":"2024-05-10T04:50:16.093266+0000","last_became_peered":"2024-05-10T04:50:16.093266+0000","last_unstale":"2024-05-10T04:50:17.316653+0000","last_undegraded":"2024-05-10T04:50:17.316653+0000","last_fullsized":"2024-05-10T04:50:17.316653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316221+0000","last_change":"2024-05-10T04:50:15.518189+0000","last_active":"2024-05-10T04:50:17.316221+0000","last_peered":"2024-05-10T04:50:17.316221+0000","last_clean":"2024-05-10T04:50:17.316221+0000","last_became_active":"2024-05-10T04:50:15.517697+0000","last_became_peered":"2024-05-10T04:50:15.517697+0000","last_unstale":"2024-05-10T04:50:17.316221+0000","last_undegraded":"2024-05-10T04:50:17.316221+0000","last_fullsized":"2024-05-10T04:50:17.316221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316057+0000","last_change":"2024-05-10T04:50:16.096819+0000","last_active":"2024-05-10T04:50:17.316057+0000","last_peered":"2024-05-10T04:50:17.316057+0000","last_clean":"2024-05-10T04:50:17.316057+0000","last_became_active":"2024-05-10T04:50:16.096295+0000","last_became_peered":"2024-05-10T04:50:16.096295+0000","last_unstale":"2024-05-10T04:50:17.316057+0000","last_undegraded":"2024-05-10T04:50:17.316057+0000","last_fullsized":"2024-05-10T04:50:17.316057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:25.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315314+0000","last_change":"2024-05-10T04:50:15.506725+0000","last_active":"2024-05-10T04:50:17.315314+0000","last_peered":"2024-05-10T04:50:17.315314+0000","last_clean":"2024-05-10T04:50:17.315314+0000","last_became_active":"2024-05-10T04:50:15.504725+0000","last_became_peered":"2024-05-10T04:50:15.504725+0000","last_unstale":"2024-05-10T04:50:17.315314+0000","last_undegraded":"2024-05-10T04:50:17.315314+0000","last_fullsized":"2024-05-10T04:50:17.315314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:30:20.860044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315294+0000","last_change":"2024-05-10T04:50:16.090939+0000","last_active":"2024-05-10T04:50:17.315294+0000","last_peered":"2024-05-10T04:50:17.315294+0000","last_clean":"2024-05-10T04:50:17.315294+0000","last_became_active":"2024-05-10T04:50:16.090673+0000","last_became_peered":"2024-05-10T04:50:16.090673+0000","last_unstale":"2024-05-10T04:50:17.315294+0000","last_undegraded":"2024-05-10T04:50:17.315294+0000","last_fullsized":"2024-05-10T04:50:17.315294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076581+0000","last_change":"2024-05-10T04:50:15.513992+0000","last_active":"2024-05-10T04:50:17.076581+0000","last_peered":"2024-05-10T04:50:17.076581+0000","last_clean":"2024-05-10T04:50:17.076581+0000","last_became_active":"2024-05-10T04:50:15.512537+0000","last_became_peered":"2024-05-10T04:50:15.512537+0000","last_unstale":"2024-05-10T04:50:17.076581+0000","last_undegraded":"2024-05-10T04:50:17.076581+0000","last_fullsized":"2024-05-10T04:50:17.076581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076497+0000","last_change":"2024-05-10T04:50:16.104592+0000","last_active":"2024-05-10T04:50:17.076497+0000","last_peered":"2024-05-10T04:50:17.076497+0000","last_clean":"2024-05-10T04:50:17.076497+0000","last_became_active":"2024-05-10T04:50:16.104262+0000","last_became_peered":"2024-05-10T04:50:16.104262+0000","last_unstale":"2024-05-10T04:50:17.076497+0000","last_undegraded":"2024-05-10T04:50:17.076497+0000","last_fullsized":"2024-05-10T04:50:17.076497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317517+0000","last_change":"2024-05-10T04:50:15.514321+0000","last_active":"2024-05-10T04:50:17.317517+0000","last_peered":"2024-05-10T04:50:17.317517+0000","last_clean":"2024-05-10T04:50:17.317517+0000","last_became_active":"2024-05-10T04:50:15.514125+0000","last_became_peered":"2024-05-10T04:50:15.514125+0000","last_unstale":"2024-05-10T04:50:17.317517+0000","last_undegraded":"2024-05-10T04:50:17.317517+0000","last_fullsized":"2024-05-10T04:50:17.317517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077233+0000","last_change":"2024-05-10T04:50:16.096429+0000","last_active":"2024-05-10T04:50:17.077233+0000","last_peered":"2024-05-10T04:50:17.077233+0000","last_clean":"2024-05-10T04:50:17.077233+0000","last_became_active":"2024-05-10T04:50:16.095555+0000","last_became_peered":"2024-05-10T04:50:16.095555+0000","last_unstale":"2024-05-10T04:50:17.077233+0000","last_undegraded":"2024-05-10T04:50:17.077233+0000","last_fullsized":"2024-05-10T04:50:17.077233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077087+0000","last_change":"2024-05-10T04:50:15.513574+0000","last_active":"2024-05-10T04:50:17.077087+0000","last_peered":"2024-05-10T04:50:17.077087+0000","last_clean":"2024-05-10T04:50:17.077087+0000","last_became_active":"2024-05-10T04:50:15.513121+0000","last_became_peered":"2024-05-10T04:50:15.513121+0000","last_unstale":"2024-05-10T04:50:17.077087+0000","last_undegraded":"2024-05-10T04:50:17.077087+0000","last_fullsized":"2024-05-10T04:50:17.077087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316443+0000","last_change":"2024-05-10T04:50:16.090959+0000","last_active":"2024-05-10T04:50:17.316443+0000","last_peered":"2024-05-10T04:50:17.316443+0000","last_clean":"2024-05-10T04:50:17.316443+0000","last_became_active":"2024-05-10T04:50:16.090673+0000","last_became_peered":"2024-05-10T04:50:16.090673+0000","last_unstale":"2024-05-10T04:50:17.316443+0000","last_undegraded":"2024-05-10T04:50:17.316443+0000","last_fullsized":"2024-05-10T04:50:17.316443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:36.689058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077005+0000","last_change":"2024-05-10T04:50:15.515867+0000","last_active":"2024-05-10T04:50:17.077005+0000","last_peered":"2024-05-10T04:50:17.077005+0000","last_clean":"2024-05-10T04:50:17.077005+0000","last_became_active":"2024-05-10T04:50:15.515578+0000","last_became_peered":"2024-05-10T04:50:15.515578+0000","last_unstale":"2024-05-10T04:50:17.077005+0000","last_undegraded":"2024-05-10T04:50:17.077005+0000","last_fullsized":"2024-05-10T04:50:17.077005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316807+0000","last_change":"2024-05-10T04:50:16.094129+0000","last_active":"2024-05-10T04:50:17.316807+0000","last_peered":"2024-05-10T04:50:17.316807+0000","last_clean":"2024-05-10T04:50:17.316807+0000","last_became_active":"2024-05-10T04:50:16.093853+0000","last_became_peered":"2024-05-10T04:50:16.093853+0000","last_unstale":"2024-05-10T04:50:17.316807+0000","last_undegraded":"2024-05-10T04:50:17.316807+0000","last_fullsized":"2024-05-10T04:50:17.316807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:01.772418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315820+0000","last_change":"2024-05-10T04:50:15.507954+0000","last_active":"2024-05-10T04:50:17.315820+0000","last_peered":"2024-05-10T04:50:17.315820+0000","last_clean":"2024-05-10T04:50:17.315820+0000","last_became_active":"2024-05-10T04:50:15.507504+0000","last_became_peered":"2024-05-10T04:50:15.507504+0000","last_unstale":"2024-05-10T04:50:17.315820+0000","last_undegraded":"2024-05-10T04:50:17.315820+0000","last_fullsized":"2024-05-10T04:50:17.315820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:57.162592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317277+0000","last_change":"2024-05-10T04:50:16.112035+0000","last_active":"2024-05-10T04:50:17.317277+0000","last_peered":"2024-05-10T04:50:17.317277+0000","last_clean":"2024-05-10T04:50:17.317277+0000","last_became_active":"2024-05-10T04:50:16.111519+0000","last_became_peered":"2024-05-10T04:50:16.111519+0000","last_unstale":"2024-05-10T04:50:17.317277+0000","last_undegraded":"2024-05-10T04:50:17.317277+0000","last_fullsized":"2024-05-10T04:50:17.317277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:24:01.388216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315966+0000","last_change":"2024-05-10T04:50:15.497940+0000","last_active":"2024-05-10T04:50:17.315966+0000","last_peered":"2024-05-10T04:50:17.315966+0000","last_clean":"2024-05-10T04:50:17.315966+0000","last_became_active":"2024-05-10T04:50:15.496471+0000","last_became_peered":"2024-05-10T04:50:15.496471+0000","last_unstale":"2024-05-10T04:50:17.315966+0000","last_undegraded":"2024-05-10T04:50:17.315966+0000","last_fullsized":"2024-05-10T04:50:17.315966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:51.200540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315426+0000","last_change":"2024-05-10T04:50:16.107065+0000","last_active":"2024-05-10T04:50:17.315426+0000","last_peered":"2024-05-10T04:50:17.315426+0000","last_clean":"2024-05-10T04:50:17.315426+0000","last_became_active":"2024-05-10T04:50:16.106704+0000","last_became_peered":"2024-05-10T04:50:16.106704+0000","last_unstale":"2024-05-10T04:50:17.315426+0000","last_undegraded":"2024-05-10T04:50:17.315426+0000","last_fullsized":"2024-05-10T04:50:17.315426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:55.406199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077139+0000","last_change":"2024-05-10T04:50:15.512673+0000","last_active":"2024-05-10T04:50:17.077139+0000","last_peered":"2024-05-10T04:50:17.077139+0000","last_clean":"2024-05-10T04:50:17.077139+0000","last_became_active":"2024-05-10T04:50:15.509967+0000","last_became_peered":"2024-05-10T04:50:15.509967+0000","last_unstale":"2024-05-10T04:50:17.077139+0000","last_undegraded":"2024-05-10T04:50:17.077139+0000","last_fullsized":"2024-05-10T04:50:17.077139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:50:53.486663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317332+0000","last_change":"2024-05-10T04:50:16.117728+0000","last_active":"2024-05-10T04:50:17.317332+0000","last_peered":"2024-05-10T04:50:17.317332+0000","last_clean":"2024-05-10T04:50:17.317332+0000","last_became_active":"2024-05-10T04:50:16.117328+0000","last_became_peered":"2024-05-10T04:50:16.117328+0000","last_unstale":"2024-05-10T04:50:17.317332+0000","last_undegraded":"2024-05-10T04:50:17.317332+0000","last_fullsized":"2024-05-10T04:50:17.317332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:13.581090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315668+0000","last_change":"2024-05-10T04:50:15.505534+0000","last_active":"2024-05-10T04:50:17.315668+0000","last_peered":"2024-05-10T04:50:17.315668+0000","last_clean":"2024-05-10T04:50:17.315668+0000","last_became_active":"2024-05-10T04:50:15.505204+0000","last_became_peered":"2024-05-10T04:50:15.505204+0000","last_unstale":"2024-05-10T04:50:17.315668+0000","last_undegraded":"2024-05-10T04:50:17.315668+0000","last_fullsized":"2024-05-10T04:50:17.315668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315762+0000","last_change":"2024-05-10T04:50:16.107456+0000","last_active":"2024-05-10T04:50:17.315762+0000","last_peered":"2024-05-10T04:50:17.315762+0000","last_clean":"2024-05-10T04:50:17.315762+0000","last_became_active":"2024-05-10T04:50:16.107101+0000","last_became_peered":"2024-05-10T04:50:16.107101+0000","last_unstale":"2024-05-10T04:50:17.315762+0000","last_undegraded":"2024-05-10T04:50:17.315762+0000","last_fullsized":"2024-05-10T04:50:17.315762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077555+0000","last_change":"2024-05-10T04:50:15.510534+0000","last_active":"2024-05-10T04:50:17.077555+0000","last_peered":"2024-05-10T04:50:17.077555+0000","last_clean":"2024-05-10T04:50:17.077555+0000","last_became_active":"2024-05-10T04:50:15.510203+0000","last_became_peered":"2024-05-10T04:50:15.510203+0000","last_unstale":"2024-05-10T04:50:17.077555+0000","last_undegraded":"2024-05-10T04:50:17.077555+0000","last_fullsized":"2024-05-10T04:50:17.077555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:30:20.860044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316071+0000","last_change":"2024-05-10T04:50:16.116503+0000","last_active":"2024-05-10T04:50:17.316071+0000","last_peered":"2024-05-10T04:50:17.316071+0000","last_clean":"2024-05-10T04:50:17.316071+0000","last_became_active":"2024-05-10T04:50:16.116218+0000","last_became_peered":"2024-05-10T04:50:16.116218+0000","last_unstale":"2024-05-10T04:50:17.316071+0000","last_undegraded":"2024-05-10T04:50:17.316071+0000","last_fullsized":"2024-05-10T04:50:17.316071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:43:59.737316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317154+0000","last_change":"2024-05-10T04:50:15.507067+0000","last_active":"2024-05-10T04:50:17.317154+0000","last_peered":"2024-05-10T04:50:17.317154+0000","last_clean":"2024-05-10T04:50:17.317154+0000","last_became_active":"2024-05-10T04:50:15.506306+0000","last_became_peered":"2024-05-10T04:50:15.506306+0000","last_unstale":"2024-05-10T04:50:17.317154+0000","last_undegraded":"2024-05-10T04:50:17.317154+0000","last_fullsized":"2024-05-10T04:50:17.317154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:51.200540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317588+0000","last_change":"2024-05-10T04:50:16.112236+0000","last_active":"2024-05-10T04:50:17.317588+0000","last_peered":"2024-05-10T04:50:17.317588+0000","last_clean":"2024-05-10T04:50:17.317588+0000","last_became_active":"2024-05-10T04:50:16.111551+0000","last_became_peered":"2024-05-10T04:50:16.111551+0000","last_unstale":"2024-05-10T04:50:17.317588+0000","last_undegraded":"2024-05-10T04:50:17.317588+0000","last_fullsized":"2024-05-10T04:50:17.317588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:02.230401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076869+0000","last_change":"2024-05-10T04:50:15.511205+0000","last_active":"2024-05-10T04:50:17.076869+0000","last_peered":"2024-05-10T04:50:17.076869+0000","last_clean":"2024-05-10T04:50:17.076869+0000","last_became_active":"2024-05-10T04:50:15.510947+0000","last_became_peered":"2024-05-10T04:50:15.510947+0000","last_unstale":"2024-05-10T04:50:17.076869+0000","last_undegraded":"2024-05-10T04:50:17.076869+0000","last_fullsized":"2024-05-10T04:50:17.076869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:57.162592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077176+0000","last_change":"2024-05-10T04:50:16.101982+0000","last_active":"2024-05-10T04:50:17.077176+0000","last_peered":"2024-05-10T04:50:17.077176+0000","last_clean":"2024-05-10T04:50:17.077176+0000","last_became_active":"2024-05-10T04:50:16.092143+0000","last_became_peered":"2024-05-10T04:50:16.092143+0000","last_unstale":"2024-05-10T04:50:17.077176+0000","last_undegraded":"2024-05-10T04:50:17.077176+0000","last_fullsized":"2024-05-10T04:50:17.077176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:24:01.388216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076958+0000","last_change":"2024-05-10T04:50:15.509745+0000","last_active":"2024-05-10T04:50:17.076958+0000","last_peered":"2024-05-10T04:50:17.076958+0000","last_clean":"2024-05-10T04:50:17.076958+0000","last_became_active":"2024-05-10T04:50:15.509429+0000","last_became_peered":"2024-05-10T04:50:15.509429+0000","last_unstale":"2024-05-10T04:50:17.076958+0000","last_undegraded":"2024-05-10T04:50:17.076958+0000","last_fullsized":"2024-05-10T04:50:17.076958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:37.683206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316304+0000","last_change":"2024-05-10T04:50:16.091478+0000","last_active":"2024-05-10T04:50:17.316304+0000","last_peered":"2024-05-10T04:50:17.316304+0000","last_clean":"2024-05-10T04:50:17.316304+0000","last_became_active":"2024-05-10T04:50:16.091245+0000","last_became_peered":"2024-05-10T04:50:16.091245+0000","last_unstale":"2024-05-10T04:50:17.316304+0000","last_undegraded":"2024-05-10T04:50:17.316304+0000","last_fullsized":"2024-05-10T04:50:17.316304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:26.121531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076468+0000","last_change":"2024-05-10T04:50:16.093555+0000","last_active":"2024-05-10T04:50:17.076468+0000","last_peered":"2024-05-10T04:50:17.076468+0000","last_clean":"2024-05-10T04:50:17.076468+0000","last_became_active":"2024-05-10T04:50:16.093088+0000","last_became_peered":"2024-05-10T04:50:16.093088+0000","last_unstale":"2024-05-10T04:50:17.076468+0000","last_undegraded":"2024-05-10T04:50:17.076468+0000","last_fullsized":"2024-05-10T04:50:17.076468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077611+0000","last_change":"2024-05-10T04:50:15.509023+0000","last_active":"2024-05-10T04:50:17.077611+0000","last_peered":"2024-05-10T04:50:17.077611+0000","last_clean":"2024-05-10T04:50:17.077611+0000","last_became_active":"2024-05-10T04:50:15.508723+0000","last_became_peered":"2024-05-10T04:50:15.508723+0000","last_unstale":"2024-05-10T04:50:17.077611+0000","last_undegraded":"2024-05-10T04:50:17.077611+0000","last_fullsized":"2024-05-10T04:50:17.077611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:50:53.486663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315481+0000","last_change":"2024-05-10T04:50:16.108380+0000","last_active":"2024-05-10T04:50:17.315481+0000","last_peered":"2024-05-10T04:50:17.315481+0000","last_clean":"2024-05-10T04:50:17.315481+0000","last_became_active":"2024-05-10T04:50:16.107863+0000","last_became_peered":"2024-05-10T04:50:16.107863+0000","last_unstale":"2024-05-10T04:50:17.315481+0000","last_undegraded":"2024-05-10T04:50:17.315481+0000","last_fullsized":"2024-05-10T04:50:17.315481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076863+0000","last_change":"2024-05-10T04:50:15.505795+0000","last_active":"2024-05-10T04:50:17.076863+0000","last_peered":"2024-05-10T04:50:17.076863+0000","last_clean":"2024-05-10T04:50:17.076863+0000","last_became_active":"2024-05-10T04:50:15.503636+0000","last_became_peered":"2024-05-10T04:50:15.503636+0000","last_unstale":"2024-05-10T04:50:17.076863+0000","last_undegraded":"2024-05-10T04:50:17.076863+0000","last_fullsized":"2024-05-10T04:50:17.076863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:50:16.094417+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:50:16.094417+0000","last_peered":"2024-05-10T04:50:16.094417+0000","last_clean":"2024-05-10T04:50:16.094417+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:50:16.094417+0000","last_undegraded":"2024-05-10T04:50:16.094417+0000","last_fullsized":"2024-05-10T04:50:16.094417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315146+0000","last_change":"2024-05-10T04:50:16.092439+0000","last_active":"2024-05-10T04:50:17.315146+0000","last_peered":"2024-05-10T04:50:17.315146+0000","last_clean":"2024-05-10T04:50:17.315146+0000","last_became_active":"2024-05-10T04:50:16.092165+0000","last_became_peered":"2024-05-10T04:50:16.092165+0000","last_unstale":"2024-05-10T04:50:17.315146+0000","last_undegraded":"2024-05-10T04:50:17.315146+0000","last_fullsized":"2024-05-10T04:50:17.315146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:26.805209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315978+0000","last_change":"2024-05-10T04:50:15.523201+0000","last_active":"2024-05-10T04:50:17.315978+0000","last_peered":"2024-05-10T04:50:17.315978+0000","last_clean":"2024-05-10T04:50:17.315978+0000","last_became_active":"2024-05-10T04:50:15.522923+0000","last_became_peered":"2024-05-10T04:50:15.522923+0000","last_unstale":"2024-05-10T04:50:17.315978+0000","last_undegraded":"2024-05-10T04:50:17.315978+0000","last_fullsized":"2024-05-10T04:50:17.315978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317655+0000","last_change":"2024-05-10T04:50:15.520251+0000","last_active":"2024-05-10T04:50:17.317655+0000","last_peered":"2024-05-10T04:50:17.317655+0000","last_clean":"2024-05-10T04:50:17.317655+0000","last_became_active":"2024-05-10T04:50:15.519958+0000","last_became_peered":"2024-05-10T04:50:15.519958+0000","last_unstale":"2024-05-10T04:50:17.317655+0000","last_undegraded":"2024-05-10T04:50:17.317655+0000","last_fullsized":"2024-05-10T04:50:17.317655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:15.316078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076829+0000","last_change":"2024-05-10T04:50:16.094812+0000","last_active":"2024-05-10T04:50:17.076829+0000","last_peered":"2024-05-10T04:50:17.076829+0000","last_clean":"2024-05-10T04:50:17.076829+0000","last_became_active":"2024-05-10T04:50:16.093699+0000","last_became_peered":"2024-05-10T04:50:16.093699+0000","last_unstale":"2024-05-10T04:50:17.076829+0000","last_undegraded":"2024-05-10T04:50:17.076829+0000","last_fullsized":"2024-05-10T04:50:17.076829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:19.042352+0000","last_change":"2024-05-10T04:50:15.514342+0000","last_active":"2024-05-10T04:50:19.042352+0000","last_peered":"2024-05-10T04:50:19.042352+0000","last_clean":"2024-05-10T04:50:19.042352+0000","last_became_active":"2024-05-10T04:50:15.514053+0000","last_became_peered":"2024-05-10T04:50:15.514053+0000","last_unstale":"2024-05-10T04:50:19.042352+0000","last_undegraded":"2024-05-10T04:50:19.042352+0000","last_fullsized":"2024-05-10T04:50:19.042352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:15.316078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315978+0000","last_change":"2024-05-10T04:50:16.101714+0000","last_active":"2024-05-10T04:50:17.315978+0000","last_peered":"2024-05-10T04:50:17.315978+0000","last_clean":"2024-05-10T04:50:17.315978+0000","last_became_active":"2024-05-10T04:50:16.101380+0000","last_became_peered":"2024-05-10T04:50:16.101380+0000","last_unstale":"2024-05-10T04:50:17.315978+0000","last_undegraded":"2024-05-10T04:50:17.315978+0000","last_fullsized":"2024-05-10T04:50:17.315978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316044+0000","last_change":"2024-05-10T04:50:15.516370+0000","last_active":"2024-05-10T04:50:17.316044+0000","last_peered":"2024-05-10T04:50:17.316044+0000","last_clean":"2024-05-10T04:50:17.316044+0000","last_became_active":"2024-05-10T04:50:15.514786+0000","last_became_peered":"2024-05-10T04:50:15.514786+0000","last_unstale":"2024-05-10T04:50:17.316044+0000","last_undegraded":"2024-05-10T04:50:17.316044+0000","last_fullsized":"2024-05-10T04:50:17.316044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316311+0000","last_change":"2024-05-10T04:50:16.091731+0000","last_active":"2024-05-10T04:50:17.316311+0000","last_peered":"2024-05-10T04:50:17.316311+0000","last_clean":"2024-05-10T04:50:17.316311+0000","last_became_active":"2024-05-10T04:50:16.091459+0000","last_became_peered":"2024-05-10T04:50:16.091459+0000","last_unstale":"2024-05-10T04:50:17.316311+0000","last_undegraded":"2024-05-10T04:50:17.316311+0000","last_fullsized":"2024-05-10T04:50:17.316311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315645+0000","last_change":"2024-05-10T04:50:15.520260+0000","last_active":"2024-05-10T04:50:17.315645+0000","last_peered":"2024-05-10T04:50:17.315645+0000","last_clean":"2024-05-10T04:50:17.315645+0000","last_became_active":"2024-05-10T04:50:15.520059+0000","last_became_peered":"2024-05-10T04:50:15.520059+0000","last_unstale":"2024-05-10T04:50:17.315645+0000","last_undegraded":"2024-05-10T04:50:17.315645+0000","last_fullsized":"2024-05-10T04:50:17.315645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:25.798441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316457+0000","last_change":"2024-05-10T04:50:16.091927+0000","last_active":"2024-05-10T04:50:17.316457+0000","last_peered":"2024-05-10T04:50:17.316457+0000","last_clean":"2024-05-10T04:50:17.316457+0000","last_became_active":"2024-05-10T04:50:16.091543+0000","last_became_peered":"2024-05-10T04:50:16.091543+0000","last_unstale":"2024-05-10T04:50:17.316457+0000","last_undegraded":"2024-05-10T04:50:17.316457+0000","last_fullsized":"2024-05-10T04:50:17.316457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:16.322846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076410+0000","last_change":"2024-05-10T04:50:15.517935+0000","last_active":"2024-05-10T04:50:17.076410+0000","last_peered":"2024-05-10T04:50:17.076410+0000","last_clean":"2024-05-10T04:50:17.076410+0000","last_became_active":"2024-05-10T04:50:15.517528+0000","last_became_peered":"2024-05-10T04:50:15.517528+0000","last_unstale":"2024-05-10T04:50:17.076410+0000","last_undegraded":"2024-05-10T04:50:17.076410+0000","last_fullsized":"2024-05-10T04:50:17.076410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315174+0000","last_change":"2024-05-10T04:50:16.096422+0000","last_active":"2024-05-10T04:50:17.315174+0000","last_peered":"2024-05-10T04:50:17.315174+0000","last_clean":"2024-05-10T04:50:17.315174+0000","last_became_active":"2024-05-10T04:50:16.095048+0000","last_became_peered":"2024-05-10T04:50:16.095048+0000","last_unstale":"2024-05-10T04:50:17.315174+0000","last_undegraded":"2024-05-10T04:50:17.315174+0000","last_fullsized":"2024-05-10T04:50:17.315174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:55.406199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076765+0000","last_change":"2024-05-10T04:50:15.510474+0000","last_active":"2024-05-10T04:50:17.076765+0000","last_peered":"2024-05-10T04:50:17.076765+0000","last_clean":"2024-05-10T04:50:17.076765+0000","last_became_active":"2024-05-10T04:50:15.509890+0000","last_became_peered":"2024-05-10T04:50:15.509890+0000","last_unstale":"2024-05-10T04:50:17.076765+0000","last_undegraded":"2024-05-10T04:50:17.076765+0000","last_fullsized":"2024-05-10T04:50:17.076765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315711+0000","last_change":"2024-05-10T04:50:16.091690+0000","last_active":"2024-05-10T04:50:17.315711+0000","last_peered":"2024-05-10T04:50:17.315711+0000","last_clean":"2024-05-10T04:50:17.315711+0000","last_became_active":"2024-05-10T04:50:16.090685+0000","last_became_peered":"2024-05-10T04:50:16.090685+0000","last_unstale":"2024-05-10T04:50:17.315711+0000","last_undegraded":"2024-05-10T04:50:17.315711+0000","last_fullsized":"2024-05-10T04:50:17.315711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317278+0000","last_change":"2024-05-10T04:50:15.517573+0000","last_active":"2024-05-10T04:50:17.317278+0000","last_peered":"2024-05-10T04:50:17.317278+0000","last_clean":"2024-05-10T04:50:17.317278+0000","last_became_active":"2024-05-10T04:50:15.517108+0000","last_became_peered":"2024-05-10T04:50:15.517108+0000","last_unstale":"2024-05-10T04:50:17.317278+0000","last_undegraded":"2024-05-10T04:50:17.317278+0000","last_fullsized":"2024-05-10T04:50:17.317278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:30.795068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316202+0000","last_change":"2024-05-10T04:50:16.111071+0000","last_active":"2024-05-10T04:50:17.316202+0000","last_peered":"2024-05-10T04:50:17.316202+0000","last_clean":"2024-05-10T04:50:17.316202+0000","last_became_active":"2024-05-10T04:50:16.109828+0000","last_became_peered":"2024-05-10T04:50:16.109828+0000","last_unstale":"2024-05-10T04:50:17.316202+0000","last_undegraded":"2024-05-10T04:50:17.316202+0000","last_fullsized":"2024-05-10T04:50:17.316202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077673+0000","last_change":"2024-05-10T04:50:15.512759+0000","last_active":"2024-05-10T04:50:17.077673+0000","last_peered":"2024-05-10T04:50:17.077673+0000","last_clean":"2024-05-10T04:50:17.077673+0000","last_became_active":"2024-05-10T04:50:15.512504+0000","last_became_peered":"2024-05-10T04:50:15.512504+0000","last_unstale":"2024-05-10T04:50:17.077673+0000","last_undegraded":"2024-05-10T04:50:17.077673+0000","last_fullsized":"2024-05-10T04:50:17.077673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317426+0000","last_change":"2024-05-10T04:50:16.120261+0000","last_active":"2024-05-10T04:50:17.317426+0000","last_peered":"2024-05-10T04:50:17.317426+0000","last_clean":"2024-05-10T04:50:17.317426+0000","last_became_active":"2024-05-10T04:50:16.119987+0000","last_became_peered":"2024-05-10T04:50:16.119987+0000","last_unstale":"2024-05-10T04:50:17.317426+0000","last_undegraded":"2024-05-10T04:50:17.317426+0000","last_fullsized":"2024-05-10T04:50:17.317426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:37.923918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076976+0000","last_change":"2024-05-10T04:50:15.510033+0000","last_active":"2024-05-10T04:50:17.076976+0000","last_peered":"2024-05-10T04:50:17.076976+0000","last_clean":"2024-05-10T04:50:17.076976+0000","last_became_active":"2024-05-10T04:50:15.509678+0000","last_became_peered":"2024-05-10T04:50:15.509678+0000","last_unstale":"2024-05-10T04:50:17.076976+0000","last_undegraded":"2024-05-10T04:50:17.076976+0000","last_fullsized":"2024-05-10T04:50:17.076976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076880+0000","last_change":"2024-05-10T04:50:16.114747+0000","last_active":"2024-05-10T04:50:17.076880+0000","last_peered":"2024-05-10T04:50:17.076880+0000","last_clean":"2024-05-10T04:50:17.076880+0000","last_became_active":"2024-05-10T04:50:16.108054+0000","last_became_peered":"2024-05-10T04:50:16.108054+0000","last_unstale":"2024-05-10T04:50:17.076880+0000","last_undegraded":"2024-05-10T04:50:17.076880+0000","last_fullsized":"2024-05-10T04:50:17.076880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:02.230401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077792+0000","last_change":"2024-05-10T04:50:15.511828+0000","last_active":"2024-05-10T04:50:17.077792+0000","last_peered":"2024-05-10T04:50:17.077792+0000","last_clean":"2024-05-10T04:50:17.077792+0000","last_became_active":"2024-05-10T04:50:15.508490+0000","last_became_peered":"2024-05-10T04:50:15.508490+0000","last_unstale":"2024-05-10T04:50:17.077792+0000","last_undegraded":"2024-05-10T04:50:17.077792+0000","last_fullsized":"2024-05-10T04:50:17.077792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:37.683206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317311+0000","last_change":"2024-05-10T04:50:16.118853+0000","last_active":"2024-05-10T04:50:17.317311+0000","last_peered":"2024-05-10T04:50:17.317311+0000","last_clean":"2024-05-10T04:50:17.317311+0000","last_became_active":"2024-05-10T04:50:16.118491+0000","last_became_peered":"2024-05-10T04:50:16.118491+0000","last_unstale":"2024-05-10T04:50:17.317311+0000","last_undegraded":"2024-05-10T04:50:17.317311+0000","last_fullsized":"2024-05-10T04:50:17.317311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:52.596368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316201+0000","last_change":"2024-05-10T04:50:16.111132+0000","last_active":"2024-05-10T04:50:17.316201+0000","last_peered":"2024-05-10T04:50:17.316201+0000","last_clean":"2024-05-10T04:50:17.316201+0000","last_became_active":"2024-05-10T04:50:16.110819+0000","last_became_peered":"2024-05-10T04:50:16.110819+0000","last_unstale":"2024-05-10T04:50:17.316201+0000","last_undegraded":"2024-05-10T04:50:17.316201+0000","last_fullsized":"2024-05-10T04:50:17.316201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077705+0000","last_change":"2024-05-10T04:50:16.085668+0000","last_active":"2024-05-10T04:50:17.077705+0000","last_peered":"2024-05-10T04:50:17.077705+0000","last_clean":"2024-05-10T04:50:17.077705+0000","last_became_active":"2024-05-10T04:50:16.084595+0000","last_became_peered":"2024-05-10T04:50:16.084595+0000","last_unstale":"2024-05-10T04:50:17.077705+0000","last_undegraded":"2024-05-10T04:50:17.077705+0000","last_fullsized":"2024-05-10T04:50:17.077705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:01.772418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077071+0000","last_change":"2024-05-10T04:50:16.104882+0000","last_active":"2024-05-10T04:50:17.077071+0000","last_peered":"2024-05-10T04:50:17.077071+0000","last_clean":"2024-05-10T04:50:17.077071+0000","last_became_active":"2024-05-10T04:50:16.101840+0000","last_became_peered":"2024-05-10T04:50:16.101840+0000","last_unstale":"2024-05-10T04:50:17.077071+0000","last_undegraded":"2024-05-10T04:50:17.077071+0000","last_fullsized":"2024-05-10T04:50:17.077071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:07.192432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315884+0000","last_change":"2024-05-10T04:50:16.096600+0000","last_active":"2024-05-10T04:50:17.315884+0000","last_peered":"2024-05-10T04:50:17.315884+0000","last_clean":"2024-05-10T04:50:17.315884+0000","last_became_active":"2024-05-10T04:50:16.095907+0000","last_became_peered":"2024-05-10T04:50:16.095907+0000","last_unstale":"2024-05-10T04:50:17.315884+0000","last_undegraded":"2024-05-10T04:50:17.315884+0000","last_fullsized":"2024-05-10T04:50:17.315884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315600+0000","last_change":"2024-05-10T04:50:16.097111+0000","last_active":"2024-05-10T04:50:17.315600+0000","last_peered":"2024-05-10T04:50:17.315600+0000","last_clean":"2024-05-10T04:50:17.315600+0000","last_became_active":"2024-05-10T04:50:16.096855+0000","last_became_peered":"2024-05-10T04:50:16.096855+0000","last_unstale":"2024-05-10T04:50:17.315600+0000","last_undegraded":"2024-05-10T04:50:17.315600+0000","last_fullsized":"2024-05-10T04:50:17.315600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076898+0000","last_change":"2024-05-10T04:50:16.100106+0000","last_active":"2024-05-10T04:50:17.076898+0000","last_peered":"2024-05-10T04:50:17.076898+0000","last_clean":"2024-05-10T04:50:17.076898+0000","last_became_active":"2024-05-10T04:50:16.095317+0000","last_became_peered":"2024-05-10T04:50:16.095317+0000","last_unstale":"2024-05-10T04:50:17.076898+0000","last_undegraded":"2024-05-10T04:50:17.076898+0000","last_fullsized":"2024-05-10T04:50:17.076898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316523+0000","last_change":"2024-05-10T04:50:16.103396+0000","last_active":"2024-05-10T04:50:17.316523+0000","last_peered":"2024-05-10T04:50:17.316523+0000","last_clean":"2024-05-10T04:50:17.316523+0000","last_became_active":"2024-05-10T04:50:16.102768+0000","last_became_peered":"2024-05-10T04:50:16.102768+0000","last_unstale":"2024-05-10T04:50:17.316523+0000","last_undegraded":"2024-05-10T04:50:17.316523+0000","last_fullsized":"2024-05-10T04:50:17.316523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315919+0000","last_change":"2024-05-10T04:50:16.095965+0000","last_active":"2024-05-10T04:50:17.315919+0000","last_peered":"2024-05-10T04:50:17.315919+0000","last_clean":"2024-05-10T04:50:17.315919+0000","last_became_active":"2024-05-10T04:50:16.095711+0000","last_became_peered":"2024-05-10T04:50:16.095711+0000","last_unstale":"2024-05-10T04:50:17.315919+0000","last_undegraded":"2024-05-10T04:50:17.315919+0000","last_fullsized":"2024-05-10T04:50:17.315919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076712+0000","last_change":"2024-05-10T04:50:16.107080+0000","last_active":"2024-05-10T04:50:17.076712+0000","last_peered":"2024-05-10T04:50:17.076712+0000","last_clean":"2024-05-10T04:50:17.076712+0000","last_became_active":"2024-05-10T04:50:16.102437+0000","last_became_peered":"2024-05-10T04:50:16.102437+0000","last_unstale":"2024-05-10T04:50:17.076712+0000","last_undegraded":"2024-05-10T04:50:17.076712+0000","last_fullsized":"2024-05-10T04:50:17.076712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:37.923918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315288+0000","last_change":"2024-05-10T04:50:16.095687+0000","last_active":"2024-05-10T04:50:17.315288+0000","last_peered":"2024-05-10T04:50:17.315288+0000","last_clean":"2024-05-10T04:50:17.315288+0000","last_became_active":"2024-05-10T04:50:16.093813+0000","last_became_peered":"2024-05-10T04:50:16.093813+0000","last_unstale":"2024-05-10T04:50:17.315288+0000","last_undegraded":"2024-05-10T04:50:17.315288+0000","last_fullsized":"2024-05-10T04:50:17.315288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076694+0000","last_change":"2024-05-10T04:50:16.108911+0000","last_active":"2024-05-10T04:50:17.076694+0000","last_peered":"2024-05-10T04:50:17.076694+0000","last_clean":"2024-05-10T04:50:17.076694+0000","last_became_active":"2024-05-10T04:50:16.107713+0000","last_became_peered":"2024-05-10T04:50:16.107713+0000","last_unstale":"2024-05-10T04:50:17.076694+0000","last_undegraded":"2024-05-10T04:50:17.076694+0000","last_fullsized":"2024-05-10T04:50:17.076694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315797+0000","last_change":"2024-05-10T04:50:16.097207+0000","last_active":"2024-05-10T04:50:17.315797+0000","last_peered":"2024-05-10T04:50:17.315797+0000","last_clean":"2024-05-10T04:50:17.315797+0000","last_became_active":"2024-05-10T04:50:16.093993+0000","last_became_peered":"2024-05-10T04:50:16.093993+0000","last_unstale":"2024-05-10T04:50:17.315797+0000","last_undegraded":"2024-05-10T04:50:17.315797+0000","last_fullsized":"2024-05-10T04:50:17.315797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315905+0000","last_change":"2024-05-10T04:50:16.096624+0000","last_active":"2024-05-10T04:50:17.315905+0000","last_peered":"2024-05-10T04:50:17.315905+0000","last_clean":"2024-05-10T04:50:17.315905+0000","last_became_active":"2024-05-10T04:50:16.096111+0000","last_became_peered":"2024-05-10T04:50:16.096111+0000","last_unstale":"2024-05-10T04:50:17.315905+0000","last_undegraded":"2024-05-10T04:50:17.315905+0000","last_fullsized":"2024-05-10T04:50:17.315905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:50:27.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:50:27.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.941+0000 7fd21c600700 1 Processor -- start 2024-05-10T04:50:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.941+0000 7fd21c600700 1 -- start start 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd21c600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd214162c30 0x7fd2140b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd21c600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd21415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd21c600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2141627a0 con 0x7fd2140b5ee0 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd21c600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd214163040 con 0x7fd214162c30 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd21c600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21415fa20 con 0x7fd2140d2e60 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd219c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd214162c30 0x7fd2140b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd219200700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd2140b5ee0 0x7fd2140d2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36636/0 (socket says 172.21.15.82:36636) 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd219200700 1 -- 172.21.15.82:0/124520063 learned_addr learned my addr 172.21.15.82:0/124520063 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd21a600700 1 --2- 172.21.15.82:0/124520063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd21415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd219c00700 1 -- 172.21.15.82:0/124520063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 msgr2=0x7fd21415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd219c00700 1 --2- 172.21.15.82:0/124520063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd21415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd219c00700 1 -- 172.21.15.82:0/124520063 >> v1:172.21.15.82:6789/0 conn(0x7fd2140b5ee0 legacy=0x7fd2140d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd219c00700 1 -- 172.21.15.82:0/124520063 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140b62f0 con 0x7fd214162c30 2024-05-10T04:50:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd21a600700 1 --2- 172.21.15.82:0/124520063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd21415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.943+0000 7fd213e00700 1 -- 172.21.15.82:0/124520063 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537997474 0 0) 0x7fd2141627a0 con 0x7fd2140b5ee0 2024-05-10T04:50:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.944+0000 7fd219c00700 1 --2- 172.21.15.82:0/124520063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd214162c30 0x7fd2140b59a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd208009840 tx=0x7fd208009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87aee6043844dfe0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.944+0000 7fd213e00700 1 -- 172.21.15.82:0/124520063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208011830 con 0x7fd214162c30 2024-05-10T04:50:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.944+0000 7fd213e00700 1 -- 172.21.15.82:0/124520063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208011990 con 0x7fd214162c30 2024-05-10T04:50:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.944+0000 7fd213e00700 1 -- 172.21.15.82:0/124520063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208011d20 con 0x7fd214162c30 2024-05-10T04:50:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.945+0000 7fd21c600700 1 -- 172.21.15.82:0/124520063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd214162c30 msgr2=0x7fd2140b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.945+0000 7fd21c600700 1 --2- 172.21.15.82:0/124520063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd214162c30 0x7fd2140b59a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd208009840 tx=0x7fd208009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.945+0000 7fd21c600700 1 -- 172.21.15.82:0/124520063 shutdown_connections 2024-05-10T04:50:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.945+0000 7fd21c600700 1 --2- 172.21.15.82:0/124520063 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd21415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.945+0000 7fd21c600700 1 --2- 172.21.15.82:0/124520063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd214162c30 0x7fd2140b59a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.945+0000 7fd21c600700 1 -- 172.21.15.82:0/124520063 >> 172.21.15.82:0/124520063 conn(0x7fd2140d0b80 msgr2=0x7fd2140d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.945+0000 7fd21c600700 1 -- 172.21.15.82:0/124520063 shutdown_connections 2024-05-10T04:50:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.945+0000 7fd21c600700 1 -- 172.21.15.82:0/124520063 wait complete. 2024-05-10T04:50:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.947+0000 7fd21c600700 1 Processor -- start 2024-05-10T04:50:27.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.947+0000 7fd21c600700 1 -- start start 2024-05-10T04:50:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.948+0000 7fd21c600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2140b5ee0 0x7fd214153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.948+0000 7fd21c600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd214155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd21c600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd214162c30 0x7fd214155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd21c600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c6f50 con 0x7fd2140b5ee0 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd21c600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141f4970 con 0x7fd214162c30 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd21c600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140cc040 con 0x7fd2140d2e60 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2140b5ee0 0x7fd214153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2140b5ee0 0x7fd214153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42684/0 (socket says 172.21.15.82:42684) 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 -- 172.21.15.82:0/1598557461 learned_addr learned my addr 172.21.15.82:0/1598557461 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219200700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd214155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 -- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 msgr2=0x7fd214155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd21a600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd214162c30 0x7fd214155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd214155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 -- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd214162c30 msgr2=0x7fd214155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd214162c30 0x7fd214155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 -- 172.21.15.82:0/1598557461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080094a0 con 0x7fd2140b5ee0 2024-05-10T04:50:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219200700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd214155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd21a600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd214162c30 0x7fd214155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.949+0000 7fd219c00700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2140b5ee0 0x7fd214153590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd2080090b0 tx=0x7fd208004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.950+0000 7fd211600700 1 -- 172.21.15.82:0/1598557461 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080038a0 con 0x7fd2140b5ee0 2024-05-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.950+0000 7fd211600700 1 -- 172.21.15.82:0/1598557461 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20801e070 con 0x7fd2140b5ee0 2024-05-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.950+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140cbd90 con 0x7fd2140b5ee0 2024-05-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.950+0000 7fd211600700 1 -- 172.21.15.82:0/1598557461 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208003c60 con 0x7fd2140b5ee0 2024-05-10T04:50:27.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.950+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2140cc290 con 0x7fd2140b5ee0 2024-05-10T04:50:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.951+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2140732b0 con 0x7fd2140b5ee0 2024-05-10T04:50:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.952+0000 7fd211600700 1 -- 172.21.15.82:0/1598557461 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd20801a420 con 0x7fd2140b5ee0 2024-05-10T04:50:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.953+0000 7fd211600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1f406acc0 0x7fd1f406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.953+0000 7fd211600700 1 -- 172.21.15.82:0/1598557461 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd20808a500 con 0x7fd2140b5ee0 2024-05-10T04:50:27.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.953+0000 7fd219200700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1f406acc0 0x7fd1f406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:27.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.953+0000 7fd219200700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1f406acc0 0x7fd1f406d1d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd200007fd0 tx=0x7fd200009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:27.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:27.957+0000 7fd211600700 1 -- 172.21.15.82:0/1598557461 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd208055770 con 0x7fd2140b5ee0 2024-05-10T04:50:28.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.156+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd214162150 con 0x7fd1f406acc0 2024-05-10T04:50:28.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.164+0000 7fd211600700 1 -- 172.21.15.82:0/1598557461 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264577 (secure 0 0 0) 0x7fd200001420 con 0x7fd1f406acc0 2024-05-10T04:50:28.170 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1f406acc0 msgr2=0x7fd1f406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1f406acc0 0x7fd1f406d1d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd200007fd0 tx=0x7fd200009040 comp rx=0 tx=0).stop 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2140b5ee0 msgr2=0x7fd214153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2140b5ee0 0x7fd214153590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd2080090b0 tx=0x7fd208004750 comp rx=0 tx=0).stop 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 shutdown_connections 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1f406acc0 0x7fd1f406d1d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd214162c30 0x7fd214155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2140b5ee0 0x7fd214153590 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 --2- 172.21.15.82:0/1598557461 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2140d2e60 0x7fd214155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 >> 172.21.15.82:0/1598557461 conn(0x7fd2140d0b80 msgr2=0x7fd21415ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 shutdown_connections 2024-05-10T04:50:28.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.168+0000 7fd21c600700 1 -- 172.21.15.82:0/1598557461 wait complete. 2024-05-10T04:50:28.174 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:50:28.196 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-10T04:50:26.971115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219100,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755620,"statfs":{"total":773094113280,"available":772869754880,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002106"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317468+0000","last_change":"2024-05-10T04:50:16.116571+0000","last_active":"2024-05-10T04:50:17.317468+0000","last_peered":"2024-05-10T04:50:17.317468+0000","last_clean":"2024-05-10T04:50:17.317468+0000","last_became_active":"2024-05-10T04:50:16.114134+0000","last_became_peered":"2024-05-10T04:50:16.114134+0000","last_unstale":"2024-05-10T04:50:17.317468+0000","last_undegraded":"2024-05-10T04:50:17.317468+0000","last_fullsized":"2024-05-10T04:50:17.317468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:48.157294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076993+0000","last_change":"2024-05-10T04:50:16.105444+0000","last_active":"2024-05-10T04:50:17.076993+0000","last_peered":"2024-05-10T04:50:17.076993+0000","last_clean":"2024-05-10T04:50:17.076993+0000","last_became_active":"2024-05-10T04:50:16.105168+0000","last_became_peered":"2024-05-10T04:50:16.105168+0000","last_unstale":"2024-05-10T04:50:17.076993+0000","last_undegraded":"2024-05-10T04:50:17.076993+0000","last_fullsized":"2024-05-10T04:50:17.076993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315713+0000","last_change":"2024-05-10T04:50:16.095062+0000","last_active":"2024-05-10T04:50:17.315713+0000","last_peered":"2024-05-10T04:50:17.315713+0000","last_clean":"2024-05-10T04:50:17.315713+0000","last_became_active":"2024-05-10T04:50:16.094786+0000","last_became_peered":"2024-05-10T04:50:16.094786+0000","last_unstale":"2024-05-10T04:50:17.315713+0000","last_undegraded":"2024-05-10T04:50:17.315713+0000","last_fullsized":"2024-05-10T04:50:17.315713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:41:32.856707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077027+0000","last_change":"2024-05-10T04:50:16.105222+0000","last_active":"2024-05-10T04:50:17.077027+0000","last_peered":"2024-05-10T04:50:17.077027+0000","last_clean":"2024-05-10T04:50:17.077027+0000","last_became_active":"2024-05-10T04:50:16.104534+0000","last_became_peered":"2024-05-10T04:50:16.104534+0000","last_unstale":"2024-05-10T04:50:17.077027+0000","last_undegraded":"2024-05-10T04:50:17.077027+0000","last_fullsized":"2024-05-10T04:50:17.077027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:13.581090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316177+0000","last_change":"2024-05-10T04:50:16.116857+0000","last_active":"2024-05-10T04:50:17.316177+0000","last_peered":"2024-05-10T04:50:17.316177+0000","last_clean":"2024-05-10T04:50:17.316177+0000","last_became_active":"2024-05-10T04:50:16.114914+0000","last_became_peered":"2024-05-10T04:50:16.114914+0000","last_unstale":"2024-05-10T04:50:17.316177+0000","last_undegraded":"2024-05-10T04:50:17.316177+0000","last_fullsized":"2024-05-10T04:50:17.316177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076793+0000","last_change":"2024-05-10T04:50:16.092687+0000","last_active":"2024-05-10T04:50:17.076793+0000","last_peered":"2024-05-10T04:50:17.076793+0000","last_clean":"2024-05-10T04:50:17.076793+0000","last_became_active":"2024-05-10T04:50:16.092377+0000","last_became_peered":"2024-05-10T04:50:16.092377+0000","last_unstale":"2024-05-10T04:50:17.076793+0000","last_undegraded":"2024-05-10T04:50:17.076793+0000","last_fullsized":"2024-05-10T04:50:17.076793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316827+0000","last_change":"2024-05-10T04:50:16.112968+0000","last_active":"2024-05-10T04:50:17.316827+0000","last_peered":"2024-05-10T04:50:17.316827+0000","last_clean":"2024-05-10T04:50:17.316827+0000","last_became_active":"2024-05-10T04:50:16.112691+0000","last_became_peered":"2024-05-10T04:50:16.112691+0000","last_unstale":"2024-05-10T04:50:17.316827+0000","last_undegraded":"2024-05-10T04:50:17.316827+0000","last_fullsized":"2024-05-10T04:50:17.316827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:32:24.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315078+0000","last_change":"2024-05-10T04:50:16.104549+0000","last_active":"2024-05-10T04:50:17.315078+0000","last_peered":"2024-05-10T04:50:17.315078+0000","last_clean":"2024-05-10T04:50:17.315078+0000","last_became_active":"2024-05-10T04:50:16.104213+0000","last_became_peered":"2024-05-10T04:50:16.104213+0000","last_unstale":"2024-05-10T04:50:17.315078+0000","last_undegraded":"2024-05-10T04:50:17.315078+0000","last_fullsized":"2024-05-10T04:50:17.315078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317412+0000","last_change":"2024-05-10T04:50:16.118415+0000","last_active":"2024-05-10T04:50:17.317412+0000","last_peered":"2024-05-10T04:50:17.317412+0000","last_clean":"2024-05-10T04:50:17.317412+0000","last_became_active":"2024-05-10T04:50:16.118045+0000","last_became_peered":"2024-05-10T04:50:16.118045+0000","last_unstale":"2024-05-10T04:50:17.317412+0000","last_undegraded":"2024-05-10T04:50:17.317412+0000","last_fullsized":"2024-05-10T04:50:17.317412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:07.192432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316747+0000","last_change":"2024-05-10T04:50:16.108768+0000","last_active":"2024-05-10T04:50:17.316747+0000","last_peered":"2024-05-10T04:50:17.316747+0000","last_clean":"2024-05-10T04:50:17.316747+0000","last_became_active":"2024-05-10T04:50:16.108457+0000","last_became_peered":"2024-05-10T04:50:16.108457+0000","last_unstale":"2024-05-10T04:50:17.316747+0000","last_undegraded":"2024-05-10T04:50:17.316747+0000","last_fullsized":"2024-05-10T04:50:17.316747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315861+0000","last_change":"2024-05-10T04:50:16.119907+0000","last_active":"2024-05-10T04:50:17.315861+0000","last_peered":"2024-05-10T04:50:17.315861+0000","last_clean":"2024-05-10T04:50:17.315861+0000","last_became_active":"2024-05-10T04:50:16.119573+0000","last_became_peered":"2024-05-10T04:50:16.119573+0000","last_unstale":"2024-05-10T04:50:17.315861+0000","last_undegraded":"2024-05-10T04:50:17.315861+0000","last_fullsized":"2024-05-10T04:50:17.315861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316976+0000","last_change":"2024-05-10T04:50:16.096302+0000","last_active":"2024-05-10T04:50:17.316976+0000","last_peered":"2024-05-10T04:50:17.316976+0000","last_clean":"2024-05-10T04:50:17.316976+0000","last_became_active":"2024-05-10T04:50:16.095997+0000","last_became_peered":"2024-05-10T04:50:16.095997+0000","last_unstale":"2024-05-10T04:50:17.316976+0000","last_undegraded":"2024-05-10T04:50:17.316976+0000","last_fullsized":"2024-05-10T04:50:17.316976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:25.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315424+0000","last_change":"2024-05-10T04:50:16.106646+0000","last_active":"2024-05-10T04:50:17.315424+0000","last_peered":"2024-05-10T04:50:17.315424+0000","last_clean":"2024-05-10T04:50:17.315424+0000","last_became_active":"2024-05-10T04:50:16.106365+0000","last_became_peered":"2024-05-10T04:50:16.106365+0000","last_unstale":"2024-05-10T04:50:17.315424+0000","last_undegraded":"2024-05-10T04:50:17.315424+0000","last_fullsized":"2024-05-10T04:50:17.315424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315522+0000","last_change":"2024-05-10T04:50:16.091792+0000","last_active":"2024-05-10T04:50:17.315522+0000","last_peered":"2024-05-10T04:50:17.315522+0000","last_clean":"2024-05-10T04:50:17.315522+0000","last_became_active":"2024-05-10T04:50:16.091437+0000","last_became_peered":"2024-05-10T04:50:16.091437+0000","last_unstale":"2024-05-10T04:50:17.315522+0000","last_undegraded":"2024-05-10T04:50:17.315522+0000","last_fullsized":"2024-05-10T04:50:17.315522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076423+0000","last_change":"2024-05-10T04:50:16.106200+0000","last_active":"2024-05-10T04:50:17.076423+0000","last_peered":"2024-05-10T04:50:17.076423+0000","last_clean":"2024-05-10T04:50:17.076423+0000","last_became_active":"2024-05-10T04:50:16.099204+0000","last_became_peered":"2024-05-10T04:50:16.099204+0000","last_unstale":"2024-05-10T04:50:17.076423+0000","last_undegraded":"2024-05-10T04:50:17.076423+0000","last_fullsized":"2024-05-10T04:50:17.076423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076460+0000","last_change":"2024-05-10T04:50:16.091018+0000","last_active":"2024-05-10T04:50:17.076460+0000","last_peered":"2024-05-10T04:50:17.076460+0000","last_clean":"2024-05-10T04:50:17.076460+0000","last_became_active":"2024-05-10T04:50:16.090683+0000","last_became_peered":"2024-05-10T04:50:16.090683+0000","last_unstale":"2024-05-10T04:50:17.076460+0000","last_undegraded":"2024-05-10T04:50:17.076460+0000","last_fullsized":"2024-05-10T04:50:17.076460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077320+0000","last_change":"2024-05-10T04:50:16.100477+0000","last_active":"2024-05-10T04:50:17.077320+0000","last_peered":"2024-05-10T04:50:17.077320+0000","last_clean":"2024-05-10T04:50:17.077320+0000","last_became_active":"2024-05-10T04:50:16.099915+0000","last_became_peered":"2024-05-10T04:50:16.099915+0000","last_unstale":"2024-05-10T04:50:17.077320+0000","last_undegraded":"2024-05-10T04:50:17.077320+0000","last_fullsized":"2024-05-10T04:50:17.077320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:32:24.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077731+0000","last_change":"2024-05-10T04:50:16.100503+0000","last_active":"2024-05-10T04:50:17.077731+0000","last_peered":"2024-05-10T04:50:17.077731+0000","last_clean":"2024-05-10T04:50:17.077731+0000","last_became_active":"2024-05-10T04:50:16.100054+0000","last_became_peered":"2024-05-10T04:50:16.100054+0000","last_unstale":"2024-05-10T04:50:17.077731+0000","last_undegraded":"2024-05-10T04:50:17.077731+0000","last_fullsized":"2024-05-10T04:50:17.077731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317151+0000","last_change":"2024-05-10T04:50:16.111998+0000","last_active":"2024-05-10T04:50:17.317151+0000","last_peered":"2024-05-10T04:50:17.317151+0000","last_clean":"2024-05-10T04:50:17.317151+0000","last_became_active":"2024-05-10T04:50:16.111151+0000","last_became_peered":"2024-05-10T04:50:16.111151+0000","last_unstale":"2024-05-10T04:50:17.317151+0000","last_undegraded":"2024-05-10T04:50:17.317151+0000","last_fullsized":"2024-05-10T04:50:17.317151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.659081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316335+0000","last_change":"2024-05-10T04:50:15.516274+0000","last_active":"2024-05-10T04:50:17.316335+0000","last_peered":"2024-05-10T04:50:17.316335+0000","last_clean":"2024-05-10T04:50:17.316335+0000","last_became_active":"2024-05-10T04:50:15.515938+0000","last_became_peered":"2024-05-10T04:50:15.515938+0000","last_unstale":"2024-05-10T04:50:17.316335+0000","last_undegraded":"2024-05-10T04:50:17.316335+0000","last_fullsized":"2024-05-10T04:50:17.316335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.492940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315956+0000","last_change":"2024-05-10T04:50:16.103965+0000","last_active":"2024-05-10T04:50:17.315956+0000","last_peered":"2024-05-10T04:50:17.315956+0000","last_clean":"2024-05-10T04:50:17.315956+0000","last_became_active":"2024-05-10T04:50:16.100297+0000","last_became_peered":"2024-05-10T04:50:16.100297+0000","last_unstale":"2024-05-10T04:50:17.315956+0000","last_undegraded":"2024-05-10T04:50:17.315956+0000","last_fullsized":"2024-05-10T04:50:17.315956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316052+0000","last_change":"2024-05-10T04:50:15.511208+0000","last_active":"2024-05-10T04:50:17.316052+0000","last_peered":"2024-05-10T04:50:17.316052+0000","last_clean":"2024-05-10T04:50:17.316052+0000","last_became_active":"2024-05-10T04:50:15.510946+0000","last_became_peered":"2024-05-10T04:50:15.510946+0000","last_unstale":"2024-05-10T04:50:17.316052+0000","last_undegraded":"2024-05-10T04:50:17.316052+0000","last_fullsized":"2024-05-10T04:50:17.316052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.492940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316317+0000","last_change":"2024-05-10T04:50:16.103854+0000","last_active":"2024-05-10T04:50:17.316317+0000","last_peered":"2024-05-10T04:50:17.316317+0000","last_clean":"2024-05-10T04:50:17.316317+0000","last_became_active":"2024-05-10T04:50:16.103319+0000","last_became_peered":"2024-05-10T04:50:16.103319+0000","last_unstale":"2024-05-10T04:50:17.316317+0000","last_undegraded":"2024-05-10T04:50:17.316317+0000","last_fullsized":"2024-05-10T04:50:17.316317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:02.917774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317628+0000","last_change":"2024-05-10T04:50:15.520375+0000","last_active":"2024-05-10T04:50:17.317628+0000","last_peered":"2024-05-10T04:50:17.317628+0000","last_clean":"2024-05-10T04:50:17.317628+0000","last_became_active":"2024-05-10T04:50:15.520023+0000","last_became_peered":"2024-05-10T04:50:15.520023+0000","last_unstale":"2024-05-10T04:50:17.317628+0000","last_undegraded":"2024-05-10T04:50:17.317628+0000","last_fullsized":"2024-05-10T04:50:17.317628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076711+0000","last_change":"2024-05-10T04:50:16.092652+0000","last_active":"2024-05-10T04:50:17.076711+0000","last_peered":"2024-05-10T04:50:17.076711+0000","last_clean":"2024-05-10T04:50:17.076711+0000","last_became_active":"2024-05-10T04:50:16.092325+0000","last_became_peered":"2024-05-10T04:50:16.092325+0000","last_unstale":"2024-05-10T04:50:17.076711+0000","last_undegraded":"2024-05-10T04:50:17.076711+0000","last_fullsized":"2024-05-10T04:50:17.076711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317137+0000","last_change":"2024-05-10T04:50:15.519068+0000","last_active":"2024-05-10T04:50:17.317137+0000","last_peered":"2024-05-10T04:50:17.317137+0000","last_clean":"2024-05-10T04:50:17.317137+0000","last_became_active":"2024-05-10T04:50:15.518747+0000","last_became_peered":"2024-05-10T04:50:15.518747+0000","last_unstale":"2024-05-10T04:50:17.317137+0000","last_undegraded":"2024-05-10T04:50:17.317137+0000","last_fullsized":"2024-05-10T04:50:17.317137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:35.682289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077225+0000","last_change":"2024-05-10T04:50:16.105958+0000","last_active":"2024-05-10T04:50:17.077225+0000","last_peered":"2024-05-10T04:50:17.077225+0000","last_clean":"2024-05-10T04:50:17.077225+0000","last_became_active":"2024-05-10T04:50:16.104254+0000","last_became_peered":"2024-05-10T04:50:16.104254+0000","last_unstale":"2024-05-10T04:50:17.077225+0000","last_undegraded":"2024-05-10T04:50:17.077225+0000","last_fullsized":"2024-05-10T04:50:17.077225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.659081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315602+0000","last_change":"2024-05-10T04:50:15.517690+0000","last_active":"2024-05-10T04:50:17.315602+0000","last_peered":"2024-05-10T04:50:17.315602+0000","last_clean":"2024-05-10T04:50:17.315602+0000","last_became_active":"2024-05-10T04:50:15.517371+0000","last_became_peered":"2024-05-10T04:50:15.517371+0000","last_unstale":"2024-05-10T04:50:17.315602+0000","last_undegraded":"2024-05-10T04:50:17.315602+0000","last_fullsized":"2024-05-10T04:50:17.315602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316653+0000","last_change":"2024-05-10T04:50:16.093622+0000","last_active":"2024-05-10T04:50:17.316653+0000","last_peered":"2024-05-10T04:50:17.316653+0000","last_clean":"2024-05-10T04:50:17.316653+0000","last_became_active":"2024-05-10T04:50:16.093266+0000","last_became_peered":"2024-05-10T04:50:16.093266+0000","last_unstale":"2024-05-10T04:50:17.316653+0000","last_undegraded":"2024-05-10T04:50:17.316653+0000","last_fullsized":"2024-05-10T04:50:17.316653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316221+0000","last_change":"2024-05-10T04:50:15.518189+0000","last_active":"2024-05-10T04:50:17.316221+0000","last_peered":"2024-05-10T04:50:17.316221+0000","last_clean":"2024-05-10T04:50:17.316221+0000","last_became_active":"2024-05-10T04:50:15.517697+0000","last_became_peered":"2024-05-10T04:50:15.517697+0000","last_unstale":"2024-05-10T04:50:17.316221+0000","last_undegraded":"2024-05-10T04:50:17.316221+0000","last_fullsized":"2024-05-10T04:50:17.316221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316057+0000","last_change":"2024-05-10T04:50:16.096819+0000","last_active":"2024-05-10T04:50:17.316057+0000","last_peered":"2024-05-10T04:50:17.316057+0000","last_clean":"2024-05-10T04:50:17.316057+0000","last_became_active":"2024-05-10T04:50:16.096295+0000","last_became_peered":"2024-05-10T04:50:16.096295+0000","last_unstale":"2024-05-10T04:50:17.316057+0000","last_undegraded":"2024-05-10T04:50:17.316057+0000","last_fullsized":"2024-05-10T04:50:17.316057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:25.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315314+0000","last_change":"2024-05-10T04:50:15.506725+0000","last_active":"2024-05-10T04:50:17.315314+0000","last_peered":"2024-05-10T04:50:17.315314+0000","last_clean":"2024-05-10T04:50:17.315314+0000","last_became_active":"2024-05-10T04:50:15.504725+0000","last_became_peered":"2024-05-10T04:50:15.504725+0000","last_unstale":"2024-05-10T04:50:17.315314+0000","last_undegraded":"2024-05-10T04:50:17.315314+0000","last_fullsized":"2024-05-10T04:50:17.315314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:30:20.860044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315294+0000","last_change":"2024-05-10T04:50:16.090939+0000","last_active":"2024-05-10T04:50:17.315294+0000","last_peered":"2024-05-10T04:50:17.315294+0000","last_clean":"2024-05-10T04:50:17.315294+0000","last_became_active":"2024-05-10T04:50:16.090673+0000","last_became_peered":"2024-05-10T04:50:16.090673+0000","last_unstale":"2024-05-10T04:50:17.315294+0000","last_undegraded":"2024-05-10T04:50:17.315294+0000","last_fullsized":"2024-05-10T04:50:17.315294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076581+0000","last_change":"2024-05-10T04:50:15.513992+0000","last_active":"2024-05-10T04:50:17.076581+0000","last_peered":"2024-05-10T04:50:17.076581+0000","last_clean":"2024-05-10T04:50:17.076581+0000","last_became_active":"2024-05-10T04:50:15.512537+0000","last_became_peered":"2024-05-10T04:50:15.512537+0000","last_unstale":"2024-05-10T04:50:17.076581+0000","last_undegraded":"2024-05-10T04:50:17.076581+0000","last_fullsized":"2024-05-10T04:50:17.076581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076497+0000","last_change":"2024-05-10T04:50:16.104592+0000","last_active":"2024-05-10T04:50:17.076497+0000","last_peered":"2024-05-10T04:50:17.076497+0000","last_clean":"2024-05-10T04:50:17.076497+0000","last_became_active":"2024-05-10T04:50:16.104262+0000","last_became_peered":"2024-05-10T04:50:16.104262+0000","last_unstale":"2024-05-10T04:50:17.076497+0000","last_undegraded":"2024-05-10T04:50:17.076497+0000","last_fullsized":"2024-05-10T04:50:17.076497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317517+0000","last_change":"2024-05-10T04:50:15.514321+0000","last_active":"2024-05-10T04:50:17.317517+0000","last_peered":"2024-05-10T04:50:17.317517+0000","last_clean":"2024-05-10T04:50:17.317517+0000","last_became_active":"2024-05-10T04:50:15.514125+0000","last_became_peered":"2024-05-10T04:50:15.514125+0000","last_unstale":"2024-05-10T04:50:17.317517+0000","last_undegraded":"2024-05-10T04:50:17.317517+0000","last_fullsized":"2024-05-10T04:50:17.317517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077233+0000","last_change":"2024-05-10T04:50:16.096429+0000","last_active":"2024-05-10T04:50:17.077233+0000","last_peered":"2024-05-10T04:50:17.077233+0000","last_clean":"2024-05-10T04:50:17.077233+0000","last_became_active":"2024-05-10T04:50:16.095555+0000","last_became_peered":"2024-05-10T04:50:16.095555+0000","last_unstale":"2024-05-10T04:50:17.077233+0000","last_undegraded":"2024-05-10T04:50:17.077233+0000","last_fullsized":"2024-05-10T04:50:17.077233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:31.537019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077087+0000","last_change":"2024-05-10T04:50:15.513574+0000","last_active":"2024-05-10T04:50:17.077087+0000","last_peered":"2024-05-10T04:50:17.077087+0000","last_clean":"2024-05-10T04:50:17.077087+0000","last_became_active":"2024-05-10T04:50:15.513121+0000","last_became_peered":"2024-05-10T04:50:15.513121+0000","last_unstale":"2024-05-10T04:50:17.077087+0000","last_undegraded":"2024-05-10T04:50:17.077087+0000","last_fullsized":"2024-05-10T04:50:17.077087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316443+0000","last_change":"2024-05-10T04:50:16.090959+0000","last_active":"2024-05-10T04:50:17.316443+0000","last_peered":"2024-05-10T04:50:17.316443+0000","last_clean":"2024-05-10T04:50:17.316443+0000","last_became_active":"2024-05-10T04:50:16.090673+0000","last_became_peered":"2024-05-10T04:50:16.090673+0000","last_unstale":"2024-05-10T04:50:17.316443+0000","last_undegraded":"2024-05-10T04:50:17.316443+0000","last_fullsized":"2024-05-10T04:50:17.316443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:36.689058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077005+0000","last_change":"2024-05-10T04:50:15.515867+0000","last_active":"2024-05-10T04:50:17.077005+0000","last_peered":"2024-05-10T04:50:17.077005+0000","last_clean":"2024-05-10T04:50:17.077005+0000","last_became_active":"2024-05-10T04:50:15.515578+0000","last_became_peered":"2024-05-10T04:50:15.515578+0000","last_unstale":"2024-05-10T04:50:17.077005+0000","last_undegraded":"2024-05-10T04:50:17.077005+0000","last_fullsized":"2024-05-10T04:50:17.077005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:25.114763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316807+0000","last_change":"2024-05-10T04:50:16.094129+0000","last_active":"2024-05-10T04:50:17.316807+0000","last_peered":"2024-05-10T04:50:17.316807+0000","last_clean":"2024-05-10T04:50:17.316807+0000","last_became_active":"2024-05-10T04:50:16.093853+0000","last_became_peered":"2024-05-10T04:50:16.093853+0000","last_unstale":"2024-05-10T04:50:17.316807+0000","last_undegraded":"2024-05-10T04:50:17.316807+0000","last_fullsized":"2024-05-10T04:50:17.316807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:01.772418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315820+0000","last_change":"2024-05-10T04:50:15.507954+0000","last_active":"2024-05-10T04:50:17.315820+0000","last_peered":"2024-05-10T04:50:17.315820+0000","last_clean":"2024-05-10T04:50:17.315820+0000","last_became_active":"2024-05-10T04:50:15.507504+0000","last_became_peered":"2024-05-10T04:50:15.507504+0000","last_unstale":"2024-05-10T04:50:17.315820+0000","last_undegraded":"2024-05-10T04:50:17.315820+0000","last_fullsized":"2024-05-10T04:50:17.315820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:57.162592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317277+0000","last_change":"2024-05-10T04:50:16.112035+0000","last_active":"2024-05-10T04:50:17.317277+0000","last_peered":"2024-05-10T04:50:17.317277+0000","last_clean":"2024-05-10T04:50:17.317277+0000","last_became_active":"2024-05-10T04:50:16.111519+0000","last_became_peered":"2024-05-10T04:50:16.111519+0000","last_unstale":"2024-05-10T04:50:17.317277+0000","last_undegraded":"2024-05-10T04:50:17.317277+0000","last_fullsized":"2024-05-10T04:50:17.317277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:24:01.388216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315966+0000","last_change":"2024-05-10T04:50:15.497940+0000","last_active":"2024-05-10T04:50:17.315966+0000","last_peered":"2024-05-10T04:50:17.315966+0000","last_clean":"2024-05-10T04:50:17.315966+0000","last_became_active":"2024-05-10T04:50:15.496471+0000","last_became_peered":"2024-05-10T04:50:15.496471+0000","last_unstale":"2024-05-10T04:50:17.315966+0000","last_undegraded":"2024-05-10T04:50:17.315966+0000","last_fullsized":"2024-05-10T04:50:17.315966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:51.200540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315426+0000","last_change":"2024-05-10T04:50:16.107065+0000","last_active":"2024-05-10T04:50:17.315426+0000","last_peered":"2024-05-10T04:50:17.315426+0000","last_clean":"2024-05-10T04:50:17.315426+0000","last_became_active":"2024-05-10T04:50:16.106704+0000","last_became_peered":"2024-05-10T04:50:16.106704+0000","last_unstale":"2024-05-10T04:50:17.315426+0000","last_undegraded":"2024-05-10T04:50:17.315426+0000","last_fullsized":"2024-05-10T04:50:17.315426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:55.406199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077139+0000","last_change":"2024-05-10T04:50:15.512673+0000","last_active":"2024-05-10T04:50:17.077139+0000","last_peered":"2024-05-10T04:50:17.077139+0000","last_clean":"2024-05-10T04:50:17.077139+0000","last_became_active":"2024-05-10T04:50:15.509967+0000","last_became_peered":"2024-05-10T04:50:15.509967+0000","last_unstale":"2024-05-10T04:50:17.077139+0000","last_undegraded":"2024-05-10T04:50:17.077139+0000","last_fullsized":"2024-05-10T04:50:17.077139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:50:53.486663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317332+0000","last_change":"2024-05-10T04:50:16.117728+0000","last_active":"2024-05-10T04:50:17.317332+0000","last_peered":"2024-05-10T04:50:17.317332+0000","last_clean":"2024-05-10T04:50:17.317332+0000","last_became_active":"2024-05-10T04:50:16.117328+0000","last_became_peered":"2024-05-10T04:50:16.117328+0000","last_unstale":"2024-05-10T04:50:17.317332+0000","last_undegraded":"2024-05-10T04:50:17.317332+0000","last_fullsized":"2024-05-10T04:50:17.317332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:13.581090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315668+0000","last_change":"2024-05-10T04:50:15.505534+0000","last_active":"2024-05-10T04:50:17.315668+0000","last_peered":"2024-05-10T04:50:17.315668+0000","last_clean":"2024-05-10T04:50:17.315668+0000","last_became_active":"2024-05-10T04:50:15.505204+0000","last_became_peered":"2024-05-10T04:50:15.505204+0000","last_unstale":"2024-05-10T04:50:17.315668+0000","last_undegraded":"2024-05-10T04:50:17.315668+0000","last_fullsized":"2024-05-10T04:50:17.315668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315762+0000","last_change":"2024-05-10T04:50:16.107456+0000","last_active":"2024-05-10T04:50:17.315762+0000","last_peered":"2024-05-10T04:50:17.315762+0000","last_clean":"2024-05-10T04:50:17.315762+0000","last_became_active":"2024-05-10T04:50:16.107101+0000","last_became_peered":"2024-05-10T04:50:16.107101+0000","last_unstale":"2024-05-10T04:50:17.315762+0000","last_undegraded":"2024-05-10T04:50:17.315762+0000","last_fullsized":"2024-05-10T04:50:17.315762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077555+0000","last_change":"2024-05-10T04:50:15.510534+0000","last_active":"2024-05-10T04:50:17.077555+0000","last_peered":"2024-05-10T04:50:17.077555+0000","last_clean":"2024-05-10T04:50:17.077555+0000","last_became_active":"2024-05-10T04:50:15.510203+0000","last_became_peered":"2024-05-10T04:50:15.510203+0000","last_unstale":"2024-05-10T04:50:17.077555+0000","last_undegraded":"2024-05-10T04:50:17.077555+0000","last_fullsized":"2024-05-10T04:50:17.077555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:30:20.860044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316071+0000","last_change":"2024-05-10T04:50:16.116503+0000","last_active":"2024-05-10T04:50:17.316071+0000","last_peered":"2024-05-10T04:50:17.316071+0000","last_clean":"2024-05-10T04:50:17.316071+0000","last_became_active":"2024-05-10T04:50:16.116218+0000","last_became_peered":"2024-05-10T04:50:16.116218+0000","last_unstale":"2024-05-10T04:50:17.316071+0000","last_undegraded":"2024-05-10T04:50:17.316071+0000","last_fullsized":"2024-05-10T04:50:17.316071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:43:59.737316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317154+0000","last_change":"2024-05-10T04:50:15.507067+0000","last_active":"2024-05-10T04:50:17.317154+0000","last_peered":"2024-05-10T04:50:17.317154+0000","last_clean":"2024-05-10T04:50:17.317154+0000","last_became_active":"2024-05-10T04:50:15.506306+0000","last_became_peered":"2024-05-10T04:50:15.506306+0000","last_unstale":"2024-05-10T04:50:17.317154+0000","last_undegraded":"2024-05-10T04:50:17.317154+0000","last_fullsized":"2024-05-10T04:50:17.317154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:28:51.200540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317588+0000","last_change":"2024-05-10T04:50:16.112236+0000","last_active":"2024-05-10T04:50:17.317588+0000","last_peered":"2024-05-10T04:50:17.317588+0000","last_clean":"2024-05-10T04:50:17.317588+0000","last_became_active":"2024-05-10T04:50:16.111551+0000","last_became_peered":"2024-05-10T04:50:16.111551+0000","last_unstale":"2024-05-10T04:50:17.317588+0000","last_undegraded":"2024-05-10T04:50:17.317588+0000","last_fullsized":"2024-05-10T04:50:17.317588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:02.230401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076869+0000","last_change":"2024-05-10T04:50:15.511205+0000","last_active":"2024-05-10T04:50:17.076869+0000","last_peered":"2024-05-10T04:50:17.076869+0000","last_clean":"2024-05-10T04:50:17.076869+0000","last_became_active":"2024-05-10T04:50:15.510947+0000","last_became_peered":"2024-05-10T04:50:15.510947+0000","last_unstale":"2024-05-10T04:50:17.076869+0000","last_undegraded":"2024-05-10T04:50:17.076869+0000","last_fullsized":"2024-05-10T04:50:17.076869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:57.162592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077176+0000","last_change":"2024-05-10T04:50:16.101982+0000","last_active":"2024-05-10T04:50:17.077176+0000","last_peered":"2024-05-10T04:50:17.077176+0000","last_clean":"2024-05-10T04:50:17.077176+0000","last_became_active":"2024-05-10T04:50:16.092143+0000","last_became_peered":"2024-05-10T04:50:16.092143+0000","last_unstale":"2024-05-10T04:50:17.077176+0000","last_undegraded":"2024-05-10T04:50:17.077176+0000","last_fullsized":"2024-05-10T04:50:17.077176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:24:01.388216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076958+0000","last_change":"2024-05-10T04:50:15.509745+0000","last_active":"2024-05-10T04:50:17.076958+0000","last_peered":"2024-05-10T04:50:17.076958+0000","last_clean":"2024-05-10T04:50:17.076958+0000","last_became_active":"2024-05-10T04:50:15.509429+0000","last_became_peered":"2024-05-10T04:50:15.509429+0000","last_unstale":"2024-05-10T04:50:17.076958+0000","last_undegraded":"2024-05-10T04:50:17.076958+0000","last_fullsized":"2024-05-10T04:50:17.076958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:37.683206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316304+0000","last_change":"2024-05-10T04:50:16.091478+0000","last_active":"2024-05-10T04:50:17.316304+0000","last_peered":"2024-05-10T04:50:17.316304+0000","last_clean":"2024-05-10T04:50:17.316304+0000","last_became_active":"2024-05-10T04:50:16.091245+0000","last_became_peered":"2024-05-10T04:50:16.091245+0000","last_unstale":"2024-05-10T04:50:17.316304+0000","last_undegraded":"2024-05-10T04:50:17.316304+0000","last_fullsized":"2024-05-10T04:50:17.316304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:26.121531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076468+0000","last_change":"2024-05-10T04:50:16.093555+0000","last_active":"2024-05-10T04:50:17.076468+0000","last_peered":"2024-05-10T04:50:17.076468+0000","last_clean":"2024-05-10T04:50:17.076468+0000","last_became_active":"2024-05-10T04:50:16.093088+0000","last_became_peered":"2024-05-10T04:50:16.093088+0000","last_unstale":"2024-05-10T04:50:17.076468+0000","last_undegraded":"2024-05-10T04:50:17.076468+0000","last_fullsized":"2024-05-10T04:50:17.076468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077611+0000","last_change":"2024-05-10T04:50:15.509023+0000","last_active":"2024-05-10T04:50:17.077611+0000","last_peered":"2024-05-10T04:50:17.077611+0000","last_clean":"2024-05-10T04:50:17.077611+0000","last_became_active":"2024-05-10T04:50:15.508723+0000","last_became_peered":"2024-05-10T04:50:15.508723+0000","last_unstale":"2024-05-10T04:50:17.077611+0000","last_undegraded":"2024-05-10T04:50:17.077611+0000","last_fullsized":"2024-05-10T04:50:17.077611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T04:50:53.486663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315481+0000","last_change":"2024-05-10T04:50:16.108380+0000","last_active":"2024-05-10T04:50:17.315481+0000","last_peered":"2024-05-10T04:50:17.315481+0000","last_clean":"2024-05-10T04:50:17.315481+0000","last_became_active":"2024-05-10T04:50:16.107863+0000","last_became_peered":"2024-05-10T04:50:16.107863+0000","last_unstale":"2024-05-10T04:50:17.315481+0000","last_undegraded":"2024-05-10T04:50:17.315481+0000","last_fullsized":"2024-05-10T04:50:17.315481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076863+0000","last_change":"2024-05-10T04:50:15.505795+0000","last_active":"2024-05-10T04:50:17.076863+0000","last_peered":"2024-05-10T04:50:17.076863+0000","last_clean":"2024-05-10T04:50:17.076863+0000","last_became_active":"2024-05-10T04:50:15.503636+0000","last_became_peered":"2024-05-10T04:50:15.503636+0000","last_unstale":"2024-05-10T04:50:17.076863+0000","last_undegraded":"2024-05-10T04:50:17.076863+0000","last_fullsized":"2024-05-10T04:50:17.076863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-10T04:50:16.094417+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:50:16.094417+0000","last_peered":"2024-05-10T04:50:16.094417+0000","last_clean":"2024-05-10T04:50:16.094417+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:50:16.094417+0000","last_undegraded":"2024-05-10T04:50:16.094417+0000","last_fullsized":"2024-05-10T04:50:16.094417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315146+0000","last_change":"2024-05-10T04:50:16.092439+0000","last_active":"2024-05-10T04:50:17.315146+0000","last_peered":"2024-05-10T04:50:17.315146+0000","last_clean":"2024-05-10T04:50:17.315146+0000","last_became_active":"2024-05-10T04:50:16.092165+0000","last_became_peered":"2024-05-10T04:50:16.092165+0000","last_unstale":"2024-05-10T04:50:17.315146+0000","last_undegraded":"2024-05-10T04:50:17.315146+0000","last_fullsized":"2024-05-10T04:50:17.315146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:26.805209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315978+0000","last_change":"2024-05-10T04:50:15.523201+0000","last_active":"2024-05-10T04:50:17.315978+0000","last_peered":"2024-05-10T04:50:17.315978+0000","last_clean":"2024-05-10T04:50:17.315978+0000","last_became_active":"2024-05-10T04:50:15.522923+0000","last_became_peered":"2024-05-10T04:50:15.522923+0000","last_unstale":"2024-05-10T04:50:17.315978+0000","last_undegraded":"2024-05-10T04:50:17.315978+0000","last_fullsized":"2024-05-10T04:50:17.315978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317655+0000","last_change":"2024-05-10T04:50:15.520251+0000","last_active":"2024-05-10T04:50:17.317655+0000","last_peered":"2024-05-10T04:50:17.317655+0000","last_clean":"2024-05-10T04:50:17.317655+0000","last_became_active":"2024-05-10T04:50:15.519958+0000","last_became_peered":"2024-05-10T04:50:15.519958+0000","last_unstale":"2024-05-10T04:50:17.317655+0000","last_undegraded":"2024-05-10T04:50:17.317655+0000","last_fullsized":"2024-05-10T04:50:17.317655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:15.316078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076829+0000","last_change":"2024-05-10T04:50:16.094812+0000","last_active":"2024-05-10T04:50:17.076829+0000","last_peered":"2024-05-10T04:50:17.076829+0000","last_clean":"2024-05-10T04:50:17.076829+0000","last_became_active":"2024-05-10T04:50:16.093699+0000","last_became_peered":"2024-05-10T04:50:16.093699+0000","last_unstale":"2024-05-10T04:50:17.076829+0000","last_undegraded":"2024-05-10T04:50:17.076829+0000","last_fullsized":"2024-05-10T04:50:17.076829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:19.042352+0000","last_change":"2024-05-10T04:50:15.514342+0000","last_active":"2024-05-10T04:50:19.042352+0000","last_peered":"2024-05-10T04:50:19.042352+0000","last_clean":"2024-05-10T04:50:19.042352+0000","last_became_active":"2024-05-10T04:50:15.514053+0000","last_became_peered":"2024-05-10T04:50:15.514053+0000","last_unstale":"2024-05-10T04:50:19.042352+0000","last_undegraded":"2024-05-10T04:50:19.042352+0000","last_fullsized":"2024-05-10T04:50:19.042352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:15.316078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315978+0000","last_change":"2024-05-10T04:50:16.101714+0000","last_active":"2024-05-10T04:50:17.315978+0000","last_peered":"2024-05-10T04:50:17.315978+0000","last_clean":"2024-05-10T04:50:17.315978+0000","last_became_active":"2024-05-10T04:50:16.101380+0000","last_became_peered":"2024-05-10T04:50:16.101380+0000","last_unstale":"2024-05-10T04:50:17.315978+0000","last_undegraded":"2024-05-10T04:50:17.315978+0000","last_fullsized":"2024-05-10T04:50:17.315978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:26:24.678487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316044+0000","last_change":"2024-05-10T04:50:15.516370+0000","last_active":"2024-05-10T04:50:17.316044+0000","last_peered":"2024-05-10T04:50:17.316044+0000","last_clean":"2024-05-10T04:50:17.316044+0000","last_became_active":"2024-05-10T04:50:15.514786+0000","last_became_peered":"2024-05-10T04:50:15.514786+0000","last_unstale":"2024-05-10T04:50:17.316044+0000","last_undegraded":"2024-05-10T04:50:17.316044+0000","last_fullsized":"2024-05-10T04:50:17.316044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316311+0000","last_change":"2024-05-10T04:50:16.091731+0000","last_active":"2024-05-10T04:50:17.316311+0000","last_peered":"2024-05-10T04:50:17.316311+0000","last_clean":"2024-05-10T04:50:17.316311+0000","last_became_active":"2024-05-10T04:50:16.091459+0000","last_became_peered":"2024-05-10T04:50:16.091459+0000","last_unstale":"2024-05-10T04:50:17.316311+0000","last_undegraded":"2024-05-10T04:50:17.316311+0000","last_fullsized":"2024-05-10T04:50:17.316311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315645+0000","last_change":"2024-05-10T04:50:15.520260+0000","last_active":"2024-05-10T04:50:17.315645+0000","last_peered":"2024-05-10T04:50:17.315645+0000","last_clean":"2024-05-10T04:50:17.315645+0000","last_became_active":"2024-05-10T04:50:15.520059+0000","last_became_peered":"2024-05-10T04:50:15.520059+0000","last_unstale":"2024-05-10T04:50:17.315645+0000","last_undegraded":"2024-05-10T04:50:17.315645+0000","last_fullsized":"2024-05-10T04:50:17.315645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:15:25.798441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316457+0000","last_change":"2024-05-10T04:50:16.091927+0000","last_active":"2024-05-10T04:50:17.316457+0000","last_peered":"2024-05-10T04:50:17.316457+0000","last_clean":"2024-05-10T04:50:17.316457+0000","last_became_active":"2024-05-10T04:50:16.091543+0000","last_became_peered":"2024-05-10T04:50:16.091543+0000","last_unstale":"2024-05-10T04:50:17.316457+0000","last_undegraded":"2024-05-10T04:50:17.316457+0000","last_fullsized":"2024-05-10T04:50:17.316457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:16.322846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076410+0000","last_change":"2024-05-10T04:50:15.517935+0000","last_active":"2024-05-10T04:50:17.076410+0000","last_peered":"2024-05-10T04:50:17.076410+0000","last_clean":"2024-05-10T04:50:17.076410+0000","last_became_active":"2024-05-10T04:50:15.517528+0000","last_became_peered":"2024-05-10T04:50:15.517528+0000","last_unstale":"2024-05-10T04:50:17.076410+0000","last_undegraded":"2024-05-10T04:50:17.076410+0000","last_fullsized":"2024-05-10T04:50:17.076410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:24.334423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315174+0000","last_change":"2024-05-10T04:50:16.096422+0000","last_active":"2024-05-10T04:50:17.315174+0000","last_peered":"2024-05-10T04:50:17.315174+0000","last_clean":"2024-05-10T04:50:17.315174+0000","last_became_active":"2024-05-10T04:50:16.095048+0000","last_became_peered":"2024-05-10T04:50:16.095048+0000","last_unstale":"2024-05-10T04:50:17.315174+0000","last_undegraded":"2024-05-10T04:50:17.315174+0000","last_fullsized":"2024-05-10T04:50:17.315174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:55.406199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076765+0000","last_change":"2024-05-10T04:50:15.510474+0000","last_active":"2024-05-10T04:50:17.076765+0000","last_peered":"2024-05-10T04:50:17.076765+0000","last_clean":"2024-05-10T04:50:17.076765+0000","last_became_active":"2024-05-10T04:50:15.509890+0000","last_became_peered":"2024-05-10T04:50:15.509890+0000","last_unstale":"2024-05-10T04:50:17.076765+0000","last_undegraded":"2024-05-10T04:50:17.076765+0000","last_fullsized":"2024-05-10T04:50:17.076765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:00.765649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315711+0000","last_change":"2024-05-10T04:50:16.091690+0000","last_active":"2024-05-10T04:50:17.315711+0000","last_peered":"2024-05-10T04:50:17.315711+0000","last_clean":"2024-05-10T04:50:17.315711+0000","last_became_active":"2024-05-10T04:50:16.090685+0000","last_became_peered":"2024-05-10T04:50:16.090685+0000","last_unstale":"2024-05-10T04:50:17.315711+0000","last_undegraded":"2024-05-10T04:50:17.315711+0000","last_fullsized":"2024-05-10T04:50:17.315711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317278+0000","last_change":"2024-05-10T04:50:15.517573+0000","last_active":"2024-05-10T04:50:17.317278+0000","last_peered":"2024-05-10T04:50:17.317278+0000","last_clean":"2024-05-10T04:50:17.317278+0000","last_became_active":"2024-05-10T04:50:15.517108+0000","last_became_peered":"2024-05-10T04:50:15.517108+0000","last_unstale":"2024-05-10T04:50:17.317278+0000","last_undegraded":"2024-05-10T04:50:17.317278+0000","last_fullsized":"2024-05-10T04:50:17.317278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:30.795068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316202+0000","last_change":"2024-05-10T04:50:16.111071+0000","last_active":"2024-05-10T04:50:17.316202+0000","last_peered":"2024-05-10T04:50:17.316202+0000","last_clean":"2024-05-10T04:50:17.316202+0000","last_became_active":"2024-05-10T04:50:16.109828+0000","last_became_peered":"2024-05-10T04:50:16.109828+0000","last_unstale":"2024-05-10T04:50:17.316202+0000","last_undegraded":"2024-05-10T04:50:17.316202+0000","last_fullsized":"2024-05-10T04:50:17.316202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077673+0000","last_change":"2024-05-10T04:50:15.512759+0000","last_active":"2024-05-10T04:50:17.077673+0000","last_peered":"2024-05-10T04:50:17.077673+0000","last_clean":"2024-05-10T04:50:17.077673+0000","last_became_active":"2024-05-10T04:50:15.512504+0000","last_became_peered":"2024-05-10T04:50:15.512504+0000","last_unstale":"2024-05-10T04:50:17.077673+0000","last_undegraded":"2024-05-10T04:50:17.077673+0000","last_fullsized":"2024-05-10T04:50:17.077673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:15.313570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317426+0000","last_change":"2024-05-10T04:50:16.120261+0000","last_active":"2024-05-10T04:50:17.317426+0000","last_peered":"2024-05-10T04:50:17.317426+0000","last_clean":"2024-05-10T04:50:17.317426+0000","last_became_active":"2024-05-10T04:50:16.119987+0000","last_became_peered":"2024-05-10T04:50:16.119987+0000","last_unstale":"2024-05-10T04:50:17.317426+0000","last_undegraded":"2024-05-10T04:50:17.317426+0000","last_fullsized":"2024-05-10T04:50:17.317426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:37.923918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076976+0000","last_change":"2024-05-10T04:50:15.510033+0000","last_active":"2024-05-10T04:50:17.076976+0000","last_peered":"2024-05-10T04:50:17.076976+0000","last_clean":"2024-05-10T04:50:17.076976+0000","last_became_active":"2024-05-10T04:50:15.509678+0000","last_became_peered":"2024-05-10T04:50:15.509678+0000","last_unstale":"2024-05-10T04:50:17.076976+0000","last_undegraded":"2024-05-10T04:50:17.076976+0000","last_fullsized":"2024-05-10T04:50:17.076976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:11.978320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076880+0000","last_change":"2024-05-10T04:50:16.114747+0000","last_active":"2024-05-10T04:50:17.076880+0000","last_peered":"2024-05-10T04:50:17.076880+0000","last_clean":"2024-05-10T04:50:17.076880+0000","last_became_active":"2024-05-10T04:50:16.108054+0000","last_became_peered":"2024-05-10T04:50:16.108054+0000","last_unstale":"2024-05-10T04:50:17.076880+0000","last_undegraded":"2024-05-10T04:50:17.076880+0000","last_fullsized":"2024-05-10T04:50:17.076880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:02.230401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077792+0000","last_change":"2024-05-10T04:50:15.511828+0000","last_active":"2024-05-10T04:50:17.077792+0000","last_peered":"2024-05-10T04:50:17.077792+0000","last_clean":"2024-05-10T04:50:17.077792+0000","last_became_active":"2024-05-10T04:50:15.508490+0000","last_became_peered":"2024-05-10T04:50:15.508490+0000","last_unstale":"2024-05-10T04:50:17.077792+0000","last_undegraded":"2024-05-10T04:50:17.077792+0000","last_fullsized":"2024-05-10T04:50:17.077792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:14.471385+0000","last_clean_scrub_stamp":"2024-05-10T04:50:14.471385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:17:37.683206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.317311+0000","last_change":"2024-05-10T04:50:16.118853+0000","last_active":"2024-05-10T04:50:17.317311+0000","last_peered":"2024-05-10T04:50:17.317311+0000","last_clean":"2024-05-10T04:50:17.317311+0000","last_became_active":"2024-05-10T04:50:16.118491+0000","last_became_peered":"2024-05-10T04:50:16.118491+0000","last_unstale":"2024-05-10T04:50:17.317311+0000","last_undegraded":"2024-05-10T04:50:17.317311+0000","last_fullsized":"2024-05-10T04:50:17.317311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:51:52.596368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316201+0000","last_change":"2024-05-10T04:50:16.111132+0000","last_active":"2024-05-10T04:50:17.316201+0000","last_peered":"2024-05-10T04:50:17.316201+0000","last_clean":"2024-05-10T04:50:17.316201+0000","last_became_active":"2024-05-10T04:50:16.110819+0000","last_became_peered":"2024-05-10T04:50:16.110819+0000","last_unstale":"2024-05-10T04:50:17.316201+0000","last_undegraded":"2024-05-10T04:50:17.316201+0000","last_fullsized":"2024-05-10T04:50:17.316201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:37:54.432068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077705+0000","last_change":"2024-05-10T04:50:16.085668+0000","last_active":"2024-05-10T04:50:17.077705+0000","last_peered":"2024-05-10T04:50:17.077705+0000","last_clean":"2024-05-10T04:50:17.077705+0000","last_became_active":"2024-05-10T04:50:16.084595+0000","last_became_peered":"2024-05-10T04:50:16.084595+0000","last_unstale":"2024-05-10T04:50:17.077705+0000","last_undegraded":"2024-05-10T04:50:17.077705+0000","last_fullsized":"2024-05-10T04:50:17.077705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:31:01.772418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.077071+0000","last_change":"2024-05-10T04:50:16.104882+0000","last_active":"2024-05-10T04:50:17.077071+0000","last_peered":"2024-05-10T04:50:17.077071+0000","last_clean":"2024-05-10T04:50:17.077071+0000","last_became_active":"2024-05-10T04:50:16.101840+0000","last_became_peered":"2024-05-10T04:50:16.101840+0000","last_unstale":"2024-05-10T04:50:17.077071+0000","last_undegraded":"2024-05-10T04:50:17.077071+0000","last_fullsized":"2024-05-10T04:50:17.077071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:11:07.192432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315884+0000","last_change":"2024-05-10T04:50:16.096600+0000","last_active":"2024-05-10T04:50:17.315884+0000","last_peered":"2024-05-10T04:50:17.315884+0000","last_clean":"2024-05-10T04:50:17.315884+0000","last_became_active":"2024-05-10T04:50:16.095907+0000","last_became_peered":"2024-05-10T04:50:16.095907+0000","last_unstale":"2024-05-10T04:50:17.315884+0000","last_undegraded":"2024-05-10T04:50:17.315884+0000","last_fullsized":"2024-05-10T04:50:17.315884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:53:11.621399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315600+0000","last_change":"2024-05-10T04:50:16.097111+0000","last_active":"2024-05-10T04:50:17.315600+0000","last_peered":"2024-05-10T04:50:17.315600+0000","last_clean":"2024-05-10T04:50:17.315600+0000","last_became_active":"2024-05-10T04:50:16.096855+0000","last_became_peered":"2024-05-10T04:50:16.096855+0000","last_unstale":"2024-05-10T04:50:17.315600+0000","last_undegraded":"2024-05-10T04:50:17.315600+0000","last_fullsized":"2024-05-10T04:50:17.315600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:15:18.132741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076898+0000","last_change":"2024-05-10T04:50:16.100106+0000","last_active":"2024-05-10T04:50:17.076898+0000","last_peered":"2024-05-10T04:50:17.076898+0000","last_clean":"2024-05-10T04:50:17.076898+0000","last_became_active":"2024-05-10T04:50:16.095317+0000","last_became_peered":"2024-05-10T04:50:16.095317+0000","last_unstale":"2024-05-10T04:50:17.076898+0000","last_undegraded":"2024-05-10T04:50:17.076898+0000","last_fullsized":"2024-05-10T04:50:17.076898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:34:07.142717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.316523+0000","last_change":"2024-05-10T04:50:16.103396+0000","last_active":"2024-05-10T04:50:17.316523+0000","last_peered":"2024-05-10T04:50:17.316523+0000","last_clean":"2024-05-10T04:50:17.316523+0000","last_became_active":"2024-05-10T04:50:16.102768+0000","last_became_peered":"2024-05-10T04:50:16.102768+0000","last_unstale":"2024-05-10T04:50:17.316523+0000","last_undegraded":"2024-05-10T04:50:17.316523+0000","last_fullsized":"2024-05-10T04:50:17.316523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315919+0000","last_change":"2024-05-10T04:50:16.095965+0000","last_active":"2024-05-10T04:50:17.315919+0000","last_peered":"2024-05-10T04:50:17.315919+0000","last_clean":"2024-05-10T04:50:17.315919+0000","last_became_active":"2024-05-10T04:50:16.095711+0000","last_became_peered":"2024-05-10T04:50:16.095711+0000","last_unstale":"2024-05-10T04:50:17.315919+0000","last_undegraded":"2024-05-10T04:50:17.315919+0000","last_fullsized":"2024-05-10T04:50:17.315919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:02:56.232223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076712+0000","last_change":"2024-05-10T04:50:16.107080+0000","last_active":"2024-05-10T04:50:17.076712+0000","last_peered":"2024-05-10T04:50:17.076712+0000","last_clean":"2024-05-10T04:50:17.076712+0000","last_became_active":"2024-05-10T04:50:16.102437+0000","last_became_peered":"2024-05-10T04:50:16.102437+0000","last_unstale":"2024-05-10T04:50:17.076712+0000","last_undegraded":"2024-05-10T04:50:17.076712+0000","last_fullsized":"2024-05-10T04:50:17.076712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:39:37.923918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315288+0000","last_change":"2024-05-10T04:50:16.095687+0000","last_active":"2024-05-10T04:50:17.315288+0000","last_peered":"2024-05-10T04:50:17.315288+0000","last_clean":"2024-05-10T04:50:17.315288+0000","last_became_active":"2024-05-10T04:50:16.093813+0000","last_became_peered":"2024-05-10T04:50:16.093813+0000","last_unstale":"2024-05-10T04:50:17.315288+0000","last_undegraded":"2024-05-10T04:50:17.315288+0000","last_fullsized":"2024-05-10T04:50:17.315288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:01:58.169360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.076694+0000","last_change":"2024-05-10T04:50:16.108911+0000","last_active":"2024-05-10T04:50:17.076694+0000","last_peered":"2024-05-10T04:50:17.076694+0000","last_clean":"2024-05-10T04:50:17.076694+0000","last_became_active":"2024-05-10T04:50:16.107713+0000","last_became_peered":"2024-05-10T04:50:16.107713+0000","last_unstale":"2024-05-10T04:50:17.076694+0000","last_undegraded":"2024-05-10T04:50:17.076694+0000","last_fullsized":"2024-05-10T04:50:17.076694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:25:51.024120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315797+0000","last_change":"2024-05-10T04:50:16.097207+0000","last_active":"2024-05-10T04:50:17.315797+0000","last_peered":"2024-05-10T04:50:17.315797+0000","last_clean":"2024-05-10T04:50:17.315797+0000","last_became_active":"2024-05-10T04:50:16.093993+0000","last_became_peered":"2024-05-10T04:50:16.093993+0000","last_unstale":"2024-05-10T04:50:17.315797+0000","last_undegraded":"2024-05-10T04:50:17.315797+0000","last_fullsized":"2024-05-10T04:50:17.315797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-10T04:50:17.315905+0000","last_change":"2024-05-10T04:50:16.096624+0000","last_active":"2024-05-10T04:50:17.315905+0000","last_peered":"2024-05-10T04:50:17.315905+0000","last_clean":"2024-05-10T04:50:17.315905+0000","last_became_active":"2024-05-10T04:50:16.096111+0000","last_became_peered":"2024-05-10T04:50:16.096111+0000","last_unstale":"2024-05-10T04:50:17.315905+0000","last_undegraded":"2024-05-10T04:50:17.315905+0000","last_fullsized":"2024-05-10T04:50:17.315905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:15.478153+0000","last_clean_scrub_stamp":"2024-05-10T04:50:15.478153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:28.811138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:50:28.204 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T04:50:28.204 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T04:50:28.204 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-10T04:50:28.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T04:50:28.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.496+0000 7fa6d0e00700 1 Processor -- start 2024-05-10T04:50:28.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.496+0000 7fa6d0e00700 1 -- start start 2024-05-10T04:50:28.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6d0e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6d0e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa6cc0b5530 0x7fa6cc15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6d0e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc15cb90 con 0x7fa6cc15fac0 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6d0e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6cc142910 con 0x7fa6cc0b5530 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6d0e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc160410 con 0x7fa6cc142500 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6c3e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa6cc15fac0 0x7fa6cc0b4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36642/0 (socket says 172.21.15.82:36642) 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6c3e00700 1 -- 172.21.15.82:0/1152526108 learned_addr learned my addr 172.21.15.82:0/1152526108 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6cb400700 1 --2- 172.21.15.82:0/1152526108 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6cbe00700 1 --2- 172.21.15.82:0/1152526108 >> v2:172.21.15.129:3300/0 conn(0x7fa6cc0b5530 0x7fa6cc15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6caa00700 1 -- 172.21.15.82:0/1152526108 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374994736 0 0) 0x7fa6cc15cb90 con 0x7fa6cc15fac0 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.499+0000 7fa6caa00700 1 -- 172.21.15.82:0/1152526108 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b00035b0 con 0x7fa6cc15fac0 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.500+0000 7fa6cb400700 1 -- 172.21.15.82:0/1152526108 >> v2:172.21.15.129:3300/0 conn(0x7fa6cc0b5530 msgr2=0x7fa6cc15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.500+0000 7fa6cb400700 1 --2- 172.21.15.82:0/1152526108 >> v2:172.21.15.129:3300/0 conn(0x7fa6cc0b5530 0x7fa6cc15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.500+0000 7fa6cb400700 1 -- 172.21.15.82:0/1152526108 >> v1:172.21.15.82:6789/0 conn(0x7fa6cc15fac0 legacy=0x7fa6cc0b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.500+0000 7fa6cb400700 1 -- 172.21.15.82:0/1152526108 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc1459b0 con 0x7fa6cc142500 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.500+0000 7fa6cb400700 1 --2- 172.21.15.82:0/1152526108 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc15d020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009840 tx=0x7fa6bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b01ee12fb62b2813 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.500+0000 7fa6caa00700 1 -- 172.21.15.82:0/1152526108 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc011830 con 0x7fa6cc142500 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.500+0000 7fa6caa00700 1 -- 172.21.15.82:0/1152526108 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc011990 con 0x7fa6cc142500 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.500+0000 7fa6caa00700 1 -- 172.21.15.82:0/1152526108 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc011d20 con 0x7fa6cc142500 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.501+0000 7fa6d0e00700 1 -- 172.21.15.82:0/1152526108 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 msgr2=0x7fa6cc15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.501+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/1152526108 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc15d020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009840 tx=0x7fa6bc009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.501+0000 7fa6d0e00700 1 -- 172.21.15.82:0/1152526108 shutdown_connections 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.501+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/1152526108 >> v2:172.21.15.129:3300/0 conn(0x7fa6cc0b5530 0x7fa6cc15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.501+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/1152526108 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc15d020 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.501+0000 7fa6d0e00700 1 -- 172.21.15.82:0/1152526108 >> 172.21.15.82:0/1152526108 conn(0x7fa6cc0b1810 msgr2=0x7fa6cc0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.501+0000 7fa6d0e00700 1 -- 172.21.15.82:0/1152526108 shutdown_connections 2024-05-10T04:50:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.501+0000 7fa6d0e00700 1 -- 172.21.15.82:0/1152526108 wait complete. 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.503+0000 7fa6d0e00700 1 Processor -- start 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.504+0000 7fa6d0e00700 1 -- start start 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6d0e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6d0e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15fac0 0x7fa6cc06d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6d0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6cc06dda0 0x7fa6cc15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6d0e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc15d680 con 0x7fa6cc06dda0 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6d0e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc1390c0 con 0x7fa6cc15fac0 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6d0e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc15d890 con 0x7fa6cc142500 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6cbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6cc06dda0 0x7fa6cc15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6cbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6cc06dda0 0x7fa6cc15ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42692/0 (socket says 172.21.15.82:42692) 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.505+0000 7fa6cbe00700 1 -- 172.21.15.82:0/2460625553 learned_addr learned my addr 172.21.15.82:0/2460625553 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6cb400700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6c3e00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15fac0 0x7fa6cc06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6cbe00700 1 -- 172.21.15.82:0/2460625553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 msgr2=0x7fa6cc159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6cbe00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6cbe00700 1 -- 172.21.15.82:0/2460625553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15fac0 msgr2=0x7fa6cc06d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6cbe00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15fac0 0x7fa6cc06d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6cbe00700 1 -- 172.21.15.82:0/2460625553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0094a0 con 0x7fa6cc06dda0 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6cbe00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6cc06dda0 0x7fa6cc15ee80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400efc0 tx=0x7fa6c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6c3400700 1 -- 172.21.15.82:0/2460625553 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4009ba0 con 0x7fa6cc06dda0 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6c3400700 1 -- 172.21.15.82:0/2460625553 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c400f040 con 0x7fa6cc06dda0 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6c3400700 1 -- 172.21.15.82:0/2460625553 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4014480 con 0x7fa6cc06dda0 2024-05-10T04:50:28.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc15db70 con 0x7fa6cc06dda0 2024-05-10T04:50:28.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.506+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc15e130 con 0x7fa6cc06dda0 2024-05-10T04:50:28.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.507+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc074af0 con 0x7fa6cc06dda0 2024-05-10T04:50:28.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.508+0000 7fa6c3400700 1 -- 172.21.15.82:0/2460625553 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa6c40145e0 con 0x7fa6cc06dda0 2024-05-10T04:50:28.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.509+0000 7fa6c3400700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6a806ac90 0x7fa6a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:28.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.509+0000 7fa6c3400700 1 -- 172.21.15.82:0/2460625553 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6c408a070 con 0x7fa6cc06dda0 2024-05-10T04:50:28.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.510+0000 7fa6cb400700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6a806ac90 0x7fa6a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:28.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.510+0000 7fa6cb400700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6a806ac90 0x7fa6a806d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009840 tx=0x7fa6bc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:28.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.514+0000 7fa6c3400700 1 -- 172.21.15.82:0/2460625553 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa6c40bd900 con 0x7fa6cc06dda0 2024-05-10T04:50:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.765+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa6cc15a190 con 0x7fa6cc06dda0 2024-05-10T04:50:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.765+0000 7fa6c3400700 1 -- 172.21.15.82:0/2460625553 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa6c4018080 con 0x7fa6cc06dda0 2024-05-10T04:50:28.767 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:28.767 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T04:50:28.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.767+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6a806ac90 msgr2=0x7fa6a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:28.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.767+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6a806ac90 0x7fa6a806d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009840 tx=0x7fa6bc008030 comp rx=0 tx=0).stop 2024-05-10T04:50:28.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.767+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6cc06dda0 msgr2=0x7fa6cc15ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:28.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.767+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6cc06dda0 0x7fa6cc15ee80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400efc0 tx=0x7fa6c400c3a0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.768+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 shutdown_connections 2024-05-10T04:50:28.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.768+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa6a806ac90 0x7fa6a806d1a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.768+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6cc06dda0 0x7fa6cc15ee80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.768+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6cc142500 0x7fa6cc159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.768+0000 7fa6d0e00700 1 --2- 172.21.15.82:0/2460625553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6cc15fac0 0x7fa6cc06d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:28.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.768+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 >> 172.21.15.82:0/2460625553 conn(0x7fa6cc0b1810 msgr2=0x7fa6cc0afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:28.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.768+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 shutdown_connections 2024-05-10T04:50:28.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:28.768+0000 7fa6d0e00700 1 -- 172.21.15.82:0/2460625553 wait complete. 2024-05-10T04:50:28.796 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-10T04:50:28.797 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:29.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.060+0000 7f9446000700 1 Processor -- start 2024-05-10T04:50:29.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.060+0000 7f9446000700 1 -- start start 2024-05-10T04:50:29.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f9446000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94400b5fa0 0x7f94400b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f9446000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944015f900 con 0x7f944015f4f0 2024-05-10T04:50:29.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f9446000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9440162a70 con 0x7f944015bfe0 2024-05-10T04:50:29.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f9446000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944015c3f0 con 0x7f94400b5fa0 2024-05-10T04:50:29.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f943fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94400b5fa0 0x7f94400b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f943ea00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f944015f4f0 0x7f94400b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36654/0 (socket says 172.21.15.82:36654) 2024-05-10T04:50:29.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f943ea00700 1 -- 172.21.15.82:0/3675154131 learned_addr learned my addr 172.21.15.82:0/3675154131 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:29.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f943fe00700 1 -- 172.21.15.82:0/3675154131 >> v1:172.21.15.129:6789/0 conn(0x7f944015bfe0 legacy=0x7f9440161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f943fe00700 1 -- 172.21.15.82:0/3675154131 >> v1:172.21.15.82:6789/0 conn(0x7f944015f4f0 legacy=0x7f94400b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f943fe00700 1 -- 172.21.15.82:0/3675154131 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440162d50 con 0x7f94400b5fa0 2024-05-10T04:50:29.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.062+0000 7f943e000700 1 -- 172.21.15.82:0/3675154131 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396439154 0 0) 0x7f942c001110 con 0x7f944015f4f0 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.063+0000 7f943fe00700 1 --2- 172.21.15.82:0/3675154131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400b5fa0 0x7f94400b2890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9438009d90 tx=0x7f943800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefd0ea433a840be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.063+0000 7f943e000700 1 -- 172.21.15.82:0/3675154131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943800e070 con 0x7f94400b5fa0 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.063+0000 7f943e000700 1 -- 172.21.15.82:0/3675154131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943800bbd0 con 0x7f94400b5fa0 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.063+0000 7f943e000700 1 -- 172.21.15.82:0/3675154131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438012430 con 0x7f94400b5fa0 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.064+0000 7f9446000700 1 -- 172.21.15.82:0/3675154131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400b5fa0 msgr2=0x7f94400b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.064+0000 7f9446000700 1 --2- 172.21.15.82:0/3675154131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400b5fa0 0x7f94400b2890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9438009d90 tx=0x7f943800b330 comp rx=0 tx=0).stop 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.064+0000 7f9446000700 1 -- 172.21.15.82:0/3675154131 shutdown_connections 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.064+0000 7f9446000700 1 --2- 172.21.15.82:0/3675154131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94400b5fa0 0x7f94400b2890 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.064+0000 7f9446000700 1 -- 172.21.15.82:0/3675154131 >> 172.21.15.82:0/3675154131 conn(0x7f94400d0a70 msgr2=0x7f94400d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.064+0000 7f9446000700 1 -- 172.21.15.82:0/3675154131 shutdown_connections 2024-05-10T04:50:29.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.064+0000 7f9446000700 1 -- 172.21.15.82:0/3675154131 wait complete. 2024-05-10T04:50:29.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.066+0000 7f9446000700 1 Processor -- start 2024-05-10T04:50:29.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.066+0000 7f9446000700 1 -- start start 2024-05-10T04:50:29.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.067+0000 7f9446000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944015bfe0 0x7f94400cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.067+0000 7f9446000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f944015f4f0 0x7f94400b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f9446000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94400b8900 0x7f944014a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f9446000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944014e5e0 con 0x7f944015bfe0 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f9446000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944014cbf0 con 0x7f94400b8900 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f9446000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944014d5d0 con 0x7f944015f4f0 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944015bfe0 0x7f94400cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944015bfe0 0x7f94400cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42720/0 (socket says 172.21.15.82:42720) 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 -- 172.21.15.82:0/4255077998 learned_addr learned my addr 172.21.15.82:0/4255077998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943fe00700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94400b8900 0x7f944014a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 -- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f944015f4f0 msgr2=0x7f94400b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943ea00700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f944015f4f0 0x7f94400b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f944015f4f0 0x7f94400b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 -- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94400b8900 msgr2=0x7f944014a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94400b8900 0x7f944014a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 -- 172.21.15.82:0/4255077998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438009a70 con 0x7f944015bfe0 2024-05-10T04:50:29.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943fe00700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94400b8900 0x7f944014a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:29.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943ea00700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f944015f4f0 0x7f94400b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:29.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.068+0000 7f943f400700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944015bfe0 0x7f94400cd4b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f943000c480 tx=0x7f943000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:29.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.069+0000 7f9437400700 1 -- 172.21.15.82:0/4255077998 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300052d0 con 0x7f944015bfe0 2024-05-10T04:50:29.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.069+0000 7f9437400700 1 -- 172.21.15.82:0/4255077998 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9430005430 con 0x7f944015bfe0 2024-05-10T04:50:29.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.069+0000 7f9437400700 1 -- 172.21.15.82:0/4255077998 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300038c0 con 0x7f944015bfe0 2024-05-10T04:50:29.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.069+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944014d780 con 0x7f944015bfe0 2024-05-10T04:50:29.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.069+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944014d9d0 con 0x7f944015bfe0 2024-05-10T04:50:29.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.070+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9440074af0 con 0x7f944015bfe0 2024-05-10T04:50:29.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.071+0000 7f9437400700 1 -- 172.21.15.82:0/4255077998 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9430003a20 con 0x7f944015bfe0 2024-05-10T04:50:29.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.072+0000 7f9437400700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f942006ac90 0x7f942006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.072+0000 7f9437400700 1 -- 172.21.15.82:0/4255077998 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94300887e0 con 0x7f944015bfe0 2024-05-10T04:50:29.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.072+0000 7f943ea00700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f942006ac90 0x7f942006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.073+0000 7f943ea00700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f942006ac90 0x7f942006d1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f94401f7d40 tx=0x7f942c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:29.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.076+0000 7f9437400700 1 -- 172.21.15.82:0/4255077998 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9430053920 con 0x7f944015bfe0 2024-05-10T04:50:29.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.281+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94400b62c0 con 0x7f944015bfe0 2024-05-10T04:50:29.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.282+0000 7f9437400700 1 -- 172.21.15.82:0/4255077998 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f9430056f40 con 0x7f944015bfe0 2024-05-10T04:50:29.284 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:29.284 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:29.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.284+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f942006ac90 msgr2=0x7f942006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.284+0000 7f9446000700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f942006ac90 0x7f942006d1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f94401f7d40 tx=0x7f942c009040 comp rx=0 tx=0).stop 2024-05-10T04:50:29.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.284+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944015bfe0 msgr2=0x7f94400cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.284+0000 7f9446000700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944015bfe0 0x7f94400cd4b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f943000c480 tx=0x7f943000c840 comp rx=0 tx=0).stop 2024-05-10T04:50:29.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.285+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 shutdown_connections 2024-05-10T04:50:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.285+0000 7f9446000700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f942006ac90 0x7f942006d1a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.285+0000 7f9446000700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f94400b8900 0x7f944014a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.285+0000 7f9446000700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944015bfe0 0x7f94400cd4b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.285+0000 7f9446000700 1 --2- 172.21.15.82:0/4255077998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f944015f4f0 0x7f94400b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.285+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 >> 172.21.15.82:0/4255077998 conn(0x7f94400d0a70 msgr2=0x7f94400b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.285+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 shutdown_connections 2024-05-10T04:50:29.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.285+0000 7f9446000700 1 -- 172.21.15.82:0/4255077998 wait complete. 2024-05-10T04:50:29.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:29.312 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.577+0000 7fafce200700 1 Processor -- start 2024-05-10T04:50:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.577+0000 7fafce200700 1 -- start start 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.579+0000 7fafce200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc815e610 0x7fafc80b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.579+0000 7fafce200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fafc80b7910 0x7fafc806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.579+0000 7fafce200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc80d2c00 con 0x7fafc8162150 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.579+0000 7fafce200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc815ea20 con 0x7fafc80b7910 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.579+0000 7fafce200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8162630 con 0x7fafc815e610 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc6a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc815e610 0x7fafc80b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc7e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fafc80b7910 0x7fafc806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc6a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc815e610 0x7fafc80b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:59026/0 (socket says 172.21.15.82:59026) 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc7400700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fafc8162150 0x7fafc80cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:37926/0 (socket says 172.21.15.82:37926) 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc7400700 1 -- 172.21.15.82:0/2314654773 learned_addr learned my addr 172.21.15.82:0/2314654773 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc6000700 1 -- 172.21.15.82:0/2314654773 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948860093 0 0) 0x7fafc80d2c00 con 0x7fafc8162150 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc6000700 1 -- 172.21.15.82:0/2314654773 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafac0035b0 con 0x7fafc8162150 2024-05-10T04:50:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc6a00700 1 -- 172.21.15.82:0/2314654773 >> v2:172.21.15.129:3300/0 conn(0x7fafc80b7910 msgr2=0x7fafc806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc6a00700 1 --2- 172.21.15.82:0/2314654773 >> v2:172.21.15.129:3300/0 conn(0x7fafc80b7910 0x7fafc806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc6a00700 1 -- 172.21.15.82:0/2314654773 >> v1:172.21.15.129:6789/0 conn(0x7fafc8162150 legacy=0x7fafc80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc6a00700 1 -- 172.21.15.82:0/2314654773 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc8162910 con 0x7fafc815e610 2024-05-10T04:50:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.580+0000 7fafc7e00700 1 --2- 172.21.15.82:0/2314654773 >> v2:172.21.15.129:3300/0 conn(0x7fafc80b7910 0x7fafc806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.581+0000 7fafc6a00700 1 --2- 172.21.15.82:0/2314654773 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc815e610 0x7fafc80b73d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009840 tx=0x7fafb4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb23c87d47f3ae76 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.581+0000 7fafc6000700 1 -- 172.21.15.82:0/2314654773 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011830 con 0x7fafc815e610 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.581+0000 7fafc6000700 1 -- 172.21.15.82:0/2314654773 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4011990 con 0x7fafc815e610 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.581+0000 7fafc6000700 1 -- 172.21.15.82:0/2314654773 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011d20 con 0x7fafc815e610 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.581+0000 7fafce200700 1 -- 172.21.15.82:0/2314654773 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc815e610 msgr2=0x7fafc80b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.581+0000 7fafce200700 1 --2- 172.21.15.82:0/2314654773 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc815e610 0x7fafc80b73d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009840 tx=0x7fafb4009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.582+0000 7fafce200700 1 -- 172.21.15.82:0/2314654773 shutdown_connections 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.582+0000 7fafce200700 1 --2- 172.21.15.82:0/2314654773 >> v2:172.21.15.129:3300/0 conn(0x7fafc80b7910 0x7fafc806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.582+0000 7fafce200700 1 --2- 172.21.15.82:0/2314654773 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc815e610 0x7fafc80b73d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.582+0000 7fafce200700 1 -- 172.21.15.82:0/2314654773 >> 172.21.15.82:0/2314654773 conn(0x7fafc80d3e10 msgr2=0x7fafc80d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.582+0000 7fafce200700 1 -- 172.21.15.82:0/2314654773 shutdown_connections 2024-05-10T04:50:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.582+0000 7fafce200700 1 -- 172.21.15.82:0/2314654773 wait complete. 2024-05-10T04:50:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.584+0000 7fafce200700 1 Processor -- start 2024-05-10T04:50:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.584+0000 7fafce200700 1 -- start start 2024-05-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.585+0000 7fafce200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc80b7910 0x7fafc8157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.585+0000 7fafce200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc815e610 0x7fafc80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafce200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc8162150 0x7fafc80cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafce200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8149a10 con 0x7fafc80b7910 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafce200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80cd7a0 con 0x7fafc815e610 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafce200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8148240 con 0x7fafc8162150 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc80b7910 0x7fafc8157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc80b7910 0x7fafc8157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42736/0 (socket says 172.21.15.82:42736) 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 -- 172.21.15.82:0/2697498300 learned_addr learned my addr 172.21.15.82:0/2697498300 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc6a00700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc815e610 0x7fafc80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7e00700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc8162150 0x7fafc80cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 -- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc8162150 msgr2=0x7fafc80cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc8162150 0x7fafc80cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 -- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc815e610 msgr2=0x7fafc80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc815e610 0x7fafc80ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 -- 172.21.15.82:0/2697498300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009a70 con 0x7fafc80b7910 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc6a00700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc815e610 0x7fafc80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7e00700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc8162150 0x7fafc80cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.586+0000 7fafc7400700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc80b7910 0x7fafc8157c60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fafb8001eb0 tx=0x7fafb800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.587+0000 7fafbf400700 1 -- 172.21.15.82:0/2697498300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8005d70 con 0x7fafc80b7910 2024-05-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.587+0000 7fafbf400700 1 -- 172.21.15.82:0/2697498300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb80070d0 con 0x7fafc80b7910 2024-05-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.587+0000 7fafbf400700 1 -- 172.21.15.82:0/2697498300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8007460 con 0x7fafc80b7910 2024-05-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.587+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb40094a0 con 0x7fafc80b7910 2024-05-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.587+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc80cd9f0 con 0x7fafc80b7910 2024-05-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.588+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc8074af0 con 0x7fafc80b7910 2024-05-10T04:50:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.589+0000 7fafbf400700 1 -- 172.21.15.82:0/2697498300 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fafb80075c0 con 0x7fafc80b7910 2024-05-10T04:50:29.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.590+0000 7fafbf400700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fafa806ac90 0x7fafa806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:29.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.590+0000 7fafbf400700 1 -- 172.21.15.82:0/2697498300 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafb8088820 con 0x7fafc80b7910 2024-05-10T04:50:29.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.591+0000 7fafc6a00700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fafa806ac90 0x7fafa806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:29.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.591+0000 7fafc6a00700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fafa806ac90 0x7fafa806d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fafb4000c00 tx=0x7fafb4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:29.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.595+0000 7fafbf400700 1 -- 172.21.15.82:0/2697498300 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fafb8053a00 con 0x7fafc80b7910 2024-05-10T04:50:29.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.800+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafc8161ec0 con 0x7fafc80b7910 2024-05-10T04:50:29.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.800+0000 7fafbf400700 1 -- 172.21.15.82:0/2697498300 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafb80170a0 con 0x7fafc80b7910 2024-05-10T04:50:29.802 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fafa806ac90 msgr2=0x7fafa806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fafa806ac90 0x7fafa806d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fafb4000c00 tx=0x7fafb4008030 comp rx=0 tx=0).stop 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc80b7910 msgr2=0x7fafc8157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc80b7910 0x7fafc8157c60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fafb8001eb0 tx=0x7fafb800c860 comp rx=0 tx=0).stop 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 shutdown_connections 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fafa806ac90 0x7fafa806d1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fafc8162150 0x7fafc80cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc80b7910 0x7fafc8157c60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 --2- 172.21.15.82:0/2697498300 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc815e610 0x7fafc80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:29.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 >> 172.21.15.82:0/2697498300 conn(0x7fafc80d3e10 msgr2=0x7fafc80b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 shutdown_connections 2024-05-10T04:50:29.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:29.803+0000 7fafce200700 1 -- 172.21.15.82:0/2697498300 wait complete. 2024-05-10T04:50:29.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:50:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.095+0000 7f7d6ac00700 1 Processor -- start 2024-05-10T04:50:30.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.095+0000 7f7d6ac00700 1 -- start start 2024-05-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.096+0000 7f7d6ac00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d64162150 0x7f7d6415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.096+0000 7f7d6ac00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7d6406c160 0x7f7d6406c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.096+0000 7f7d6ac00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d640d2c00 con 0x7f7d640cf4d0 2024-05-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.096+0000 7f7d6ac00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6406cab0 con 0x7f7d64162150 2024-05-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.096+0000 7f7d6ac00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d64162630 con 0x7f7d6406c160 2024-05-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d63400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7d640cf4d0 0x7f7d640b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36664/0 (socket says 172.21.15.82:36664) 2024-05-10T04:50:30.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d63400700 1 -- 172.21.15.82:0/3887571841 learned_addr learned my addr 172.21.15.82:0/3887571841 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d63e00700 1 --2- 172.21.15.82:0/3887571841 >> v2:172.21.15.82:3300/0 conn(0x7f7d64162150 0x7f7d6415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d68c00700 1 --2- 172.21.15.82:0/3887571841 >> v2:172.21.15.129:3300/0 conn(0x7f7d6406c160 0x7f7d6406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d62a00700 1 -- 172.21.15.82:0/3887571841 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669040596 0 0) 0x7f7d640d2c00 con 0x7f7d640cf4d0 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d63e00700 1 -- 172.21.15.82:0/3887571841 >> v2:172.21.15.129:3300/0 conn(0x7f7d6406c160 msgr2=0x7f7d6406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d63e00700 1 --2- 172.21.15.82:0/3887571841 >> v2:172.21.15.129:3300/0 conn(0x7f7d6406c160 0x7f7d6406c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d63e00700 1 -- 172.21.15.82:0/3887571841 >> v1:172.21.15.82:6789/0 conn(0x7f7d640cf4d0 legacy=0x7f7d640b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d63e00700 1 -- 172.21.15.82:0/3887571841 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64162910 con 0x7f7d64162150 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.097+0000 7f7d63e00700 1 --2- 172.21.15.82:0/3887571841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64162150 0x7f7d6415e610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009840 tx=0x7f7d54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aab40471792063 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d62a00700 1 -- 172.21.15.82:0/3887571841 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54011830 con 0x7f7d64162150 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d62a00700 1 -- 172.21.15.82:0/3887571841 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d54011990 con 0x7f7d64162150 2024-05-10T04:50:30.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d62a00700 1 -- 172.21.15.82:0/3887571841 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54011d20 con 0x7f7d64162150 2024-05-10T04:50:30.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d6ac00700 1 -- 172.21.15.82:0/3887571841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64162150 msgr2=0x7f7d6415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/3887571841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64162150 0x7f7d6415e610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009840 tx=0x7f7d54009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:30.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d6ac00700 1 -- 172.21.15.82:0/3887571841 shutdown_connections 2024-05-10T04:50:30.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/3887571841 >> v2:172.21.15.129:3300/0 conn(0x7f7d6406c160 0x7f7d6406c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/3887571841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d64162150 0x7f7d6415e610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d6ac00700 1 -- 172.21.15.82:0/3887571841 >> 172.21.15.82:0/3887571841 conn(0x7f7d640d3e10 msgr2=0x7f7d640d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:30.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.098+0000 7f7d6ac00700 1 -- 172.21.15.82:0/3887571841 shutdown_connections 2024-05-10T04:50:30.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.099+0000 7f7d6ac00700 1 -- 172.21.15.82:0/3887571841 wait complete. 2024-05-10T04:50:30.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.101+0000 7f7d6ac00700 1 Processor -- start 2024-05-10T04:50:30.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.101+0000 7f7d6ac00700 1 -- start start 2024-05-10T04:50:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.102+0000 7f7d6ac00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7d6406c160 0x7f7d640c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.102+0000 7f7d6ac00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d640cf4d0 0x7f7d6414cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.102+0000 7f7d6ac00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d64162150 0x7f7d6415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.102+0000 7f7d6ac00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d641f4dd0 con 0x7f7d640cf4d0 2024-05-10T04:50:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.102+0000 7f7d6ac00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640cc3b0 con 0x7f7d64162150 2024-05-10T04:50:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.102+0000 7f7d6ac00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d641f89a0 con 0x7f7d6406c160 2024-05-10T04:50:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d640cf4d0 0x7f7d6414cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d640cf4d0 0x7f7d6414cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42766/0 (socket says 172.21.15.82:42766) 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 -- 172.21.15.82:0/2384718663 learned_addr learned my addr 172.21.15.82:0/2384718663 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d68c00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d64162150 0x7f7d6415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63e00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7d6406c160 0x7f7d640c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 -- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7d6406c160 msgr2=0x7f7d640c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7d6406c160 0x7f7d640c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 -- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d64162150 msgr2=0x7f7d6415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d64162150 0x7f7d6415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 -- 172.21.15.82:0/2384718663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d540094a0 con 0x7f7d640cf4d0 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63e00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7d6406c160 0x7f7d640c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d68c00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d64162150 0x7f7d6415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d63400700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d640cf4d0 0x7f7d6414cd60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c520 tx=0x7f7d5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.103+0000 7f7d5be00700 1 -- 172.21.15.82:0/2384718663 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50004c80 con 0x7f7d640cf4d0 2024-05-10T04:50:30.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.104+0000 7f7d5be00700 1 -- 172.21.15.82:0/2384718663 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d50004de0 con 0x7f7d640cf4d0 2024-05-10T04:50:30.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.104+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d640c8070 con 0x7f7d640cf4d0 2024-05-10T04:50:30.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.104+0000 7f7d5be00700 1 -- 172.21.15.82:0/2384718663 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500072d0 con 0x7f7d640cf4d0 2024-05-10T04:50:30.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.104+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d640c8350 con 0x7f7d640cf4d0 2024-05-10T04:50:30.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.105+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d640c8630 con 0x7f7d640cf4d0 2024-05-10T04:50:30.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.106+0000 7f7d5be00700 1 -- 172.21.15.82:0/2384718663 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d50007430 con 0x7f7d640cf4d0 2024-05-10T04:50:30.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.106+0000 7f7d5be00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7d4406acc0 0x7f7d4406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.107+0000 7f7d5be00700 1 -- 172.21.15.82:0/2384718663 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d50088f80 con 0x7f7d640cf4d0 2024-05-10T04:50:30.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.107+0000 7f7d63e00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7d4406acc0 0x7f7d4406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.107+0000 7f7d63e00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7d4406acc0 0x7f7d4406d1d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009840 tx=0x7f7d54010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:30.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.111+0000 7f7d5be00700 1 -- 172.21.15.82:0/2384718663 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7d50054150 con 0x7f7d640cf4d0 2024-05-10T04:50:30.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.311+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d640d00a0 con 0x7f7d640cf4d0 2024-05-10T04:50:30.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.312+0000 7f7d5be00700 1 -- 172.21.15.82:0/2384718663 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d50057770 con 0x7f7d640cf4d0 2024-05-10T04:50:30.314 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:50:30.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7d4406acc0 msgr2=0x7f7d4406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7d4406acc0 0x7f7d4406d1d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009840 tx=0x7f7d54010000 comp rx=0 tx=0).stop 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d640cf4d0 msgr2=0x7f7d6414cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d640cf4d0 0x7f7d6414cd60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c520 tx=0x7f7d5000c8e0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 shutdown_connections 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7d4406acc0 0x7f7d4406d1d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7d64162150 0x7f7d6415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7d6406c160 0x7f7d640c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 --2- 172.21.15.82:0/2384718663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d640cf4d0 0x7f7d6414cd60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 >> 172.21.15.82:0/2384718663 conn(0x7f7d640d3e10 msgr2=0x7f7d640d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 shutdown_connections 2024-05-10T04:50:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.315+0000 7f7d6ac00700 1 -- 172.21.15.82:0/2384718663 wait complete. 2024-05-10T04:50:30.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:50:30.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.609+0000 7efe0c000700 1 Processor -- start 2024-05-10T04:50:30.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.609+0000 7efe0c000700 1 -- start start 2024-05-10T04:50:30.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.611+0000 7efe0c000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7efe04162150 0x7efe0415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.611+0000 7efe0c000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040d2c00 con 0x7efe0406c160 2024-05-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.611+0000 7efe0c000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe04162630 con 0x7efe040cf4d0 2024-05-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.611+0000 7efe0c000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe04162910 con 0x7efe04162150 2024-05-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.611+0000 7efe0a000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efe0406c160 0x7efe0406c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36680/0 (socket says 172.21.15.82:36680) 2024-05-10T04:50:30.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.611+0000 7efe0a000700 1 -- 172.21.15.82:0/2655542714 learned_addr learned my addr 172.21.15.82:0/2655542714 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:30.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.612+0000 7efe09600700 1 --2- 172.21.15.82:0/2655542714 >> v2:172.21.15.129:3300/0 conn(0x7efe04162150 0x7efe0415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.612+0000 7efe03e00700 1 -- 172.21.15.82:0/2655542714 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609801750 0 0) 0x7efe040d2c00 con 0x7efe0406c160 2024-05-10T04:50:30.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.612+0000 7efe03e00700 1 -- 172.21.15.82:0/2655542714 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdec0035b0 con 0x7efe0406c160 2024-05-10T04:50:30.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.612+0000 7efe03e00700 1 -- 172.21.15.82:0/2655542714 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2070850081 0 0) 0x7efdec0035b0 con 0x7efe0406c160 2024-05-10T04:50:30.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.612+0000 7efe09600700 1 -- 172.21.15.82:0/2655542714 >> v1:172.21.15.129:6789/0 conn(0x7efe040cf4d0 legacy=0x7efe040b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.612+0000 7efe09600700 1 -- 172.21.15.82:0/2655542714 >> v1:172.21.15.82:6789/0 conn(0x7efe0406c160 legacy=0x7efe0406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.612+0000 7efe09600700 1 -- 172.21.15.82:0/2655542714 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04162bf0 con 0x7efe04162150 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.612+0000 7efe09600700 1 --2- 172.21.15.82:0/2655542714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efe04162150 0x7efe0415e610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009870 tx=0x7efdf8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bcc54b3586a1d9e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.613+0000 7efe03e00700 1 -- 172.21.15.82:0/2655542714 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0019f0 con 0x7efe04162150 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.613+0000 7efe03e00700 1 -- 172.21.15.82:0/2655542714 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8004030 con 0x7efe04162150 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.613+0000 7efe03e00700 1 -- 172.21.15.82:0/2655542714 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80043c0 con 0x7efe04162150 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.613+0000 7efe0c000700 1 -- 172.21.15.82:0/2655542714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efe04162150 msgr2=0x7efe0415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.613+0000 7efe0c000700 1 --2- 172.21.15.82:0/2655542714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efe04162150 0x7efe0415e610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009870 tx=0x7efdf8009b80 comp rx=0 tx=0).stop 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.613+0000 7efe0c000700 1 -- 172.21.15.82:0/2655542714 shutdown_connections 2024-05-10T04:50:30.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.613+0000 7efe0c000700 1 --2- 172.21.15.82:0/2655542714 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efe04162150 0x7efe0415e610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.613+0000 7efe0c000700 1 -- 172.21.15.82:0/2655542714 >> 172.21.15.82:0/2655542714 conn(0x7efe040d3e10 msgr2=0x7efe040d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.614+0000 7efe0c000700 1 -- 172.21.15.82:0/2655542714 shutdown_connections 2024-05-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.614+0000 7efe0c000700 1 -- 172.21.15.82:0/2655542714 wait complete. 2024-05-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.616+0000 7efe0c000700 1 Processor -- start 2024-05-10T04:50:30.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.616+0000 7efe0c000700 1 -- start start 2024-05-10T04:50:30.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.617+0000 7efe0c000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe0406c160 0x7efe041e8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.617+0000 7efe0c000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efe040cf4d0 0x7efe041ea640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.617+0000 7efe0c000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efe04162150 0x7efe041604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.617+0000 7efe0c000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04152060 con 0x7efe0406c160 2024-05-10T04:50:30.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.617+0000 7efe0c000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe041e8ed0 con 0x7efe040cf4d0 2024-05-10T04:50:30.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.617+0000 7efe0c000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe041e9120 con 0x7efe04162150 2024-05-10T04:50:30.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe0406c160 0x7efe041e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe0406c160 0x7efe041e8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42772/0 (socket says 172.21.15.82:42772) 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 -- 172.21.15.82:0/3608981874 learned_addr learned my addr 172.21.15.82:0/3608981874 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 -- 172.21.15.82:0/3608981874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efe04162150 msgr2=0x7efe041604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efe04162150 0x7efe041604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 -- 172.21.15.82:0/3608981874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efe040cf4d0 msgr2=0x7efe041ea640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efe040cf4d0 0x7efe041ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 -- 172.21.15.82:0/3608981874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80094a0 con 0x7efe0406c160 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe09600700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe0406c160 0x7efe041e8960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efdf80090b0 tx=0x7efdf80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe01600700 1 -- 172.21.15.82:0/3608981874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8011830 con 0x7efe0406c160 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe01600700 1 -- 172.21.15.82:0/3608981874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf80119b0 con 0x7efe0406c160 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe01600700 1 -- 172.21.15.82:0/3608981874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8011d60 con 0x7efe0406c160 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.618+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe041e9400 con 0x7efe0406c160 2024-05-10T04:50:30.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.619+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe041e99c0 con 0x7efe0406c160 2024-05-10T04:50:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.620+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe04074af0 con 0x7efe0406c160 2024-05-10T04:50:30.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.621+0000 7efe01600700 1 -- 172.21.15.82:0/3608981874 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efdf801b440 con 0x7efe0406c160 2024-05-10T04:50:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.621+0000 7efe01600700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efde406ac90 0x7efde406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.621+0000 7efe01600700 1 -- 172.21.15.82:0/3608981874 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdf808ad20 con 0x7efe0406c160 2024-05-10T04:50:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.622+0000 7efe08c00700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efde406ac90 0x7efde406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:30.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.622+0000 7efe08c00700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efde406ac90 0x7efde406d1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efdf0000f60 tx=0x7efdf0007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:30.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.626+0000 7efe01600700 1 -- 172.21.15.82:0/3608981874 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efdf8056010 con 0x7efe0406c160 2024-05-10T04:50:30.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.825+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe04161ec0 con 0x7efe0406c160 2024-05-10T04:50:30.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.826+0000 7efe01600700 1 -- 172.21.15.82:0/3608981874 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdf802a020 con 0x7efe0406c160 2024-05-10T04:50:30.827 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:50:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efde406ac90 msgr2=0x7efde406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efde406ac90 0x7efde406d1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efdf0000f60 tx=0x7efdf0007a40 comp rx=0 tx=0).stop 2024-05-10T04:50:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe0406c160 msgr2=0x7efe041e8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe0406c160 0x7efe041e8960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efdf80090b0 tx=0x7efdf80047c0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 shutdown_connections 2024-05-10T04:50:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efde406ac90 0x7efde406d1a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efe04162150 0x7efe041604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe0406c160 0x7efe041e8960 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 --2- 172.21.15.82:0/3608981874 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efe040cf4d0 0x7efe041ea640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.828+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 >> 172.21.15.82:0/3608981874 conn(0x7efe040d3e10 msgr2=0x7efe040b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.829+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 shutdown_connections 2024-05-10T04:50:30.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:30.829+0000 7efe0c000700 1 -- 172.21.15.82:0/3608981874 wait complete. 2024-05-10T04:50:30.858 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:50:31.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.121+0000 7f4461e00700 1 Processor -- start 2024-05-10T04:50:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.121+0000 7f4461e00700 1 -- start start 2024-05-10T04:50:31.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f4461e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f445c0b5fa0 0x7f445c0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f4461e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c15f900 con 0x7f445c15f4f0 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f4461e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c162a70 con 0x7f445c15bfe0 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f4461e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c15c3f0 con 0x7f445c0b5fa0 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f445a000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f445c15f4f0 0x7f445c0b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36696/0 (socket says 172.21.15.82:36696) 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f445a000700 1 -- 172.21.15.82:0/3787194341 learned_addr learned my addr 172.21.15.82:0/3787194341 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f445b400700 1 --2- 172.21.15.82:0/3787194341 >> v2:172.21.15.82:3300/0 conn(0x7f445c0b5fa0 0x7f445c0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f4459600700 1 -- 172.21.15.82:0/3787194341 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749774664 0 0) 0x7f4448001110 con 0x7f445c15f4f0 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f4459600700 1 -- 172.21.15.82:0/3787194341 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44400035b0 con 0x7f445c15f4f0 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.123+0000 7f4459600700 1 -- 172.21.15.82:0/3787194341 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571913246 0 0) 0x7f445c162a70 con 0x7f445c15bfe0 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.124+0000 7f4459600700 1 -- 172.21.15.82:0/3787194341 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4448001110 con 0x7f445c15bfe0 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.124+0000 7f445b400700 1 -- 172.21.15.82:0/3787194341 >> v1:172.21.15.129:6789/0 conn(0x7f445c15bfe0 legacy=0x7f445c161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.124+0000 7f445b400700 1 -- 172.21.15.82:0/3787194341 >> v1:172.21.15.82:6789/0 conn(0x7f445c15f4f0 legacy=0x7f445c0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.124+0000 7f445b400700 1 -- 172.21.15.82:0/3787194341 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c162d50 con 0x7f445c0b5fa0 2024-05-10T04:50:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.124+0000 7f445b400700 1 --2- 172.21.15.82:0/3787194341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c0b5fa0 0x7f445c0b2890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4454009d90 tx=0x7f445400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cfe4fd5a47fdf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.124+0000 7f4459600700 1 -- 172.21.15.82:0/3787194341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400e070 con 0x7f445c0b5fa0 2024-05-10T04:50:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.124+0000 7f4459600700 1 -- 172.21.15.82:0/3787194341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445400bb20 con 0x7f445c0b5fa0 2024-05-10T04:50:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.124+0000 7f4459600700 1 -- 172.21.15.82:0/3787194341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4454012430 con 0x7f445c0b5fa0 2024-05-10T04:50:31.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.125+0000 7f4461e00700 1 -- 172.21.15.82:0/3787194341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c0b5fa0 msgr2=0x7f445c0b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.125+0000 7f4461e00700 1 --2- 172.21.15.82:0/3787194341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c0b5fa0 0x7f445c0b2890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4454009d90 tx=0x7f445400b330 comp rx=0 tx=0).stop 2024-05-10T04:50:31.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.125+0000 7f4461e00700 1 -- 172.21.15.82:0/3787194341 shutdown_connections 2024-05-10T04:50:31.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.125+0000 7f4461e00700 1 --2- 172.21.15.82:0/3787194341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c0b5fa0 0x7f445c0b2890 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.125+0000 7f4461e00700 1 -- 172.21.15.82:0/3787194341 >> 172.21.15.82:0/3787194341 conn(0x7f445c0d0a70 msgr2=0x7f445c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:31.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.125+0000 7f4461e00700 1 -- 172.21.15.82:0/3787194341 shutdown_connections 2024-05-10T04:50:31.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.125+0000 7f4461e00700 1 -- 172.21.15.82:0/3787194341 wait complete. 2024-05-10T04:50:31.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.127+0000 7f4461e00700 1 Processor -- start 2024-05-10T04:50:31.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.127+0000 7f4461e00700 1 -- start start 2024-05-10T04:50:31.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f4461e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c15bfe0 0x7f445c15b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f4461e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f445c15f4f0 0x7f445c0b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f4461e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f445c1f4940 0x7f445c0b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f4461e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c1f5b90 con 0x7f445c15bfe0 2024-05-10T04:50:31.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f4461e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c1f4ed0 con 0x7f445c1f4940 2024-05-10T04:50:31.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f4461e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445c0cb440 con 0x7f445c15f4f0 2024-05-10T04:50:31.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f445aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c15bfe0 0x7f445c15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f445aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c15bfe0 0x7f445c15b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42784/0 (socket says 172.21.15.82:42784) 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f445aa00700 1 -- 172.21.15.82:0/336782102 learned_addr learned my addr 172.21.15.82:0/336782102 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f445a000700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f445c15f4f0 0x7f445c0b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.129+0000 7f445b400700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f445c1f4940 0x7f445c0b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f445aa00700 1 -- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f445c15f4f0 msgr2=0x7f445c0b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f445aa00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f445c15f4f0 0x7f445c0b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f445aa00700 1 -- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f445c1f4940 msgr2=0x7f445c0b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f445aa00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f445c1f4940 0x7f445c0b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f445aa00700 1 -- 172.21.15.82:0/336782102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454009a70 con 0x7f445c15bfe0 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f445b400700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f445c1f4940 0x7f445c0b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f445a000700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f445c15f4f0 0x7f445c0b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f445aa00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c15bfe0 0x7f445c15b540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f444c00c500 tx=0x7f444c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f4453400700 1 -- 172.21.15.82:0/336782102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0052d0 con 0x7f445c15bfe0 2024-05-10T04:50:31.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f4453400700 1 -- 172.21.15.82:0/336782102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c005450 con 0x7f445c15bfe0 2024-05-10T04:50:31.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f4453400700 1 -- 172.21.15.82:0/336782102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0038c0 con 0x7f445c15bfe0 2024-05-10T04:50:31.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c0b9b90 con 0x7f445c15bfe0 2024-05-10T04:50:31.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.130+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c0cae80 con 0x7f445c15bfe0 2024-05-10T04:50:31.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.131+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c074af0 con 0x7f445c15bfe0 2024-05-10T04:50:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.132+0000 7f4453400700 1 -- 172.21.15.82:0/336782102 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f444c003a20 con 0x7f445c15bfe0 2024-05-10T04:50:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.133+0000 7f4453400700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f443c06acc0 0x7f443c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.133+0000 7f4453400700 1 -- 172.21.15.82:0/336782102 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f444c0888e0 con 0x7f445c15bfe0 2024-05-10T04:50:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.133+0000 7f445a000700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f443c06acc0 0x7f443c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.134+0000 7f445a000700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f443c06acc0 0x7f443c06d1d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f445c0b6d40 tx=0x7f4448009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:31.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.138+0000 7f4453400700 1 -- 172.21.15.82:0/336782102 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f444c053990 con 0x7f445c15bfe0 2024-05-10T04:50:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.382+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f445c0d2210 con 0x7f445c15bfe0 2024-05-10T04:50:31.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.383+0000 7f4453400700 1 -- 172.21.15.82:0/336782102 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f444c017020 con 0x7f445c15bfe0 2024-05-10T04:50:31.384 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:31.384 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:50:16.068598+0000","modified":"2024-05-10T04:50:19.501679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:50:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f443c06acc0 msgr2=0x7f443c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f443c06acc0 0x7f443c06d1d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f445c0b6d40 tx=0x7f4448009040 comp rx=0 tx=0).stop 2024-05-10T04:50:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c15bfe0 msgr2=0x7f445c15b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c15bfe0 0x7f445c15b540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f444c00c500 tx=0x7f444c00c8c0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 shutdown_connections 2024-05-10T04:50:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f443c06acc0 0x7f443c06d1d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f445c1f4940 0x7f445c0b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f445c15bfe0 0x7f445c15b540 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 --2- 172.21.15.82:0/336782102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f445c15f4f0 0x7f445c0b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 >> 172.21.15.82:0/336782102 conn(0x7f445c0d0a70 msgr2=0x7f445c0c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 shutdown_connections 2024-05-10T04:50:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.385+0000 7f4461e00700 1 -- 172.21.15.82:0/336782102 wait complete. 2024-05-10T04:50:31.392 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-10T04:50:31.412 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.676+0000 7faea8e00700 1 Processor -- start 2024-05-10T04:50:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.676+0000 7faea8e00700 1 -- start start 2024-05-10T04:50:31.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.678+0000 7faea8e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7faea415f4f0 0x7faea40b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.678+0000 7faea8e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b5dd0 0x7faea40b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.678+0000 7faea8e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea415f900 con 0x7faea415bfe0 2024-05-10T04:50:31.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.678+0000 7faea8e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea415c3f0 con 0x7faea415f4f0 2024-05-10T04:50:31.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.678+0000 7faea8e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea40b61e0 con 0x7faea40b5dd0 2024-05-10T04:50:31.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.678+0000 7faea1e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faea415bfe0 0x7faea4161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36700/0 (socket says 172.21.15.82:36700) 2024-05-10T04:50:31.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.678+0000 7faea1e00700 1 -- 172.21.15.82:0/360849735 learned_addr learned my addr 172.21.15.82:0/360849735 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:31.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea2800700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b5dd0 0x7faea40b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7fae9be00700 1 --2- 172.21.15.82:0/360849735 >> v2:172.21.15.129:3300/0 conn(0x7faea415f4f0 0x7faea40b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362460192 0 0) 0x7fae94001110 con 0x7faea415bfe0 2024-05-10T04:50:31.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae880035b0 con 0x7faea415bfe0 2024-05-10T04:50:31.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856369769 0 0) 0x7fae880035b0 con 0x7faea415bfe0 2024-05-10T04:50:31.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b5dd0 msgr2=0x7faea40b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:31.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b5dd0 0x7faea40b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 >> v2:172.21.15.129:3300/0 conn(0x7faea415f4f0 msgr2=0x7faea40b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:31.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 --2- 172.21.15.82:0/360849735 >> v2:172.21.15.129:3300/0 conn(0x7faea415f4f0 0x7faea40b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea4162a70 con 0x7faea415bfe0 2024-05-10T04:50:31.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fae94001800 con 0x7faea415bfe0 2024-05-10T04:50:31.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 >> v1:172.21.15.82:6789/0 conn(0x7faea415bfe0 legacy=0x7faea4161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7fae88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b5dd0 0x7fae88004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae88004d90 0x7fae880051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea415c3f0 con 0x7fae88003a00 2024-05-10T04:50:31.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea40b61e0 con 0x7fae88004d90 2024-05-10T04:50:31.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8800ba10 con 0x7faea40b5dd0 2024-05-10T04:50:31.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.679+0000 7faea1e00700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7fae88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7fae9be00700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b5dd0 0x7fae88004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea2800700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae88004d90 0x7fae880051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1e00700 1 -- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b5dd0 msgr2=0x7fae88004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:31.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1e00700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b5dd0 0x7fae88004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1e00700 1 -- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae88004d90 msgr2=0x7fae880051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:31.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1e00700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fae88004d90 0x7fae880051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1e00700 1 -- 172.21.15.82:0/360849735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880035b0 con 0x7fae88003a00 2024-05-10T04:50:31.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1e00700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7fae88003e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c2f0 tx=0x7fae88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa7aeb114ddc658 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:31.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9400cd70 con 0x7fae88003a00 2024-05-10T04:50:31.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae94005960 con 0x7fae88003a00 2024-05-10T04:50:31.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.680+0000 7faea1400700 1 -- 172.21.15.82:0/360849735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94005d10 con 0x7fae88003a00 2024-05-10T04:50:31.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.681+0000 7faea8e00700 1 -- 172.21.15.82:0/360849735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 msgr2=0x7fae88003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.681+0000 7faea8e00700 1 --2- 172.21.15.82:0/360849735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7fae88003e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fae9400c2f0 tx=0x7fae88005880 comp rx=0 tx=0).stop 2024-05-10T04:50:31.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.681+0000 7faea2800700 1 -- 172.21.15.82:0/360849735 reap_dead start 2024-05-10T04:50:31.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.681+0000 7faea8e00700 1 -- 172.21.15.82:0/360849735 shutdown_connections 2024-05-10T04:50:31.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.681+0000 7faea8e00700 1 -- 172.21.15.82:0/360849735 >> 172.21.15.82:0/360849735 conn(0x7faea40d0a70 msgr2=0x7faea40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:31.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.681+0000 7faea8e00700 1 -- 172.21.15.82:0/360849735 shutdown_connections 2024-05-10T04:50:31.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.681+0000 7faea8e00700 1 -- 172.21.15.82:0/360849735 wait complete. 2024-05-10T04:50:31.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.684+0000 7faea8e00700 1 Processor -- start 2024-05-10T04:50:31.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.684+0000 7faea8e00700 1 -- start start 2024-05-10T04:50:31.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea8e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7faea415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea8e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faea40ca2b0 0x7faea41f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea8e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b9150 0x7faea40b9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea8e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea40cb620 con 0x7fae88003a00 2024-05-10T04:50:31.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea8e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea41f5220 con 0x7faea40ca2b0 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea8e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea40b20e0 con 0x7faea40b9150 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7faea415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7faea415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42814/0 (socket says 172.21.15.82:42814) 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.685+0000 7faea1e00700 1 -- 172.21.15.82:0/3126302774 learned_addr learned my addr 172.21.15.82:0/3126302774 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea1e00700 1 -- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b9150 msgr2=0x7faea40b9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7fae9be00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faea40ca2b0 0x7faea41f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea2800700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b9150 0x7faea40b9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea1e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b9150 0x7faea40b9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea1e00700 1 -- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faea40ca2b0 msgr2=0x7faea41f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea1e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faea40ca2b0 0x7faea41f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea1e00700 1 -- 172.21.15.82:0/3126302774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea40b9aa0 con 0x7fae88003a00 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea2800700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b9150 0x7faea40b9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:31.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7fae9be00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faea40ca2b0 0x7faea41f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea1e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7faea415b320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faea40b66e0 tx=0x7fae94000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7fae9a000700 1 -- 172.21.15.82:0/3126302774 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94004870 con 0x7fae88003a00 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7fae9a000700 1 -- 172.21.15.82:0/3126302774 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae940049d0 con 0x7fae88003a00 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7fae9a000700 1 -- 172.21.15.82:0/3126302774 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94004d80 con 0x7fae88003a00 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea40b2330 con 0x7fae88003a00 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.686+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea40cb240 con 0x7fae88003a00 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.688+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea4074af0 con 0x7fae88003a00 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.688+0000 7fae9a000700 1 -- 172.21.15.82:0/3126302774 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae94005040 con 0x7fae88003a00 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.689+0000 7fae9a000700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fae8006ac90 0x7fae8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.689+0000 7fae9a000700 1 -- 172.21.15.82:0/3126302774 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae94089eb0 con 0x7fae88003a00 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.690+0000 7fae9be00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fae8006ac90 0x7fae8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.690+0000 7fae9be00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fae8006ac90 0x7fae8006d1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faea40d4a40 tx=0x7fae8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:31.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.694+0000 7fae9a000700 1 -- 172.21.15.82:0/3126302774 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fae94055240 con 0x7fae88003a00 2024-05-10T04:50:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.896+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faea415f900 con 0x7fae88003a00 2024-05-10T04:50:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.897+0000 7fae9a000700 1 -- 172.21.15.82:0/3126302774 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7faea415f900 con 0x7fae88003a00 2024-05-10T04:50:31.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:31.899 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fae8006ac90 msgr2=0x7fae8006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fae8006ac90 0x7fae8006d1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faea40d4a40 tx=0x7fae8c008040 comp rx=0 tx=0).stop 2024-05-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 msgr2=0x7faea415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7faea415b320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faea40b66e0 tx=0x7fae94000fe0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 shutdown_connections 2024-05-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fae8006ac90 0x7fae8006d1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faea40b9150 0x7faea40b9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae88003a00 0x7faea415b320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 --2- 172.21.15.82:0/3126302774 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faea40ca2b0 0x7faea41f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 >> 172.21.15.82:0/3126302774 conn(0x7faea40d0a70 msgr2=0x7faea415faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 shutdown_connections 2024-05-10T04:50:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:31.900+0000 7faea8e00700 1 -- 172.21.15.82:0/3126302774 wait complete. 2024-05-10T04:50:31.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:31.929 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:32.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.196+0000 7f40df200700 1 Processor -- start 2024-05-10T04:50:32.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.196+0000 7f40df200700 1 -- start start 2024-05-10T04:50:32.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40df200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d815e610 0x7f40d80b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40df200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f40d80b7910 0x7f40d806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40df200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d80d2c00 con 0x7f40d8162150 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40df200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d815ea20 con 0x7f40d80b7910 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40df200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8162630 con 0x7f40d815e610 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40d7e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f40d8162150 0x7f40d80cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36710/0 (socket says 172.21.15.82:36710) 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40d7e00700 1 -- 172.21.15.82:0/331790076 learned_addr learned my addr 172.21.15.82:0/331790076 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40d7400700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d815e610 0x7f40d80b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40dd200700 1 --2- 172.21.15.82:0/331790076 >> v2:172.21.15.129:3300/0 conn(0x7f40d80b7910 0x7f40d806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.198+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771583428 0 0) 0x7f40d80d2c00 con 0x7f40d8162150 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40bc0035b0 con 0x7f40d8162150 2024-05-10T04:50:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2134265058 0 0) 0x7f40bc0035b0 con 0x7f40d8162150 2024-05-10T04:50:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d815e610 msgr2=0x7f40d80b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d815e610 0x7f40d80b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 >> v2:172.21.15.129:3300/0 conn(0x7f40d80b7910 msgr2=0x7f40d806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 --2- 172.21.15.82:0/331790076 >> v2:172.21.15.129:3300/0 conn(0x7f40d80b7910 0x7f40d806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8162910 con 0x7f40d8162150 2024-05-10T04:50:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f40c8001670 con 0x7f40d8162150 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 >> v1:172.21.15.82:6789/0 conn(0x7f40d8162150 legacy=0x7f40d80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d815e610 0x7f40bc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40bc003f80 0x7f40bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc004d90 0x7f40bc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d815ea20 con 0x7f40bc003f80 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8162630 con 0x7f40bc004d90 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc00bb10 con 0x7f40d815e610 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d7400700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40bc003f80 0x7f40bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40d7e00700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d815e610 0x7f40bc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.199+0000 7f40dd200700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc004d90 0x7f40bc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d7400700 1 -- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d815e610 msgr2=0x7f40bc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d7400700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d815e610 0x7f40bc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d7400700 1 -- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc004d90 msgr2=0x7f40bc0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d7400700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc004d90 0x7f40bc0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d7400700 1 -- 172.21.15.82:0/331790076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0035b0 con 0x7f40bc003f80 2024-05-10T04:50:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d7400700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40bc003f80 0x7f40bc004850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009b60 tx=0x7f40bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90130da3657f7e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400e6c0 con 0x7f40bc003f80 2024-05-10T04:50:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400e820 con 0x7f40bc003f80 2024-05-10T04:50:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.200+0000 7f40d6a00700 1 -- 172.21.15.82:0/331790076 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400eb90 con 0x7f40bc003f80 2024-05-10T04:50:32.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.201+0000 7f40df200700 1 -- 172.21.15.82:0/331790076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40bc003f80 msgr2=0x7f40bc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.201+0000 7f40df200700 1 --2- 172.21.15.82:0/331790076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40bc003f80 0x7f40bc004850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009b60 tx=0x7f40bc005880 comp rx=0 tx=0).stop 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.201+0000 7f40dd200700 1 -- 172.21.15.82:0/331790076 reap_dead start 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.201+0000 7f40df200700 1 -- 172.21.15.82:0/331790076 shutdown_connections 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.201+0000 7f40df200700 1 -- 172.21.15.82:0/331790076 >> 172.21.15.82:0/331790076 conn(0x7f40d80d3e10 msgr2=0x7f40d80d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.201+0000 7f40df200700 1 -- 172.21.15.82:0/331790076 shutdown_connections 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.201+0000 7f40df200700 1 -- 172.21.15.82:0/331790076 wait complete. 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.203+0000 7f40df200700 1 Processor -- start 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.203+0000 7f40df200700 1 -- start start 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40df200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc003f80 0x7f40d815f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40df200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d81f7d80 0x7f40d8160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40df200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d81f8190 0x7f40d81606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40df200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8160ef0 con 0x7f40d81f7d80 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40df200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d81f8710 con 0x7f40bc003f80 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40df200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8158650 con 0x7f40d81f8190 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d81f7d80 0x7f40d8160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc003f80 0x7f40d815f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d81f7d80 0x7f40d8160160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42836/0 (socket says 172.21.15.82:42836) 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7400700 1 -- 172.21.15.82:0/3561658402 learned_addr learned my addr 172.21.15.82:0/3561658402 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40dd200700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d81f8190 0x7f40d81606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7400700 1 -- 172.21.15.82:0/3561658402 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d81f8190 msgr2=0x7f40d81606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7400700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d81f8190 0x7f40d81606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7400700 1 -- 172.21.15.82:0/3561658402 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc003f80 msgr2=0x7f40d815f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7400700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc003f80 0x7f40d815f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.205+0000 7f40d7400700 1 -- 172.21.15.82:0/3561658402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d81f8960 con 0x7f40d81f7d80 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.206+0000 7f40d7400700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d81f7d80 0x7f40d8160160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f40c40090b0 tx=0x7f40c40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.206+0000 7f40cfe00700 1 -- 172.21.15.82:0/3561658402 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400e6c0 con 0x7f40d81f7d80 2024-05-10T04:50:32.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.206+0000 7f40cfe00700 1 -- 172.21.15.82:0/3561658402 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c40038c0 con 0x7f40d81f7d80 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.206+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d81f8c40 con 0x7f40d81f7d80 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.206+0000 7f40cfe00700 1 -- 172.21.15.82:0/3561658402 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4003c70 con 0x7f40d81f7d80 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.206+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d815eee0 con 0x7f40d81f7d80 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.207+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d8074af0 con 0x7f40d81f7d80 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.208+0000 7f40cfe00700 1 -- 172.21.15.82:0/3561658402 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40c4013470 con 0x7f40d81f7d80 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.210+0000 7f40cfe00700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40b806acc0 0x7f40b806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.210+0000 7f40cfe00700 1 -- 172.21.15.82:0/3561658402 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40c408aa90 con 0x7f40d81f7d80 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.210+0000 7f40d7e00700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40b806acc0 0x7f40b806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.210+0000 7f40d7e00700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40b806acc0 0x7f40b806d1d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40c8000c00 tx=0x7f40c8007980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:32.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.215+0000 7f40cfe00700 1 -- 172.21.15.82:0/3561658402 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f40c4055d80 con 0x7f40d81f7d80 2024-05-10T04:50:32.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.418+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40d80cf990 con 0x7f40d81f7d80 2024-05-10T04:50:32.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.418+0000 7f40cfe00700 1 -- 172.21.15.82:0/3561658402 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40c40090e0 con 0x7f40d81f7d80 2024-05-10T04:50:32.421 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40b806acc0 msgr2=0x7f40b806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40b806acc0 0x7f40b806d1d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40c8000c00 tx=0x7f40c8007980 comp rx=0 tx=0).stop 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d81f7d80 msgr2=0x7f40d8160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d81f7d80 0x7f40d8160160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f40c40090b0 tx=0x7f40c40047c0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 shutdown_connections 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f40b806acc0 0x7f40b806d1d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f40d81f8190 0x7f40d81606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f40bc003f80 0x7f40d815f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 --2- 172.21.15.82:0/3561658402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40d81f7d80 0x7f40d8160160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 >> 172.21.15.82:0/3561658402 conn(0x7f40d80d3e10 msgr2=0x7f40d80b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 shutdown_connections 2024-05-10T04:50:32.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.421+0000 7f40df200700 1 -- 172.21.15.82:0/3561658402 wait complete. 2024-05-10T04:50:32.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.711+0000 7f9c76e00700 1 Processor -- start 2024-05-10T04:50:32.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.711+0000 7f9c76e00700 1 -- start start 2024-05-10T04:50:32.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.713+0000 7f9c76e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9c7006c160 0x7f9c7006c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.713+0000 7f9c76e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c700d2c00 con 0x7f9c7015e610 2024-05-10T04:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.713+0000 7f9c76e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7006cab0 con 0x7f9c70162150 2024-05-10T04:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.713+0000 7f9c76e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7015ea20 con 0x7f9c7006c160 2024-05-10T04:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.713+0000 7f9c6f400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9c7015e610 0x7f9c700b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36722/0 (socket says 172.21.15.82:36722) 2024-05-10T04:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.713+0000 7f9c6f400700 1 -- 172.21.15.82:0/3954813061 learned_addr learned my addr 172.21.15.82:0/3954813061 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.713+0000 7f9c74e00700 1 --2- 172.21.15.82:0/3954813061 >> v2:172.21.15.129:3300/0 conn(0x7f9c7006c160 0x7f9c7006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.713+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828664993 0 0) 0x7f9c700d2c00 con 0x7f9c7015e610 2024-05-10T04:50:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c540035b0 con 0x7f9c7015e610 2024-05-10T04:50:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2016721522 0 0) 0x7f9c540035b0 con 0x7f9c7015e610 2024-05-10T04:50:32.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 >> v2:172.21.15.129:3300/0 conn(0x7f9c7006c160 msgr2=0x7f9c7006c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 --2- 172.21.15.82:0/3954813061 >> v2:172.21.15.129:3300/0 conn(0x7f9c7006c160 0x7f9c7006c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 >> v1:172.21.15.129:6789/0 conn(0x7f9c70162150 legacy=0x7f9c700cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c70162630 con 0x7f9c7015e610 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f9c5c001670 con 0x7f9c7015e610 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 >> v1:172.21.15.82:6789/0 conn(0x7f9c7015e610 legacy=0x7f9c700b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c54003a00 0x7f9c54003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c54004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c540052a0 0x7f9c5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7015ea20 con 0x7f9c54004850 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5400c230 con 0x7f9c54003a00 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5400c3f0 con 0x7f9c540052a0 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6f400700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c54004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c6fe00700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c54003a00 0x7f9c54003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.714+0000 7f9c74e00700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c540052a0 0x7f9c5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6f400700 1 -- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c540052a0 msgr2=0x7f9c5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6f400700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c540052a0 0x7f9c5400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6f400700 1 -- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c54003a00 msgr2=0x7f9c54003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6f400700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c54003a00 0x7f9c54003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6f400700 1 -- 172.21.15.82:0/3954813061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540035b0 con 0x7f9c54004850 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c74e00700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c540052a0 0x7f9c5400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c74e00700 1 -- 172.21.15.82:0/3954813061 reap_dead start 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6f400700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c54004c60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c240 tx=0x7f9c54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61891f815cfd7d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c007c10 con 0x7f9c54004850 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00ce00 con 0x7f9c54004850 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.715+0000 7f9c6ea00700 1 -- 172.21.15.82:0/3954813061 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c005ba0 con 0x7f9c54004850 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.716+0000 7f9c76e00700 1 -- 172.21.15.82:0/3954813061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 msgr2=0x7f9c54004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.716+0000 7f9c76e00700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c54004c60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c240 tx=0x7f9c54005880 comp rx=0 tx=0).stop 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.716+0000 7f9c76e00700 1 -- 172.21.15.82:0/3954813061 shutdown_connections 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.716+0000 7f9c76e00700 1 --2- 172.21.15.82:0/3954813061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c54004c60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.716+0000 7f9c76e00700 1 -- 172.21.15.82:0/3954813061 >> 172.21.15.82:0/3954813061 conn(0x7f9c700d3e10 msgr2=0x7f9c700d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.716+0000 7f9c76e00700 1 -- 172.21.15.82:0/3954813061 shutdown_connections 2024-05-10T04:50:32.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.716+0000 7f9c76e00700 1 -- 172.21.15.82:0/3954813061 wait complete. 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.718+0000 7f9c76e00700 1 Processor -- start 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.719+0000 7f9c76e00700 1 -- start start 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c76e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c7014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c76e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c70155c50 0x7f9c70156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c76e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c70158240 0x7f9c70158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c76e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7014f1a0 con 0x7f9c54004850 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c76e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c701517b0 con 0x7f9c70155c50 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c76e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c70153cd0 con 0x7f9c70158240 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c6fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c7014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c6fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c7014ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42842/0 (socket says 172.21.15.82:42842) 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.720+0000 7f9c6fe00700 1 -- 172.21.15.82:0/2433502750 learned_addr learned my addr 172.21.15.82:0/2433502750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c74e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c70158240 0x7f9c70158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c6f400700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c70155c50 0x7f9c70156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c6fe00700 1 -- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c70158240 msgr2=0x7f9c70158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c6fe00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c70158240 0x7f9c70158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c6fe00700 1 -- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c70155c50 msgr2=0x7f9c70156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c6fe00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c70155c50 0x7f9c70156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c6fe00700 1 -- 172.21.15.82:0/2433502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c70158b90 con 0x7f9c54004850 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c74e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c70158240 0x7f9c70158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c6f400700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c70155c50 0x7f9c70156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c6fe00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c7014ec60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000f820 tx=0x7f9c6000fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c67e00700 1 -- 172.21.15.82:0/2433502750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600052e0 con 0x7f9c54004850 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c67e00700 1 -- 172.21.15.82:0/2433502750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60005460 con 0x7f9c54004850 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c70153f20 con 0x7f9c54004850 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c67e00700 1 -- 172.21.15.82:0/2433502750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600038c0 con 0x7f9c54004850 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.721+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c701544e0 con 0x7f9c54004850 2024-05-10T04:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.722+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c70074af0 con 0x7f9c54004850 2024-05-10T04:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.723+0000 7f9c67e00700 1 -- 172.21.15.82:0/2433502750 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c60003a20 con 0x7f9c54004850 2024-05-10T04:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.724+0000 7f9c67e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c5006acc0 0x7f9c5006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.724+0000 7f9c67e00700 1 -- 172.21.15.82:0/2433502750 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c600891c0 con 0x7f9c54004850 2024-05-10T04:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.724+0000 7f9c6f400700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c5006acc0 0x7f9c5006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.725+0000 7f9c6f400700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c5006acc0 0x7f9c5006d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c7006c880 tx=0x7f9c5c007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.729+0000 7f9c67e00700 1 -- 172.21.15.82:0/2433502750 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9c60054300 con 0x7f9c54004850 2024-05-10T04:50:32.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.931+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c701565a0 con 0x7f9c54004850 2024-05-10T04:50:32.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.931+0000 7f9c67e00700 1 -- 172.21.15.82:0/2433502750 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c60057920 con 0x7f9c54004850 2024-05-10T04:50:32.933 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c5006acc0 msgr2=0x7f9c5006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c5006acc0 0x7f9c5006d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9c7006c880 tx=0x7f9c5c007000 comp rx=0 tx=0).stop 2024-05-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 msgr2=0x7f9c7014ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c7014ec60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000f820 tx=0x7f9c6000fbe0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 shutdown_connections 2024-05-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c5006acc0 0x7f9c5006d1d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c70158240 0x7f9c70158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c54004850 0x7f9c7014ec60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 --2- 172.21.15.82:0/2433502750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c70155c50 0x7f9c70156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.933+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 >> 172.21.15.82:0/2433502750 conn(0x7f9c700d3e10 msgr2=0x7f9c700b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.934+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 shutdown_connections 2024-05-10T04:50:32.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:32.934+0000 7f9c76e00700 1 -- 172.21.15.82:0/2433502750 wait complete. 2024-05-10T04:50:32.959 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:50:33.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.223+0000 7f38d6e00700 1 Processor -- start 2024-05-10T04:50:33.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.223+0000 7f38d6e00700 1 -- start start 2024-05-10T04:50:33.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.224+0000 7f38d6e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00b31e0 0x7f38d00d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.224+0000 7f38d6e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38d00d0b10 0x7f38d00b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d6e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00d27e0 con 0x7f38d00d3510 2024-05-10T04:50:33.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d6e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d00d3080 con 0x7f38d00d0b10 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d6e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00cf6e0 con 0x7f38d00b31e0 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d4e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38d00d0b10 0x7f38d00b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d4e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f38d00d0b10 0x7f38d00b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42844/0 (socket says 172.21.15.82:42844) 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d4e00700 1 -- 172.21.15.82:0/2793603527 learned_addr learned my addr 172.21.15.82:0/2793603527 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38cf400700 1 --2- 172.21.15.82:0/2793603527 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00b31e0 0x7f38d00d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d4e00700 1 -- 172.21.15.82:0/2793603527 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00b31e0 msgr2=0x7f38d00d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d4e00700 1 --2- 172.21.15.82:0/2793603527 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00b31e0 0x7f38d00d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d4e00700 1 -- 172.21.15.82:0/2793603527 >> v1:172.21.15.129:6789/0 conn(0x7f38d00d3510 legacy=0x7f38d00ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.225+0000 7f38d4e00700 1 -- 172.21.15.82:0/2793603527 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00d2a30 con 0x7f38d00d0b10 2024-05-10T04:50:33.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.226+0000 7f38d4e00700 1 --2- 172.21.15.82:0/2793603527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00d0b10 0x7f38d00b72b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009e50 tx=0x7f38c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6133005eb1f022c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.226+0000 7f38cea00700 1 -- 172.21.15.82:0/2793603527 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800e070 con 0x7f38d00d0b10 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.226+0000 7f38cea00700 1 -- 172.21.15.82:0/2793603527 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c8003a20 con 0x7f38d00d0b10 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.226+0000 7f38cea00700 1 -- 172.21.15.82:0/2793603527 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8003dd0 con 0x7f38d00d0b10 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.226+0000 7f38d6e00700 1 -- 172.21.15.82:0/2793603527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00d0b10 msgr2=0x7f38d00b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.226+0000 7f38d6e00700 1 --2- 172.21.15.82:0/2793603527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00d0b10 0x7f38d00b72b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38c8009e50 tx=0x7f38c800b330 comp rx=0 tx=0).stop 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.227+0000 7f38d6e00700 1 -- 172.21.15.82:0/2793603527 shutdown_connections 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.227+0000 7f38d6e00700 1 --2- 172.21.15.82:0/2793603527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00d0b10 0x7f38d00b72b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.227+0000 7f38d6e00700 1 --2- 172.21.15.82:0/2793603527 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00b31e0 0x7f38d00d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.227+0000 7f38d6e00700 1 -- 172.21.15.82:0/2793603527 >> 172.21.15.82:0/2793603527 conn(0x7f38d006c4b0 msgr2=0x7f38d006c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.227+0000 7f38d6e00700 1 -- 172.21.15.82:0/2793603527 shutdown_connections 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.227+0000 7f38d6e00700 1 -- 172.21.15.82:0/2793603527 wait complete. 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.229+0000 7f38d6e00700 1 Processor -- start 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.229+0000 7f38d6e00700 1 -- start start 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.230+0000 7f38d6e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00b31e0 0x7f38d01f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.230+0000 7f38d6e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d00d0b10 0x7f38d00ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.230+0000 7f38d6e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00d3510 0x7f38d0155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.230+0000 7f38d6e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00cc460 con 0x7f38d00b31e0 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.230+0000 7f38d6e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d01f5b40 con 0x7f38d00d0b10 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.230+0000 7f38d6e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d01f5ce0 con 0x7f38d00d3510 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00b31e0 0x7f38d01f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00b31e0 0x7f38d01f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42858/0 (socket says 172.21.15.82:42858) 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 -- 172.21.15.82:0/3372374551 learned_addr learned my addr 172.21.15.82:0/3372374551 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:33.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 -- 172.21.15.82:0/3372374551 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00d3510 msgr2=0x7f38d0155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00d3510 0x7f38d0155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 -- 172.21.15.82:0/3372374551 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d00d0b10 msgr2=0x7f38d00ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cf400700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d00d0b10 0x7f38d00ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d00d0b10 0x7f38d00ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 -- 172.21.15.82:0/3372374551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c8009b30 con 0x7f38d00b31e0 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.231+0000 7f38cfe00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00b31e0 0x7f38d01f4980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38c000b480 tx=0x7f38c000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.232+0000 7f38c7e00700 1 -- 172.21.15.82:0/3372374551 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0011830 con 0x7f38d00b31e0 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.232+0000 7f38c7e00700 1 -- 172.21.15.82:0/3372374551 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0011990 con 0x7f38d00b31e0 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.232+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d01f5180 con 0x7f38d00b31e0 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.232+0000 7f38c7e00700 1 -- 172.21.15.82:0/3372374551 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0011d40 con 0x7f38d00b31e0 2024-05-10T04:50:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.232+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d01f5990 con 0x7f38d00b31e0 2024-05-10T04:50:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.233+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d0074af0 con 0x7f38d00b31e0 2024-05-10T04:50:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.234+0000 7f38c7e00700 1 -- 172.21.15.82:0/3372374551 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f38c001a400 con 0x7f38d00b31e0 2024-05-10T04:50:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.235+0000 7f38c7e00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f38b006ac90 0x7f38b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.235+0000 7f38c7e00700 1 -- 172.21.15.82:0/3372374551 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38c0089020 con 0x7f38d00b31e0 2024-05-10T04:50:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.235+0000 7f38cf400700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f38b006ac90 0x7f38b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.236+0000 7f38cf400700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f38b006ac90 0x7f38b006d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38d015e190 tx=0x7f38bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.240+0000 7f38c7e00700 1 -- 172.21.15.82:0/3372374551 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f38c00542b0 con 0x7f38d00b31e0 2024-05-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.442+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38d00d21e0 con 0x7f38d00b31e0 2024-05-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.443+0000 7f38c7e00700 1 -- 172.21.15.82:0/3372374551 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38c00578d0 con 0x7f38d00b31e0 2024-05-10T04:50:33.444 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f38b006ac90 msgr2=0x7f38b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f38b006ac90 0x7f38b006d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38d015e190 tx=0x7f38bc008040 comp rx=0 tx=0).stop 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00b31e0 msgr2=0x7f38d01f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00b31e0 0x7f38d01f4980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38c000b480 tx=0x7f38c000b840 comp rx=0 tx=0).stop 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 shutdown_connections 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f38b006ac90 0x7f38b006d1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38d00d3510 0x7f38d0155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d00b31e0 0x7f38d01f4980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 --2- 172.21.15.82:0/3372374551 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38d00d0b10 0x7f38d00ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 >> 172.21.15.82:0/3372374551 conn(0x7f38d006c4b0 msgr2=0x7f38d015f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:33.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 shutdown_connections 2024-05-10T04:50:33.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.445+0000 7f38d6e00700 1 -- 172.21.15.82:0/3372374551 wait complete. 2024-05-10T04:50:33.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:50:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.734+0000 7ff8c9a00700 1 Processor -- start 2024-05-10T04:50:33.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.734+0000 7ff8c9a00700 1 -- start start 2024-05-10T04:50:33.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c9a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 0x7ff8c415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c9a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff8c4161fb0 0x7ff8c41623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c9a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8c40b5890 0x7ff8c40b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c9a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c415c3f0 con 0x7ff8c40b5890 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c9a00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c40b61e0 con 0x7ff8c4161fb0 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c9a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c4162a70 con 0x7ff8c415bfe0 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c3400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8c40b5890 0x7ff8c40b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c3400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8c40b5890 0x7ff8c40b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42874/0 (socket says 172.21.15.82:42874) 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8bbe00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff8c4161fb0 0x7ff8c41623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c3400700 1 -- 172.21.15.82:0/1434384706 learned_addr learned my addr 172.21.15.82:0/1434384706 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:33.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.736+0000 7ff8c2a00700 1 --2- 172.21.15.82:0/1434384706 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 0x7ff8c415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c3400700 1 -- 172.21.15.82:0/1434384706 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 msgr2=0x7ff8c415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c3400700 1 --2- 172.21.15.82:0/1434384706 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 0x7ff8c415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c3400700 1 -- 172.21.15.82:0/1434384706 >> v2:172.21.15.129:3300/0 conn(0x7ff8c4161fb0 msgr2=0x7ff8c41623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c3400700 1 --2- 172.21.15.82:0/1434384706 >> v2:172.21.15.129:3300/0 conn(0x7ff8c4161fb0 0x7ff8c41623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c3400700 1 -- 172.21.15.82:0/1434384706 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4162d50 con 0x7ff8c40b5890 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c3400700 1 --2- 172.21.15.82:0/1434384706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40b5ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40b65f0 tx=0x7ff8bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd2e971206efecb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c2000700 1 -- 172.21.15.82:0/1434384706 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00e070 con 0x7ff8c40b5890 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c2000700 1 -- 172.21.15.82:0/1434384706 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00b910 con 0x7ff8c40b5890 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.737+0000 7ff8c2000700 1 -- 172.21.15.82:0/1434384706 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00bcc0 con 0x7ff8c40b5890 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1434384706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 msgr2=0x7ff8c40b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:33.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1434384706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40b5ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40b65f0 tx=0x7ff8bc00b330 comp rx=0 tx=0).stop 2024-05-10T04:50:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1434384706 shutdown_connections 2024-05-10T04:50:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1434384706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40b5ca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1434384706 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 0x7ff8c415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1434384706 >> v2:172.21.15.129:3300/0 conn(0x7ff8c4161fb0 0x7ff8c41623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1434384706 >> 172.21.15.82:0/1434384706 conn(0x7ff8c40d0a70 msgr2=0x7ff8c40d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1434384706 shutdown_connections 2024-05-10T04:50:33.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.738+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1434384706 wait complete. 2024-05-10T04:50:33.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.740+0000 7ff8c9a00700 1 Processor -- start 2024-05-10T04:50:33.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.740+0000 7ff8c9a00700 1 -- start start 2024-05-10T04:50:33.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c9a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c9a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 0x7ff8c40ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c9a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff8c4161fb0 0x7ff8c415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c9a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40b5710 con 0x7ff8c40b5890 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c9a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40c9e10 con 0x7ff8c4161fb0 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c9a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40b4a90 con 0x7ff8c415bfe0 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42888/0 (socket says 172.21.15.82:42888) 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c2a00700 1 -- 172.21.15.82:0/1595892232 learned_addr learned my addr 172.21.15.82:0/1595892232 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8bbe00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 0x7ff8c40ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c3400700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff8c4161fb0 0x7ff8c415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c2a00700 1 -- 172.21.15.82:0/1595892232 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 msgr2=0x7ff8c40ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c2a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 0x7ff8c40ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c2a00700 1 -- 172.21.15.82:0/1595892232 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff8c4161fb0 msgr2=0x7ff8c415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c2a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff8c4161fb0 0x7ff8c415d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.742+0000 7ff8c2a00700 1 -- 172.21.15.82:0/1595892232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009b30 con 0x7ff8c40b5890 2024-05-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.743+0000 7ff8c2a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40ca560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e8a0 tx=0x7ff8b400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.743+0000 7ff8baa00700 1 -- 172.21.15.82:0/1595892232 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400ee40 con 0x7ff8c40b5890 2024-05-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.743+0000 7ff8baa00700 1 -- 172.21.15.82:0/1595892232 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b400c850 con 0x7ff8c40b5890 2024-05-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.743+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c40b4d70 con 0x7ff8c40b5890 2024-05-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.743+0000 7ff8baa00700 1 -- 172.21.15.82:0/1595892232 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400cc00 con 0x7ff8c40b5890 2024-05-10T04:50:33.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.743+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c40b5330 con 0x7ff8c40b5890 2024-05-10T04:50:33.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.744+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c40c9c50 con 0x7ff8c40b5890 2024-05-10T04:50:33.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.745+0000 7ff8baa00700 1 -- 172.21.15.82:0/1595892232 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff8b400cd60 con 0x7ff8c40b5890 2024-05-10T04:50:33.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.746+0000 7ff8baa00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff8a006acc0 0x7ff8a006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:33.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.746+0000 7ff8baa00700 1 -- 172.21.15.82:0/1595892232 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8b4089160 con 0x7ff8c40b5890 2024-05-10T04:50:33.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.747+0000 7ff8bbe00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff8a006acc0 0x7ff8a006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:33.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.747+0000 7ff8bbe00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff8a006acc0 0x7ff8a006d1d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40b3630 tx=0x7ff8ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:33.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.751+0000 7ff8baa00700 1 -- 172.21.15.82:0/1595892232 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff8c40c9c50 con 0x7ff8c40b5890 2024-05-10T04:50:34.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.999+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8c40c9c50 con 0x7ff8c40b5890 2024-05-10T04:50:34.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:33.999+0000 7ff8baa00700 1 -- 172.21.15.82:0/1595892232 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7ff8c40c9c50 con 0x7ff8c40b5890 2024-05-10T04:50:34.001 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:34.001 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:50:16.068598+0000","modified":"2024-05-10T04:50:19.501679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff8a006acc0 msgr2=0x7ff8a006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff8a006acc0 0x7ff8a006d1d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40b3630 tx=0x7ff8ac008040 comp rx=0 tx=0).stop 2024-05-10T04:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 msgr2=0x7ff8c40ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40ca560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e8a0 tx=0x7ff8b400ec60 comp rx=0 tx=0).stop 2024-05-10T04:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 shutdown_connections 2024-05-10T04:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff8a006acc0 0x7ff8a006d1d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff8c4161fb0 0x7ff8c415d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8c40b5890 0x7ff8c40ca560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 --2- 172.21.15.82:0/1595892232 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff8c415bfe0 0x7ff8c40ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 >> 172.21.15.82:0/1595892232 conn(0x7ff8c40d0a70 msgr2=0x7ff8c406c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 shutdown_connections 2024-05-10T04:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.002+0000 7ff8c9a00700 1 -- 172.21.15.82:0/1595892232 wait complete. 2024-05-10T04:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-10T04:50:34.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.290+0000 7f5275200700 1 Processor -- start 2024-05-10T04:50:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.290+0000 7f5275200700 1 -- start start 2024-05-10T04:50:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.292+0000 7f5275200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f527015e350 0x7f5270169030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.292+0000 7f5275200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52700d3500 con 0x7f527015df40 2024-05-10T04:50:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.292+0000 7f5275200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5270161e40 con 0x7f52700b2ca0 2024-05-10T04:50:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.292+0000 7f5275200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5270162120 con 0x7f527015e350 2024-05-10T04:50:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.292+0000 7f5267e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f527015df40 0x7f52700d03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36734/0 (socket says 172.21.15.82:36734) 2024-05-10T04:50:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.292+0000 7f5267e00700 1 -- 172.21.15.82:0/3382076710 learned_addr learned my addr 172.21.15.82:0/3382076710 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.293+0000 7f526fe00700 1 --2- 172.21.15.82:0/3382076710 >> v2:172.21.15.129:3300/0 conn(0x7f527015e350 0x7f5270169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.293+0000 7f526ea00700 1 -- 172.21.15.82:0/3382076710 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42376999 0 0) 0x7f52700d3500 con 0x7f527015df40 2024-05-10T04:50:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.293+0000 7f526ea00700 1 -- 172.21.15.82:0/3382076710 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52540035b0 con 0x7f527015df40 2024-05-10T04:50:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.293+0000 7f526fe00700 1 -- 172.21.15.82:0/3382076710 >> v1:172.21.15.129:6789/0 conn(0x7f52700b2ca0 legacy=0x7f52700cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.293+0000 7f526fe00700 1 -- 172.21.15.82:0/3382076710 >> v1:172.21.15.82:6789/0 conn(0x7f527015df40 legacy=0x7f52700d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.293+0000 7f526fe00700 1 -- 172.21.15.82:0/3382076710 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270162400 con 0x7f527015e350 2024-05-10T04:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.293+0000 7f526fe00700 1 --2- 172.21.15.82:0/3382076710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015e350 0x7f5270169030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5268009d90 tx=0x7f526800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5afc1bf6cf30de53 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.294+0000 7f526ea00700 1 -- 172.21.15.82:0/3382076710 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800e070 con 0x7f527015e350 2024-05-10T04:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.294+0000 7f526ea00700 1 -- 172.21.15.82:0/3382076710 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526800bb20 con 0x7f527015e350 2024-05-10T04:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.294+0000 7f526ea00700 1 -- 172.21.15.82:0/3382076710 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268012430 con 0x7f527015e350 2024-05-10T04:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.294+0000 7f5275200700 1 -- 172.21.15.82:0/3382076710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015e350 msgr2=0x7f5270169030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.294+0000 7f5275200700 1 --2- 172.21.15.82:0/3382076710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015e350 0x7f5270169030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5268009d90 tx=0x7f526800b330 comp rx=0 tx=0).stop 2024-05-10T04:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.295+0000 7f5275200700 1 -- 172.21.15.82:0/3382076710 shutdown_connections 2024-05-10T04:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.295+0000 7f5275200700 1 --2- 172.21.15.82:0/3382076710 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015e350 0x7f5270169030 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.295+0000 7f5275200700 1 -- 172.21.15.82:0/3382076710 >> 172.21.15.82:0/3382076710 conn(0x7f5270067600 msgr2=0x7f527006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.295+0000 7f5275200700 1 -- 172.21.15.82:0/3382076710 shutdown_connections 2024-05-10T04:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.295+0000 7f5275200700 1 -- 172.21.15.82:0/3382076710 wait complete. 2024-05-10T04:50:34.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.297+0000 7f5275200700 1 Processor -- start 2024-05-10T04:50:34.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.297+0000 7f5275200700 1 -- start start 2024-05-10T04:50:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f5275200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f52700b2ca0 0x7f527014dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f5275200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015df40 0x7f52700c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f5275200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f527015e350 0x7f52700d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f5275200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701f7f60 con 0x7f527015e350 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f5275200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701f8240 con 0x7f527015df40 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f5275200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52701f8520 con 0x7f52700b2ca0 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f527015e350 0x7f52700d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f527015e350 0x7f52700d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42896/0 (socket says 172.21.15.82:42896) 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526fe00700 1 -- 172.21.15.82:0/2320579625 learned_addr learned my addr 172.21.15.82:0/2320579625 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526f400700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f52700b2ca0 0x7f527014dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f5267e00700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015df40 0x7f52700c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526fe00700 1 -- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f52700b2ca0 msgr2=0x7f527014dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526fe00700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f52700b2ca0 0x7f527014dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526fe00700 1 -- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015df40 msgr2=0x7f52700c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526fe00700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015df40 0x7f52700c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526fe00700 1 -- 172.21.15.82:0/2320579625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268009a70 con 0x7f527015e350 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f526f400700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f52700b2ca0 0x7f527014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.299+0000 7f5267e00700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015df40 0x7f52700c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.300+0000 7f526fe00700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f527015e350 0x7f52700d0730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5268013000 tx=0x7f5268004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.300+0000 7f5267400700 1 -- 172.21.15.82:0/2320579625 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268012430 con 0x7f527015e350 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.300+0000 7f5267400700 1 -- 172.21.15.82:0/2320579625 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5268020070 con 0x7f527015e350 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.300+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52701f8800 con 0x7f527015e350 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.300+0000 7f5267400700 1 -- 172.21.15.82:0/2320579625 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268004280 con 0x7f527015e350 2024-05-10T04:50:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.300+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52701f7b10 con 0x7f527015e350 2024-05-10T04:50:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.301+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52700b77b0 con 0x7f527015e350 2024-05-10T04:50:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.302+0000 7f5267400700 1 -- 172.21.15.82:0/2320579625 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f52680043e0 con 0x7f527015e350 2024-05-10T04:50:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.304+0000 7f5267400700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f524c06ac90 0x7f524c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.304+0000 7f5267400700 1 -- 172.21.15.82:0/2320579625 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5268022070 con 0x7f527015e350 2024-05-10T04:50:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.304+0000 7f526f400700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f524c06ac90 0x7f524c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.304+0000 7f526f400700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f524c06ac90 0x7f524c06d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5260000f60 tx=0x7f5260009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.308+0000 7f5267400700 1 -- 172.21.15.82:0/2320579625 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5268056290 con 0x7f527015e350 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.515+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52701f7cd0 con 0x7f527015e350 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.517+0000 7f5267400700 1 -- 172.21.15.82:0/2320579625 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f52680598b0 con 0x7f527015e350 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f524c06ac90 msgr2=0x7f524c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f524c06ac90 0x7f524c06d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5260000f60 tx=0x7f5260009040 comp rx=0 tx=0).stop 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f527015e350 msgr2=0x7f52700d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f527015e350 0x7f52700d0730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5268013000 tx=0x7f5268004ad0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 shutdown_connections 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f524c06ac90 0x7f524c06d1a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f527015e350 0x7f52700d0730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f52700b2ca0 0x7f527014dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 --2- 172.21.15.82:0/2320579625 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f527015df40 0x7f52700c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 >> 172.21.15.82:0/2320579625 conn(0x7f5270067600 msgr2=0x7f52700d23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 shutdown_connections 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.519+0000 7f5275200700 1 -- 172.21.15.82:0/2320579625 wait complete. 2024-05-10T04:50:34.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:50:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.811+0000 7fdce0e00700 1 Processor -- start 2024-05-10T04:50:34.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.811+0000 7fdce0e00700 1 -- start start 2024-05-10T04:50:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.812+0000 7fdce0e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdcdc15bfe0 0x7fdcdc15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.812+0000 7fdce0e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc0b5fa0 0x7fdcdc1623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdce0e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc162a70 con 0x7fdcdc161fb0 2024-05-10T04:50:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdce0e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc15c3f0 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdce0e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc162d50 con 0x7fdcdc0b5fa0 2024-05-10T04:50:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdcd9e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fdcdc15bfe0 0x7fdcdc15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdcda800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc0b5fa0 0x7fdcdc1623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdcd9400700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fdcdc161fb0 0x7fdcdc0b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:37966/0 (socket says 172.21.15.82:37966) 2024-05-10T04:50:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdcd9400700 1 -- 172.21.15.82:0/2490588503 learned_addr learned my addr 172.21.15.82:0/2490588503 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdcda800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc0b5fa0 0x7fdcdc1623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:59204/0 (socket says 172.21.15.82:59204) 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdcda800700 1 -- 172.21.15.82:0/2490588503 >> v2:172.21.15.129:3300/0 conn(0x7fdcdc15bfe0 msgr2=0x7fdcdc15f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdcda800700 1 --2- 172.21.15.82:0/2490588503 >> v2:172.21.15.129:3300/0 conn(0x7fdcdc15bfe0 0x7fdcdc15f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.813+0000 7fdcda800700 1 -- 172.21.15.82:0/2490588503 >> v1:172.21.15.129:6789/0 conn(0x7fdcdc161fb0 legacy=0x7fdcdc0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.814+0000 7fdcda800700 1 -- 172.21.15.82:0/2490588503 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc15ecf0 con 0x7fdcdc0b5fa0 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.814+0000 7fdcd9e00700 1 --2- 172.21.15.82:0/2490588503 >> v2:172.21.15.129:3300/0 conn(0x7fdcdc15bfe0 0x7fdcdc15f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.814+0000 7fdcda800700 1 --2- 172.21.15.82:0/2490588503 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc0b5fa0 0x7fdcdc1623c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009d90 tx=0x7fdcd400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb2d50f44ba4c1c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.814+0000 7fdcd8a00700 1 -- 172.21.15.82:0/2490588503 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400e070 con 0x7fdcdc0b5fa0 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.814+0000 7fdcd8a00700 1 -- 172.21.15.82:0/2490588503 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd4003a20 con 0x7fdcdc0b5fa0 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.814+0000 7fdcd8a00700 1 -- 172.21.15.82:0/2490588503 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4003dd0 con 0x7fdcdc0b5fa0 2024-05-10T04:50:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.815+0000 7fdce0e00700 1 -- 172.21.15.82:0/2490588503 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc0b5fa0 msgr2=0x7fdcdc1623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.815+0000 7fdce0e00700 1 --2- 172.21.15.82:0/2490588503 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc0b5fa0 0x7fdcdc1623c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009d90 tx=0x7fdcd400b330 comp rx=0 tx=0).stop 2024-05-10T04:50:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.815+0000 7fdce0e00700 1 -- 172.21.15.82:0/2490588503 shutdown_connections 2024-05-10T04:50:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.815+0000 7fdce0e00700 1 --2- 172.21.15.82:0/2490588503 >> v2:172.21.15.129:3300/0 conn(0x7fdcdc15bfe0 0x7fdcdc15f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.815+0000 7fdce0e00700 1 --2- 172.21.15.82:0/2490588503 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc0b5fa0 0x7fdcdc1623c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.815+0000 7fdce0e00700 1 -- 172.21.15.82:0/2490588503 >> 172.21.15.82:0/2490588503 conn(0x7fdcdc0d0a70 msgr2=0x7fdcdc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.815+0000 7fdce0e00700 1 -- 172.21.15.82:0/2490588503 shutdown_connections 2024-05-10T04:50:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.815+0000 7fdce0e00700 1 -- 172.21.15.82:0/2490588503 wait complete. 2024-05-10T04:50:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.817+0000 7fdce0e00700 1 Processor -- start 2024-05-10T04:50:34.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.817+0000 7fdce0e00700 1 -- start start 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdce0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc15bfe0 0x7fdcdc15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdce0e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcdc161fb0 0x7fdcdc1f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdce0e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc1f5190 0x7fdcdc1f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdce0e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc15b960 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdce0e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1f5f90 con 0x7fdcdc161fb0 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdce0e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0caec0 con 0x7fdcdc1f5190 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdcd9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc15bfe0 0x7fdcdc15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdcd9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc15bfe0 0x7fdcdc15b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42902/0 (socket says 172.21.15.82:42902) 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdcd9e00700 1 -- 172.21.15.82:0/1473358404 learned_addr learned my addr 172.21.15.82:0/1473358404 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdcda800700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc1f5190 0x7fdcdc1f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.819+0000 7fdcd9400700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcdc161fb0 0x7fdcdc1f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd9e00700 1 -- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc1f5190 msgr2=0x7fdcdc1f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd9e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc1f5190 0x7fdcdc1f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd9e00700 1 -- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcdc161fb0 msgr2=0x7fdcdc1f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd9e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcdc161fb0 0x7fdcdc1f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd9e00700 1 -- 172.21.15.82:0/1473358404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0094a0 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcda800700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc1f5190 0x7fdcdc1f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd9e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc15bfe0 0x7fdcdc15b420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00ec10 tx=0x7fdccc009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd2000700 1 -- 172.21.15.82:0/1473358404 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc00c8e0 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd2000700 1 -- 172.21.15.82:0/1473358404 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc00ca40 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd4009a70 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdcd2000700 1 -- 172.21.15.82:0/1473358404 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc00cdd0 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.820+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc0cb100 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.821+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0cc0e0 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.822+0000 7fdcd2000700 1 -- 172.21.15.82:0/1473358404 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdccc013470 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.823+0000 7fdcd2000700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcbc06acc0 0x7fdcbc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.823+0000 7fdcd2000700 1 -- 172.21.15.82:0/1473358404 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdccc0898b0 con 0x7fdcdc15bfe0 2024-05-10T04:50:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.823+0000 7fdcd9400700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcbc06acc0 0x7fdcbc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:34.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.824+0000 7fdcd9400700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcbc06acc0 0x7fdcbc06d1d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0cf080 tx=0x7fdcc8007d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:34.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:34.828+0000 7fdcd2000700 1 -- 172.21.15.82:0/1473358404 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdccc054960 con 0x7fdcdc15bfe0 2024-05-10T04:50:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.075+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcdc0d2210 con 0x7fdcdc15bfe0 2024-05-10T04:50:35.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.076+0000 7fdcd2000700 1 -- 172.21.15.82:0/1473358404 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7fdccc017090 con 0x7fdcdc15bfe0 2024-05-10T04:50:35.078 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:50:16.068598+0000","modified":"2024-05-10T04:50:19.501679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:50:35.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcbc06acc0 msgr2=0x7fdcbc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcbc06acc0 0x7fdcbc06d1d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0cf080 tx=0x7fdcc8007d70 comp rx=0 tx=0).stop 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc15bfe0 msgr2=0x7fdcdc15b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc15bfe0 0x7fdcdc15b420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00ec10 tx=0x7fdccc009e20 comp rx=0 tx=0).stop 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 shutdown_connections 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcbc06acc0 0x7fdcbc06d1d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcdc1f5190 0x7fdcdc1f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc15bfe0 0x7fdcdc15b420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 --2- 172.21.15.82:0/1473358404 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcdc161fb0 0x7fdcdc1f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 >> 172.21.15.82:0/1473358404 conn(0x7fdcdc0d0a70 msgr2=0x7fdcdc06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 shutdown_connections 2024-05-10T04:50:35.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.079+0000 7fdce0e00700 1 -- 172.21.15.82:0/1473358404 wait complete. 2024-05-10T04:50:35.082 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-10T04:50:35.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:50:35.309 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:50:35.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:50:16.068598+0000', 'modified': '2024-05-10T04:50:19.501679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.129:6835/2167757977', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6833', 'nonce': 2167757977}, {'type': 'v1', 'addr': '172.21.15.129:6835', 'nonce': 2167757977}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T04:50:35.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T04:50:35.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T04:50:35.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.770+0000 7fd28ec00700 1 Processor -- start 2024-05-10T04:50:35.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.770+0000 7fd28ec00700 1 -- start start 2024-05-10T04:50:35.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.772+0000 7fd28ec00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd288161d40 0x7fd2880b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.772+0000 7fd28ec00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2880b3090 0x7fd2880ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.772+0000 7fd28ec00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2880b5bb0 con 0x7fd2880d0990 2024-05-10T04:50:35.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.772+0000 7fd28ec00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2880cf6d0 con 0x7fd2880b3090 2024-05-10T04:50:35.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.772+0000 7fd28ec00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880b6580 con 0x7fd288161d40 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.772+0000 7fd28e200700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd2880d0990 0x7fd2880d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36748/0 (socket says 172.21.15.82:36748) 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.772+0000 7fd28e200700 1 -- 172.21.15.82:0/540800726 learned_addr learned my addr 172.21.15.82:0/540800726 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.772+0000 7fd28ce00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2880b3090 0x7fd2880ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd28d800700 1 --2- 172.21.15.82:0/540800726 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd288161d40 0x7fd2880b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd28ce00700 1 -- 172.21.15.82:0/540800726 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd288161d40 msgr2=0x7fd2880b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd28ce00700 1 --2- 172.21.15.82:0/540800726 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd288161d40 0x7fd2880b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd28ce00700 1 -- 172.21.15.82:0/540800726 >> v1:172.21.15.82:6789/0 conn(0x7fd2880d0990 legacy=0x7fd2880d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd28ce00700 1 -- 172.21.15.82:0/540800726 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880cf110 con 0x7fd2880b3090 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd287e00700 1 -- 172.21.15.82:0/540800726 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386296111 0 0) 0x7fd2880b5bb0 con 0x7fd2880d0990 2024-05-10T04:50:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd28ce00700 1 --2- 172.21.15.82:0/540800726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2880b3090 0x7fd2880ce7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd274009840 tx=0x7fd274009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbbd7b837b338c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:35.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd287e00700 1 -- 172.21.15.82:0/540800726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274011830 con 0x7fd2880b3090 2024-05-10T04:50:35.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd287e00700 1 -- 172.21.15.82:0/540800726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274011990 con 0x7fd2880b3090 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.773+0000 7fd287e00700 1 -- 172.21.15.82:0/540800726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274011d20 con 0x7fd2880b3090 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.774+0000 7fd28ec00700 1 -- 172.21.15.82:0/540800726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2880b3090 msgr2=0x7fd2880ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.774+0000 7fd28ec00700 1 --2- 172.21.15.82:0/540800726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2880b3090 0x7fd2880ce7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd274009840 tx=0x7fd274009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.774+0000 7fd28ec00700 1 -- 172.21.15.82:0/540800726 shutdown_connections 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.774+0000 7fd28ec00700 1 --2- 172.21.15.82:0/540800726 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd288161d40 0x7fd2880b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.774+0000 7fd28ec00700 1 --2- 172.21.15.82:0/540800726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2880b3090 0x7fd2880ce7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.774+0000 7fd28ec00700 1 -- 172.21.15.82:0/540800726 >> 172.21.15.82:0/540800726 conn(0x7fd28806c580 msgr2=0x7fd28806c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.774+0000 7fd28ec00700 1 -- 172.21.15.82:0/540800726 shutdown_connections 2024-05-10T04:50:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.774+0000 7fd28ec00700 1 -- 172.21.15.82:0/540800726 wait complete. 2024-05-10T04:50:35.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.777+0000 7fd28ec00700 1 Processor -- start 2024-05-10T04:50:35.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.777+0000 7fd28ec00700 1 -- start start 2024-05-10T04:50:35.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.778+0000 7fd28ec00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2880b3090 0x7fd2880aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.778+0000 7fd28ec00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2880d0990 0x7fd2880cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.778+0000 7fd28ec00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd288161d40 0x7fd2880aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28ec00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880ca270 con 0x7fd288161d40 2024-05-10T04:50:35.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28ec00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880c8d20 con 0x7fd2880d0990 2024-05-10T04:50:35.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28ec00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2881f7b10 con 0x7fd2880b3090 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd288161d40 0x7fd2880aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd288161d40 0x7fd2880aaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41688/0 (socket says 172.21.15.82:41688) 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 -- 172.21.15.82:0/3403572724 learned_addr learned my addr 172.21.15.82:0/3403572724 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28d800700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2880b3090 0x7fd2880aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28ce00700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2880d0990 0x7fd2880cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 -- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2880b3090 msgr2=0x7fd2880aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2880b3090 0x7fd2880aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 -- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2880d0990 msgr2=0x7fd2880cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2880d0990 0x7fd2880cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 -- 172.21.15.82:0/3403572724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740094a0 con 0x7fd288161d40 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28ce00700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2880d0990 0x7fd2880cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28d800700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2880b3090 0x7fd2880aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.779+0000 7fd28e200700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd288161d40 0x7fd2880aaea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd28000cc10 tx=0x7fd2800021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:35.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.780+0000 7fd285600700 1 -- 172.21.15.82:0/3403572724 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000ab80 con 0x7fd288161d40 2024-05-10T04:50:35.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.780+0000 7fd285600700 1 -- 172.21.15.82:0/3403572724 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000ad00 con 0x7fd288161d40 2024-05-10T04:50:35.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.780+0000 7fd28ec00700 1 -- 172.21.15.82:0/3403572724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2881f83b0 con 0x7fd288161d40 2024-05-10T04:50:35.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.780+0000 7fd285600700 1 -- 172.21.15.82:0/3403572724 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280007310 con 0x7fd288161d40 2024-05-10T04:50:35.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.780+0000 7fd28ec00700 1 -- 172.21.15.82:0/3403572724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2880aab60 con 0x7fd288161d40 2024-05-10T04:50:35.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.782+0000 7fd285600700 1 -- 172.21.15.82:0/3403572724 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd280007470 con 0x7fd288161d40 2024-05-10T04:50:35.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.783+0000 7fd285600700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd26806ac90 0x7fd26806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.783+0000 7fd285600700 1 -- 172.21.15.82:0/3403572724 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2800892e0 con 0x7fd288161d40 2024-05-10T04:50:35.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.783+0000 7fd28d800700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd26806ac90 0x7fd26806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.784+0000 7fd28d800700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd26806ac90 0x7fd26806d1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd2880d1ca0 tx=0x7fd27c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:35.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.785+0000 7fd2a81adb80 1 Processor -- start 2024-05-10T04:50:35.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.785+0000 7fd2a81adb80 1 -- start start 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.786+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 0x563d8d3d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3892a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8d2b2250 con 0x563d8d388a40 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8d2afa50 con 0x563d8d38b5f0 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d8d2ab340 con 0x563d8d2515f0 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41702/0 (socket says 172.21.15.82:41702) 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 -- 172.21.15.82:0/3114172691 learned_addr learned my addr 172.21.15.82:0/3114172691 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28d800700 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 0x563d8d3d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28e200700 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 -- 172.21.15.82:0/3114172691 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 msgr2=0x563d8d3d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 0x563d8d3d1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 -- 172.21.15.82:0/3114172691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 msgr2=0x563d8d3892a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3892a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 -- 172.21.15.82:0/3114172691 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d8d09e790 con 0x563d8d388a40 2024-05-10T04:50:35.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.787+0000 7fd28ce00700 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b2bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2880b6810 tx=0x7fd274010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c059caf38cee0b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.788+0000 7fd27a000700 1 -- 172.21.15.82:0/3114172691 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274011b00 con 0x563d8d388a40 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.788+0000 7fd27a000700 1 -- 172.21.15.82:0/3114172691 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274011c60 con 0x563d8d388a40 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.788+0000 7fd27a000700 1 -- 172.21.15.82:0/3114172691 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274004240 con 0x563d8d388a40 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.788+0000 7fd2a81adb80 1 -- 172.21.15.82:0/3114172691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 msgr2=0x563d8d3b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.788+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b2bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2880b6810 tx=0x7fd274010000 comp rx=0 tx=0).stop 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.789+0000 7fd2a81adb80 1 -- 172.21.15.82:0/3114172691 shutdown_connections 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.789+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3892a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.789+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 0x563d8d3d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.789+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/3114172691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b2bd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.789+0000 7fd2a81adb80 1 -- 172.21.15.82:0/3114172691 >> 172.21.15.82:0/3114172691 conn(0x563d8d2f5cf0 msgr2=0x563d8d3d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:35.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.789+0000 7fd2a81adb80 1 -- 172.21.15.82:0/3114172691 shutdown_connections 2024-05-10T04:50:35.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.789+0000 7fd2a81adb80 1 -- 172.21.15.82:0/3114172691 wait complete. 2024-05-10T04:50:35.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.790+0000 7fd2a81adb80 1 -- start start 2024-05-10T04:50:35.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.790+0000 7fd2a81adb80 1 Processor -- start 2024-05-10T04:50:35.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3e08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d388a40 0x563d8d3b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3dfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8d247490 con 0x563d8d2515f0 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8d247130 con 0x563d8d38b5f0 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d8d09f390 con 0x563d8d388a40 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd2a81adb80 10 client.0 _ll_register_callbacks cb 0x563d8d0b25a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3e08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3e08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41706/0 (socket says 172.21.15.82:41706) 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28d800700 1 -- 172.21.15.82:0/4290619566 learned_addr learned my addr 172.21.15.82:0/4290619566 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28ce00700 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d388a40 0x563d8d3b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28e200700 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3dfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28d800700 1 -- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d388a40 msgr2=0x563d8d3b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28d800700 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d388a40 0x563d8d3b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28d800700 1 -- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 msgr2=0x563d8d3dfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28d800700 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3dfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.792+0000 7fd28d800700 1 -- 172.21.15.82:0/4290619566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2880cf110 con 0x563d8d2515f0 2024-05-10T04:50:35.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd28d800700 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3e08e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0156f0 tx=0x7fd27c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae30637d1d19324 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:35.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd26ea00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-10T04:50:35.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd26ea00700 1 -- 172.21.15.82:0/4290619566 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c011ee0 con 0x563d8d2515f0 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd26ea00700 1 -- 172.21.15.82:0/4290619566 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd27c022630 con 0x563d8d2515f0 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd2a81adb80 1 -- 172.21.15.82:0/4290619566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d8d37d790 con 0x563d8d2515f0 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd26ea00700 1 -- 172.21.15.82:0/4290619566 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd27c015e90 con 0x563d8d2515f0 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd2a81adb80 10 client.4653 fetch_fsmap learned FSMap version 8 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd2a81adb80 1 -- 172.21.15.82:0/4290619566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563d8d18b0a0 con 0x563d8d2515f0 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd26ea00700 1 -- 172.21.15.82:0/4290619566 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d8d37d790 con 0x563d8d2515f0 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.793+0000 7fd26ea00700 1 -- 172.21.15.82:0/4290619566 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd27c0227f0 con 0x563d8d2515f0 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.794+0000 7fd2a81adb80 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.794+0000 7fd2a81adb80 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.794+0000 7fd2a81adb80 20 client.4653 populate_metadata read hostname 'smithi082' 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.794+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] conn(0x563d8d3b7e30 0x563d8d3e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.794+0000 7fd2a81adb80 4 client.4653 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.794+0000 7fd2a81adb80 1 -- 172.21.15.82:0/4290619566 --> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d8d0e4040 con 0x563d8d3b7e30 2024-05-10T04:50:35.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.794+0000 7fd28ce00700 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] conn(0x563d8d3b7e30 0x563d8d3e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.795+0000 7fd26ea00700 10 client.4653 ms_handle_connect on v2:172.21.15.129:6833/2167757977 2024-05-10T04:50:35.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.795+0000 7fd28ce00700 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] conn(0x563d8d3b7e30 0x563d8d3e2d10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f6b9c86e67e2f server_cookie=896eaa26db117cca in_seq=0 out_seq=0 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.795+0000 7fd26ea00700 1 -- 172.21.15.82:0/4290619566 <== mds.0 v2:172.21.15.129:6833/2167757977 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563d8d0e4040 con 0x563d8d3b7e30 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.795+0000 7fd26ea00700 10 client.4653 handle_command_reply: tid=0 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 client.4653 shutdown 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 -- 172.21.15.82:0/4290619566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 msgr2=0x563d8d3e08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3e08e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0156f0 tx=0x7fd27c004750 comp rx=0 tx=0).stop 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 -- 172.21.15.82:0/4290619566 shutdown_connections 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3dfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] conn(0x563d8d3b7e30 0x563d8d3e2d10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3e08e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/4290619566 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d388a40 0x563d8d3b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd26ea00700 0 client.4653 ms_handle_reset on v2:172.21.15.129:6833/2167757977 2024-05-10T04:50:35.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 -- 172.21.15.82:0/4290619566 >> 172.21.15.82:0/4290619566 conn(0x563d8d2f5cf0 msgr2=0x563d8d37f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:35.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 -- 172.21.15.82:0/4290619566 shutdown_connections 2024-05-10T04:50:35.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 1 -- 172.21.15.82:0/4290619566 wait complete. 2024-05-10T04:50:35.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.796+0000 7fd2a81adb80 20 client.4653 trim_cache size 0 max 16384 2024-05-10T04:50:35.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.815+0000 7fd2a81adb80 1 Processor -- start 2024-05-10T04:50:35.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.815+0000 7fd2a81adb80 1 -- start start 2024-05-10T04:50:35.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.816+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 0x563d8d3b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.816+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.816+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3e1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8d3b8f90 con 0x563d8d388a40 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8d38bd80 con 0x563d8d38b5f0 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d8d3e0050 con 0x563d8d2515f0 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41722/0 (socket says 172.21.15.82:41722) 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 -- 172.21.15.82:0/2828080642 learned_addr learned my addr 172.21.15.82:0/2828080642 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28d800700 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 0x563d8d3b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28e200700 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 -- 172.21.15.82:0/2828080642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 msgr2=0x563d8d3b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 0x563d8d3b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 -- 172.21.15.82:0/2828080642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 msgr2=0x563d8d3e1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3e1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 -- 172.21.15.82:0/2828080642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d8d271690 con 0x563d8d388a40 2024-05-10T04:50:35.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.817+0000 7fd28ce00700 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b3110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd274011960 tx=0x7fd274011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7479e87410fb63 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd27aa00700 1 -- 172.21.15.82:0/2828080642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740042e0 con 0x563d8d388a40 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd27aa00700 1 -- 172.21.15.82:0/2828080642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274004480 con 0x563d8d388a40 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd27aa00700 1 -- 172.21.15.82:0/2828080642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740045f0 con 0x563d8d388a40 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2828080642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 msgr2=0x563d8d3b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b3110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd274011960 tx=0x7fd274011000 comp rx=0 tx=0).stop 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2828080642 shutdown_connections 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d38b5f0 0x563d8d3e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d2515f0 0x563d8d3b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2828080642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d388a40 0x563d8d3b3110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2828080642 >> 172.21.15.82:0/2828080642 conn(0x563d8d2f5cf0 msgr2=0x563d8d3cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:35.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.818+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2828080642 shutdown_connections 2024-05-10T04:50:35.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.819+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2828080642 wait complete. 2024-05-10T04:50:35.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.819+0000 7fd2a81adb80 1 -- start start 2024-05-10T04:50:35.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.820+0000 7fd2a81adb80 1 Processor -- start 2024-05-10T04:50:35.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d388a40 0x563d8d385f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd2a81adb80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d38b5f0 0x563d8d3b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8d3b6980 con 0x563d8d2515f0 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8d3b1970 con 0x563d8d388a40 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd2a81adb80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d8d3b6450 con 0x563d8d38b5f0 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd2a81adb80 10 client.0 _ll_register_callbacks cb 0x7fd27c011d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd28d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd28d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41738/0 (socket says 172.21.15.82:41738) 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.821+0000 7fd28d800700 1 -- 172.21.15.82:0/2915996290 learned_addr learned my addr 172.21.15.82:0/2915996290 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd28ce00700 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d388a40 0x563d8d385f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd28e200700 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d38b5f0 0x563d8d3b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd28d800700 1 -- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d38b5f0 msgr2=0x563d8d3b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd28d800700 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d38b5f0 0x563d8d3b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd28d800700 1 -- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d388a40 msgr2=0x563d8d385f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd28d800700 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d388a40 0x563d8d385f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd28d800700 1 -- 172.21.15.82:0/2915996290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d8d09e790 con 0x563d8d2515f0 2024-05-10T04:50:35.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd28d800700 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3b5d50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0156f0 tx=0x7fd27c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483eb0d4f69df0a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:35.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd26ea00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-10T04:50:35.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd26ea00700 1 -- 172.21.15.82:0/2915996290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c022d50 con 0x563d8d2515f0 2024-05-10T04:50:35.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd26ea00700 1 -- 172.21.15.82:0/2915996290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd27c022840 con 0x563d8d2515f0 2024-05-10T04:50:35.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2915996290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd274011c60 con 0x563d8d2515f0 2024-05-10T04:50:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.822+0000 7fd26ea00700 1 -- 172.21.15.82:0/2915996290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd27c02b440 con 0x563d8d2515f0 2024-05-10T04:50:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd2a81adb80 10 client.4659 fetch_fsmap learned FSMap version 8 2024-05-10T04:50:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2915996290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563d8d0ff1d0 con 0x563d8d2515f0 2024-05-10T04:50:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd26ea00700 1 -- 172.21.15.82:0/2915996290 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274011c60 con 0x563d8d2515f0 2024-05-10T04:50:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd26ea00700 1 -- 172.21.15.82:0/2915996290 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd27c02b5a0 con 0x563d8d2515f0 2024-05-10T04:50:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd2a81adb80 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd2a81adb80 10 client.4659 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd2a81adb80 20 client.4659 populate_metadata read hostname 'smithi082' 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] conn(0x563d8d3b2ca0 0x563d8d3b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd2a81adb80 4 client.4659 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2915996290 --> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563d8d1200c0 con 0x563d8d3b2ca0 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.823+0000 7fd28ce00700 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] conn(0x563d8d3b2ca0 0x563d8d3b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd26ea00700 10 client.4659 ms_handle_connect on v2:172.21.15.129:6833/2167757977 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd28ce00700 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] conn(0x563d8d3b2ca0 0x563d8d3b30b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=822e1235b4a4f50a server_cookie=d55c816d82fbdd7f in_seq=0 out_seq=0 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd26ea00700 1 -- 172.21.15.82:0/2915996290 <== mds.0 v2:172.21.15.129:6833/2167757977 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563d8d1200c0 con 0x563d8d3b2ca0 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd26ea00700 10 client.4659 handle_command_reply: tid=0 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd2a81adb80 1 client.4659 shutdown 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2915996290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 msgr2=0x563d8d3b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3b5d50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0156f0 tx=0x7fd27c016000 comp rx=0 tx=0).stop 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2915996290 shutdown_connections 2024-05-10T04:50:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x563d8d38b5f0 0x563d8d3b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:6833/2167757977,v1:172.21.15.129:6835/2167757977] conn(0x563d8d3b2ca0 0x563d8d3b30b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563d8d2515f0 0x563d8d3b5d50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd2a81adb80 1 --2- 172.21.15.82:0/2915996290 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x563d8d388a40 0x563d8d385f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.824+0000 7fd26ea00700 0 client.4659 ms_handle_reset on v2:172.21.15.129:6833/2167757977 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.825+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2915996290 >> 172.21.15.82:0/2915996290 conn(0x563d8d2f5cf0 msgr2=0x563d8d3cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.825+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2915996290 shutdown_connections 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.825+0000 7fd2a81adb80 1 -- 172.21.15.82:0/2915996290 wait complete. 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.825+0000 7fd2a81adb80 20 client.4659 trim_cache size 0 max 16384 2024-05-10T04:50:35.829 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c7bb1514-6d11-4350-825d-a52cfeee72e9", 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4285, 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 19.752760192, 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 8, 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 21, 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 21, 2024-05-10T04:50:35.830 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 25.357325195000001 2024-05-10T04:50:35.831 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:50:35.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.825+0000 7fd28ec00700 1 -- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd26806ac90 msgr2=0x7fd26806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.825+0000 7fd28ec00700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd26806ac90 0x7fd26806d1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd2880d1ca0 tx=0x7fd27c008040 comp rx=0 tx=0).stop 2024-05-10T04:50:35.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.825+0000 7fd28ec00700 1 -- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd288161d40 msgr2=0x7fd2880aaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.825+0000 7fd28ec00700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd288161d40 0x7fd2880aaea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd28000cc10 tx=0x7fd2800021c0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.826+0000 7fd28ec00700 1 -- 172.21.15.82:0/3403572724 shutdown_connections 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.826+0000 7fd28ec00700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd26806ac90 0x7fd26806d1a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.826+0000 7fd28ec00700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd288161d40 0x7fd2880aaea0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.826+0000 7fd28ec00700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd2880b3090 0x7fd2880aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.826+0000 7fd28ec00700 1 --2- 172.21.15.82:0/3403572724 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd2880d0990 0x7fd2880cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.826+0000 7fd28ec00700 1 -- 172.21.15.82:0/3403572724 >> 172.21.15.82:0/3403572724 conn(0x7fd28806c580 msgr2=0x7fd2880b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.826+0000 7fd28ec00700 1 -- 172.21.15.82:0/3403572724 shutdown_connections 2024-05-10T04:50:35.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:35.826+0000 7fd28ec00700 1 -- 172.21.15.82:0/3403572724 wait complete. 2024-05-10T04:50:35.851 INFO:teuthology.run_tasks:Running task sequential... 2024-05-10T04:50:35.863 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-10T04:50:35.864 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-10T04:50:35.864 INFO:teuthology.task.print:Enabling mgr modules 2024-05-10T04:50:35.864 INFO:teuthology.run_tasks:Running task kclient... 2024-05-10T04:50:35.895 INFO:tasks.kclient:Mounting kernel clients... 2024-05-10T04:50:35.896 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-10T04:50:35.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:35.896 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T04:50:35.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:35.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-10T04:50:36.012 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-05-10T04:50:36.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:50:36.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:36.019 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T04:50:36.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:36.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-10T04:50:36.187 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-05-10T04:50:36.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:50:36.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:36.190 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-05-10T04:50:36.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:36.242 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2024-05-10T04:50:36.320 INFO:teuthology.orchestra.run.smithi129.stderr:Cannot find device "ceph-brx" 2024-05-10T04:50:36.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:50:36.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:36.324 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-05-10T04:50:36.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:36.372 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2024-05-10T04:50:36.482 INFO:teuthology.orchestra.run.smithi129.stderr:Cannot find device "ceph-brx" 2024-05-10T04:50:36.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:50:36.485 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-10T04:50:36.486 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:50:36.486 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T04:50:36.486 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:50:36.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.750+0000 7fdd00600700 1 Processor -- start 2024-05-10T04:50:36.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.750+0000 7fdd00600700 1 -- start start 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdd00600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdcf815bfe0 0x7fdcf815f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdd00600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf8161fb0 0x7fdcf81623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdd00600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf8162a70 con 0x7fdcf80b5890 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdd00600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf815c3f0 con 0x7fdcf815bfe0 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdd00600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf8162d50 con 0x7fdcf8161fb0 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdcfe600700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdcf80b5890 0x7fdcf80b5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54922/0 (socket says 172.21.15.82:54922) 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdcfdc00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdcf815bfe0 0x7fdcf815f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdcfe600700 1 -- 172.21.15.82:0/2006608856 learned_addr learned my addr 172.21.15.82:0/2006608856 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:36.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.752+0000 7fdcfd200700 1 --2- 172.21.15.82:0/2006608856 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf8161fb0 0x7fdcf81623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcfdc00700 1 -- 172.21.15.82:0/2006608856 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf8161fb0 msgr2=0x7fdcf81623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcfdc00700 1 --2- 172.21.15.82:0/2006608856 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf8161fb0 0x7fdcf81623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcfdc00700 1 -- 172.21.15.82:0/2006608856 >> v1:172.21.15.82:6789/0 conn(0x7fdcf80b5890 legacy=0x7fdcf80b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcfdc00700 1 -- 172.21.15.82:0/2006608856 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf815ecf0 con 0x7fdcf815bfe0 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcf7e00700 1 -- 172.21.15.82:0/2006608856 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975050501 0 0) 0x7fdcf8162a70 con 0x7fdcf80b5890 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcfdc00700 1 --2- 172.21.15.82:0/2006608856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf815bfe0 0x7fdcf815f4f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009840 tx=0x7fdcec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934a7d7a31c015e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcf7e00700 1 -- 172.21.15.82:0/2006608856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec011830 con 0x7fdcf815bfe0 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcf7e00700 1 -- 172.21.15.82:0/2006608856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec011990 con 0x7fdcf815bfe0 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.753+0000 7fdcf7e00700 1 -- 172.21.15.82:0/2006608856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec011d20 con 0x7fdcf815bfe0 2024-05-10T04:50:36.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.754+0000 7fdd00600700 1 -- 172.21.15.82:0/2006608856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf815bfe0 msgr2=0x7fdcf815f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:36.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.754+0000 7fdd00600700 1 --2- 172.21.15.82:0/2006608856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf815bfe0 0x7fdcf815f4f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009840 tx=0x7fdcec009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:36.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.754+0000 7fdd00600700 1 -- 172.21.15.82:0/2006608856 shutdown_connections 2024-05-10T04:50:36.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.754+0000 7fdd00600700 1 --2- 172.21.15.82:0/2006608856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf815bfe0 0x7fdcf815f4f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:36.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.754+0000 7fdd00600700 1 --2- 172.21.15.82:0/2006608856 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf8161fb0 0x7fdcf81623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:36.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.754+0000 7fdd00600700 1 -- 172.21.15.82:0/2006608856 >> 172.21.15.82:0/2006608856 conn(0x7fdcf80d0a70 msgr2=0x7fdcf80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:36.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.754+0000 7fdd00600700 1 -- 172.21.15.82:0/2006608856 shutdown_connections 2024-05-10T04:50:36.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.754+0000 7fdd00600700 1 -- 172.21.15.82:0/2006608856 wait complete. 2024-05-10T04:50:36.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.757+0000 7fdd00600700 1 Processor -- start 2024-05-10T04:50:36.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.757+0000 7fdd00600700 1 -- start start 2024-05-10T04:50:36.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdd00600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf80b5890 0x7fdcf815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:36.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdd00600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf815bfe0 0x7fdcf80d3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:36.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdd00600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcf8161fb0 0x7fdcf80d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdd00600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf815ca00 con 0x7fdcf80b5890 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdd00600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80cba60 con 0x7fdcf8161fb0 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdd00600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80ca150 con 0x7fdcf815bfe0 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdcfdc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf80b5890 0x7fdcf815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdcfdc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf80b5890 0x7fdcf815a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41760/0 (socket says 172.21.15.82:41760) 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdcfdc00700 1 -- 172.21.15.82:0/4011606356 learned_addr learned my addr 172.21.15.82:0/4011606356 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdcfd200700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf815bfe0 0x7fdcf80d3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdcfe600700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcf8161fb0 0x7fdcf80d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdcfdc00700 1 -- 172.21.15.82:0/4011606356 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf815bfe0 msgr2=0x7fdcf80d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.759+0000 7fdcfdc00700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf815bfe0 0x7fdcf80d3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdcfdc00700 1 -- 172.21.15.82:0/4011606356 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcf8161fb0 msgr2=0x7fdcf80d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdcfdc00700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcf8161fb0 0x7fdcf80d42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdcfdc00700 1 -- 172.21.15.82:0/4011606356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec0094a0 con 0x7fdcf80b5890 2024-05-10T04:50:36.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdcfdc00700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf80b5890 0x7fdcf815a6a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009b90 tx=0x7fdcec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:36.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdcf5600700 1 -- 172.21.15.82:0/4011606356 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0038a0 con 0x7fdcf80b5890 2024-05-10T04:50:36.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdcf5600700 1 -- 172.21.15.82:0/4011606356 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec01e070 con 0x7fdcf80b5890 2024-05-10T04:50:36.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf815c530 con 0x7fdcf80b5890 2024-05-10T04:50:36.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdcf5600700 1 -- 172.21.15.82:0/4011606356 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec003c40 con 0x7fdcf80b5890 2024-05-10T04:50:36.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.760+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf80cbf90 con 0x7fdcf80b5890 2024-05-10T04:50:36.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.761+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf8074af0 con 0x7fdcf80b5890 2024-05-10T04:50:36.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.762+0000 7fdcf5600700 1 -- 172.21.15.82:0/4011606356 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdcec02d450 con 0x7fdcf80b5890 2024-05-10T04:50:36.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.763+0000 7fdcf5600700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcd806ac90 0x7fdcd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.763+0000 7fdcf5600700 1 -- 172.21.15.82:0/4011606356 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcec08a410 con 0x7fdcf80b5890 2024-05-10T04:50:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.763+0000 7fdcfd200700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcd806ac90 0x7fdcd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:36.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.764+0000 7fdcfd200700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcd806ac90 0x7fdcd806d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80b6ac0 tx=0x7fdce4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:36.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:36.768+0000 7fdcf5600700 1 -- 172.21.15.82:0/4011606356 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdcec055550 con 0x7fdcf80b5890 2024-05-10T04:50:37.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.015+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdcf815bb50 con 0x7fdcf80b5890 2024-05-10T04:50:37.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.015+0000 7fdcf5600700 1 -- 172.21.15.82:0/4011606356 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdcec058b70 con 0x7fdcf80b5890 2024-05-10T04:50:37.017 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:50:37.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.017+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcd806ac90 msgr2=0x7fdcd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:37.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.017+0000 7fdd00600700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcd806ac90 0x7fdcd806d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80b6ac0 tx=0x7fdce4008040 comp rx=0 tx=0).stop 2024-05-10T04:50:37.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.017+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf80b5890 msgr2=0x7fdcf815a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:37.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.017+0000 7fdd00600700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf80b5890 0x7fdcf815a6a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009b90 tx=0x7fdcec004750 comp rx=0 tx=0).stop 2024-05-10T04:50:37.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.018+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 shutdown_connections 2024-05-10T04:50:37.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.018+0000 7fdd00600700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdcd806ac90 0x7fdcd806d1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:37.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.018+0000 7fdd00600700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdcf8161fb0 0x7fdcf80d42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:37.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.018+0000 7fdd00600700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcf80b5890 0x7fdcf815a6a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:37.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.018+0000 7fdd00600700 1 --2- 172.21.15.82:0/4011606356 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdcf815bfe0 0x7fdcf80d3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:37.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.018+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 >> 172.21.15.82:0/4011606356 conn(0x7fdcf80d0a70 msgr2=0x7fdcf815de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:37.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.018+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 shutdown_connections 2024-05-10T04:50:37.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:37.018+0000 7fdd00600700 1 -- 172.21.15.82:0/4011606356 wait complete. 2024-05-10T04:50:37.047 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:50:37.047 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:50:37.047 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-05-10T04:50:37.047 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T04:50:37.048 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T04:50:37.048 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:50:37.048 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:50:37.048 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:50:37.048 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:50:37.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:37.048 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-05-10T04:50:37.093 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:50:37.093 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:50:37.093 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:50:37.093 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:37.093 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T04:50:37.093 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:37.093 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:37.094 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:50:37.095 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42486sec preferred_lft 42486sec 2024-05-10T04:50:37.095 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-10T04:50:37.095 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:37.096 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T04:50:37.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:37.096 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:37.097 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:37.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-05-10T04:50:37.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-05-10T04:50:37.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-05-10T04:50:37.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T04:50:37.097 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:37.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:37.579 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:50:37.648 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-10T04:50:37.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:37.652 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-05-10T04:50:37.712 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-05-10T04:50:37.712 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:50:37.712 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:50:37.712 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:50:37.712 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:50:37.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:37.713 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:37.713 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:37.713 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:50:37.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:50:37.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:50:37.714 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:38.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:38.381 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T04:50:38.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:38.426 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-05-10T04:50:38.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:38.512 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:38.512 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:38.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:50:38.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-10T04:50:38.512 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:38.690 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-10T04:50:38.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:38.690 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:38.691 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:38.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-10T04:50:38.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T04:50:38.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-10T04:50:38.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-10T04:50:38.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-10T04:50:38.691 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:38.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:38.950 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:38.950 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:38.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-05-10T04:50:38.951 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T04:50:38.951 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:39.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:50:39.118 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T04:50:39.163 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:50:39.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:50:39.163 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:50:39.247 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T04:50:39.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:39.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T04:50:39.462 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T04:50:39.462 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T04:50:39.462 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:50:40.139 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T04:50:40.140 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T04:50:40.140 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:50:40.140 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:50:40.140 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:50:40.173 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T04:50:40.174 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T04:50:40.174 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:50:40.174 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:50:40.174 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:50:40.174 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790" 2024-05-10T04:50:40.174 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790:/ 2024-05-10T04:50:40.174 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c7bb1514-6d11-4350-825d-a52cfeee72e9" will pass to kernel 2024-05-10T04:50:40.179 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:50:40.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:40.179 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:50:40.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:40.248 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:40.374 INFO:teuthology.orchestra.run.smithi082.stdout:client4502 2024-05-10T04:50:40.375 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:50:40.375 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:50:40.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:40.419 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:client4502 2024-05-10T04:50:40.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:40.547 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:40.631 INFO:teuthology.orchestra.run.smithi082.stdout:client4502 2024-05-10T04:50:40.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:40.632 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c7bb1514-6d11-4350-825d-a52cfeee72e9.client4502/status') 2024-05-10T04:50:40.735 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.4502 (3)172.21.15.82:0/2794469371 2024-05-10T04:50:40.736 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-05-10T04:50:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-05-10T04:50:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-05-10T04:50:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:70 bytes copied, 5.1939e-05 s, 1.3 MB/s 2024-05-10T04:50:40.739 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-05-10T04:50:40.739 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:50:40.739 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T04:50:40.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:50:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.000+0000 7fd770e00700 1 Processor -- start 2024-05-10T04:50:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.001+0000 7fd770e00700 1 -- start start 2024-05-10T04:50:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd770e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd76c162c30 0x7fd76c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:41.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd770e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd76c0b5ee0 0x7fd76c0d2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:41.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd770e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c1627a0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd770e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c163040 con 0x7fd76c162c30 2024-05-10T04:50:41.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd770e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c15f4e0 con 0x7fd76c0b5ee0 2024-05-10T04:50:41.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd76a800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd76c0d2c90 0x7fd76c06c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54930/0 (socket says 172.21.15.82:54930) 2024-05-10T04:50:41.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd76a800700 1 -- 172.21.15.82:0/2557257056 learned_addr learned my addr 172.21.15.82:0/2557257056 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:41.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd769e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd76c162c30 0x7fd76c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:41.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.003+0000 7fd763e00700 1 --2- 172.21.15.82:0/2557257056 >> v2:172.21.15.129:3300/0 conn(0x7fd76c0b5ee0 0x7fd76c0d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769e00700 1 -- 172.21.15.82:0/2557257056 >> v2:172.21.15.129:3300/0 conn(0x7fd76c0b5ee0 msgr2=0x7fd76c0d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769e00700 1 --2- 172.21.15.82:0/2557257056 >> v2:172.21.15.129:3300/0 conn(0x7fd76c0b5ee0 0x7fd76c0d2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769e00700 1 -- 172.21.15.82:0/2557257056 >> v1:172.21.15.82:6789/0 conn(0x7fd76c0d2c90 legacy=0x7fd76c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769e00700 1 -- 172.21.15.82:0/2557257056 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c15fa20 con 0x7fd76c162c30 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769400700 1 -- 172.21.15.82:0/2557257056 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150255076 0 0) 0x7fd76c1627a0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769e00700 1 --2- 172.21.15.82:0/2557257056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c162c30 0x7fd76c0b59a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd76c06d770 tx=0x7fd75c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8a7983c638cdd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769400700 1 -- 172.21.15.82:0/2557257056 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c011830 con 0x7fd76c162c30 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769400700 1 -- 172.21.15.82:0/2557257056 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c011990 con 0x7fd76c162c30 2024-05-10T04:50:41.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.004+0000 7fd769400700 1 -- 172.21.15.82:0/2557257056 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c011d20 con 0x7fd76c162c30 2024-05-10T04:50:41.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.005+0000 7fd770e00700 1 -- 172.21.15.82:0/2557257056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c162c30 msgr2=0x7fd76c0b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:41.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.005+0000 7fd770e00700 1 --2- 172.21.15.82:0/2557257056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c162c30 0x7fd76c0b59a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd76c06d770 tx=0x7fd75c009b20 comp rx=0 tx=0).stop 2024-05-10T04:50:41.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.005+0000 7fd770e00700 1 -- 172.21.15.82:0/2557257056 shutdown_connections 2024-05-10T04:50:41.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.005+0000 7fd770e00700 1 --2- 172.21.15.82:0/2557257056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c162c30 0x7fd76c0b59a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.005+0000 7fd770e00700 1 --2- 172.21.15.82:0/2557257056 >> v2:172.21.15.129:3300/0 conn(0x7fd76c0b5ee0 0x7fd76c0d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.005+0000 7fd770e00700 1 -- 172.21.15.82:0/2557257056 >> 172.21.15.82:0/2557257056 conn(0x7fd76c0d0b80 msgr2=0x7fd76c0d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:41.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.005+0000 7fd770e00700 1 -- 172.21.15.82:0/2557257056 shutdown_connections 2024-05-10T04:50:41.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.005+0000 7fd770e00700 1 -- 172.21.15.82:0/2557257056 wait complete. 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.007+0000 7fd770e00700 1 Processor -- start 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.008+0000 7fd770e00700 1 -- start start 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd770e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd76c0b5ee0 0x7fd76c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd770e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c0d2c90 0x7fd76c0b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd770e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd76c162c30 0x7fd76c14af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd770e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0ca0b0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd770e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1f89f0 con 0x7fd76c0b5ee0 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd770e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1f7de0 con 0x7fd76c162c30 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd763e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c0d2c90 0x7fd76c0b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd763e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c0d2c90 0x7fd76c0b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41768/0 (socket says 172.21.15.82:41768) 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd763e00700 1 -- 172.21.15.82:0/859685589 learned_addr learned my addr 172.21.15.82:0/859685589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:41.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd769e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd76c0b5ee0 0x7fd76c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.009+0000 7fd76a800700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd76c162c30 0x7fd76c14af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd763e00700 1 -- 172.21.15.82:0/859685589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd76c162c30 msgr2=0x7fd76c14af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd763e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd76c162c30 0x7fd76c14af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd763e00700 1 -- 172.21.15.82:0/859685589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd76c0b5ee0 msgr2=0x7fd76c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd763e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd76c0b5ee0 0x7fd76c0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd763e00700 1 -- 172.21.15.82:0/859685589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0094a0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd763e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c0d2c90 0x7fd76c0b8be0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd75400d800 tx=0x7fd75400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd762000700 1 -- 172.21.15.82:0/859685589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7540125f0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd762000700 1 -- 172.21.15.82:0/859685589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd754012750 con 0x7fd76c0d2c90 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c1f80c0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd762000700 1 -- 172.21.15.82:0/859685589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754012b00 con 0x7fd76c0d2c90 2024-05-10T04:50:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.010+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c1f8680 con 0x7fd76c0d2c90 2024-05-10T04:50:41.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.011+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c0732b0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.012+0000 7fd762000700 1 -- 172.21.15.82:0/859685589 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd754012c60 con 0x7fd76c0d2c90 2024-05-10T04:50:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.013+0000 7fd762000700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd74806acc0 0x7fd74806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.013+0000 7fd762000700 1 -- 172.21.15.82:0/859685589 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7540893f0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.014+0000 7fd769e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd74806acc0 0x7fd74806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.014+0000 7fd769e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd74806acc0 0x7fd74806d1d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0090b0 tx=0x7fd75c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:41.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.018+0000 7fd762000700 1 -- 172.21.15.82:0/859685589 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd7540544a0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.268+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd76c1f8b60 con 0x7fd76c0d2c90 2024-05-10T04:50:41.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.268+0000 7fd762000700 1 -- 172.21.15.82:0/859685589 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd754057ac0 con 0x7fd76c0d2c90 2024-05-10T04:50:41.270 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:50:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd74806acc0 msgr2=0x7fd74806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd74806acc0 0x7fd74806d1d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0090b0 tx=0x7fd75c01c040 comp rx=0 tx=0).stop 2024-05-10T04:50:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c0d2c90 msgr2=0x7fd76c0b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c0d2c90 0x7fd76c0b8be0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd75400d800 tx=0x7fd75400db10 comp rx=0 tx=0).stop 2024-05-10T04:50:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 shutdown_connections 2024-05-10T04:50:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd74806acc0 0x7fd74806d1d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd76c162c30 0x7fd76c14af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd76c0b5ee0 0x7fd76c0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 --2- 172.21.15.82:0/859685589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd76c0d2c90 0x7fd76c0b8be0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.270+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 >> 172.21.15.82:0/859685589 conn(0x7fd76c0d0b80 msgr2=0x7fd76c15d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.271+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 shutdown_connections 2024-05-10T04:50:41.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:41.271+0000 7fd770e00700 1 -- 172.21.15.82:0/859685589 wait complete. 2024-05-10T04:50:41.300 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:50:41.300 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:50:41.300 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-05-10T04:50:41.300 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-10T04:50:41.300 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-10T04:50:41.300 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:50:41.300 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:50:41.301 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:50:41.301 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-10T04:50:41.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:41.301 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-05-10T04:50:41.346 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:50:41.346 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:50:41.347 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:50:41.347 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:41.347 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T04:50:41.347 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:41.347 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:41.347 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42482sec preferred_lft 42482sec 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:50:41.348 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 32:ba:43:a6:a3:e3 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:41.349 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T04:50:41.349 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:41.349 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ac3d:f6ff:fec4:7947/64 scope link 2024-05-10T04:50:41.349 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:41.349 INFO:teuthology.orchestra.run.smithi082.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T04:50:41.349 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 32:ba:43:a6:a3:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:50:41.349 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::30ba:43ff:fea6:a3e3/64 scope link 2024-05-10T04:50:41.349 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:41.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:41.350 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:50:41.454 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-10T04:50:41.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:41.457 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-05-10T04:50:41.505 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-05-10T04:50:41.505 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:50:41.505 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:50:41.506 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:50:41.506 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:50:41.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:41.506 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:41.506 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:41.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:50:41.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:50:41.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:50:41.506 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:41.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:41.670 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T04:50:41.714 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T04:50:41.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:41.715 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-05-10T04:50:41.802 INFO:teuthology.orchestra.run.smithi082.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-10T04:50:41.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:41.803 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:41.803 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:41.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T04:50:41.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-10T04:50:41.803 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:41.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:41.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T04:50:42.047 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:50:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:50:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:50:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T04:50:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:42.048 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:50:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 16:cc:f3:4a:9d:1e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T04:50:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T04:50:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::14cc:f3ff:fe4a:9d1e/64 scope link 2024-05-10T04:50:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:42.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:42.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-10T04:50:42.118 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:50:42.118 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 16:cc:f3:4a:9d:1e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::14cc:f3ff:fe4a:9d1e/64 scope link 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:42.121 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-10T04:50:42.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-10T04:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T04:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-10T04:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-10T04:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-10T04:50:42.122 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:42.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:42.357 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:50:42.357 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:50:42.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.1 up 2024-05-10T04:50:42.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T04:50:42.357 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:50:42.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:50:42.523 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-10T04:50:42.568 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-10T04:50:42.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:50:42.568 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-10T04:50:42.652 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T04:50:42.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:42.652 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T04:50:42.866 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T04:50:42.866 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T04:50:42.866 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:50:42.886 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T04:50:42.887 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T04:50:42.887 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:50:42.887 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:50:42.887 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:50:42.920 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-10T04:50:42.920 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-10T04:50:42.920 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:50:42.920 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:50:42.920 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:50:42.920 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790" 2024-05-10T04:50:42.920 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790:/ 2024-05-10T04:50:42.920 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c7bb1514-6d11-4350-825d-a52cfeee72e9" will pass to kernel 2024-05-10T04:50:42.925 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:50:42.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:42.925 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-10T04:50:42.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:42.992 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:43.078 INFO:teuthology.orchestra.run.smithi082.stdout:client4680 2024-05-10T04:50:43.079 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:50:43.079 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:50:43.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:43.123 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:43.248 INFO:teuthology.orchestra.run.smithi082.stdout:client4680 2024-05-10T04:50:43.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:43.249 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:43.334 INFO:teuthology.orchestra.run.smithi082.stdout:client4680 2024-05-10T04:50:43.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:43.335 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c7bb1514-6d11-4350-825d-a52cfeee72e9.client4680/status') 2024-05-10T04:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.4680 (3)192.168.0.2:0/3566969357 2024-05-10T04:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-05-10T04:50:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-05-10T04:50:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-05-10T04:50:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:69 bytes copied, 5.0536e-05 s, 1.4 MB/s 2024-05-10T04:50:43.441 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-10T04:50:43.441 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:50:43.442 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T04:50:43.442 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:50:43.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.705+0000 7fa212000700 1 Processor -- start 2024-05-10T04:50:43.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.705+0000 7fa212000700 1 -- start start 2024-05-10T04:50:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.707+0000 7fa212000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa20c0cf450 0x7fa20c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.707+0000 7fa212000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa20c15a850 0x7fa20c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.707+0000 7fa212000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20c072870 con 0x7fa20c072460 2024-05-10T04:50:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.707+0000 7fa212000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c0ce600 con 0x7fa20c0cf450 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.707+0000 7fa212000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c0cd9f0 con 0x7fa20c15a850 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.707+0000 7fa20b400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa20c0cf450 0x7fa20c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.707+0000 7fa20b400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa20c0cf450 0x7fa20c0ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41776/0 (socket says 172.21.15.82:41776) 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.707+0000 7fa20b400700 1 -- 172.21.15.82:0/2668762999 learned_addr learned my addr 172.21.15.82:0/2668762999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20aa00700 1 --2- 172.21.15.82:0/2668762999 >> v2:172.21.15.129:3300/0 conn(0x7fa20c15a850 0x7fa20c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20b400700 1 -- 172.21.15.82:0/2668762999 >> v2:172.21.15.129:3300/0 conn(0x7fa20c15a850 msgr2=0x7fa20c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20b400700 1 --2- 172.21.15.82:0/2668762999 >> v2:172.21.15.129:3300/0 conn(0x7fa20c15a850 0x7fa20c071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20b400700 1 -- 172.21.15.82:0/2668762999 >> v1:172.21.15.129:6789/0 conn(0x7fa20c072460 legacy=0x7fa20c06ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20b400700 1 -- 172.21.15.82:0/2668762999 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0cdcd0 con 0x7fa20c0cf450 2024-05-10T04:50:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20b400700 1 --2- 172.21.15.82:0/2668762999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c0cf450 0x7fa20c0ca0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0708a0 tx=0x7fa1fc00ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27dea1247308940 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20a000700 1 -- 172.21.15.82:0/2668762999 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00cb30 con 0x7fa20c0cf450 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20a000700 1 -- 172.21.15.82:0/2668762999 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00cc90 con 0x7fa20c0cf450 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.708+0000 7fa20a000700 1 -- 172.21.15.82:0/2668762999 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc004030 con 0x7fa20c0cf450 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.709+0000 7fa212000700 1 -- 172.21.15.82:0/2668762999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c0cf450 msgr2=0x7fa20c0ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.709+0000 7fa212000700 1 --2- 172.21.15.82:0/2668762999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c0cf450 0x7fa20c0ca0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0708a0 tx=0x7fa1fc00ad70 comp rx=0 tx=0).stop 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.709+0000 7fa212000700 1 -- 172.21.15.82:0/2668762999 shutdown_connections 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.709+0000 7fa212000700 1 --2- 172.21.15.82:0/2668762999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c0cf450 0x7fa20c0ca0d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.709+0000 7fa212000700 1 --2- 172.21.15.82:0/2668762999 >> v2:172.21.15.129:3300/0 conn(0x7fa20c15a850 0x7fa20c071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.709+0000 7fa212000700 1 -- 172.21.15.82:0/2668762999 >> 172.21.15.82:0/2668762999 conn(0x7fa20c0cfa80 msgr2=0x7fa20c0cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.709+0000 7fa212000700 1 -- 172.21.15.82:0/2668762999 shutdown_connections 2024-05-10T04:50:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.709+0000 7fa212000700 1 -- 172.21.15.82:0/2668762999 wait complete. 2024-05-10T04:50:43.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.712+0000 7fa212000700 1 Processor -- start 2024-05-10T04:50:43.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.712+0000 7fa212000700 1 -- start start 2024-05-10T04:50:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.713+0000 7fa212000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa20c072460 0x7fa20c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.713+0000 7fa212000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa20c0cf450 0x7fa20c149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.713+0000 7fa212000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c15a850 0x7fa20c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.713+0000 7fa212000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c151ba0 con 0x7fa20c15a850 2024-05-10T04:50:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.713+0000 7fa212000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c1f4c00 con 0x7fa20c072460 2024-05-10T04:50:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.713+0000 7fa212000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c15dc10 con 0x7fa20c0cf450 2024-05-10T04:50:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c15a850 0x7fa20c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c15a850 0x7fa20c0c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41784/0 (socket says 172.21.15.82:41784) 2024-05-10T04:50:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20be00700 1 -- 172.21.15.82:0/2055943629 learned_addr learned my addr 172.21.15.82:0/2055943629 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20aa00700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa20c0cf450 0x7fa20c149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20b400700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa20c072460 0x7fa20c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20be00700 1 -- 172.21.15.82:0/2055943629 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa20c0cf450 msgr2=0x7fa20c149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20be00700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa20c0cf450 0x7fa20c149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20be00700 1 -- 172.21.15.82:0/2055943629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa20c072460 msgr2=0x7fa20c15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20be00700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa20c072460 0x7fa20c15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.714+0000 7fa20be00700 1 -- 172.21.15.82:0/2055943629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc00a6f0 con 0x7fa20c15a850 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.715+0000 7fa20be00700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c15a850 0x7fa20c0c8dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa20400b970 tx=0x7fa20400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.715+0000 7fa203400700 1 -- 172.21.15.82:0/2055943629 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20400f860 con 0x7fa20c15a850 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.715+0000 7fa203400700 1 -- 172.21.15.82:0/2055943629 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20400f9c0 con 0x7fa20c15a850 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.715+0000 7fa203400700 1 -- 172.21.15.82:0/2055943629 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20400fd70 con 0x7fa20c15a850 2024-05-10T04:50:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.715+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c150f20 con 0x7fa20c15a850 2024-05-10T04:50:43.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.715+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c1514e0 con 0x7fa20c15a850 2024-05-10T04:50:43.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.716+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c074af0 con 0x7fa20c15a850 2024-05-10T04:50:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.717+0000 7fa203400700 1 -- 172.21.15.82:0/2055943629 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa20400d3f0 con 0x7fa20c15a850 2024-05-10T04:50:43.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.718+0000 7fa203400700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa1ec06ac90 0x7fa1ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:43.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.718+0000 7fa203400700 1 -- 172.21.15.82:0/2055943629 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2040897f0 con 0x7fa20c15a850 2024-05-10T04:50:43.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.719+0000 7fa20b400700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa1ec06ac90 0x7fa1ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:43.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.719+0000 7fa20b400700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa1ec06ac90 0x7fa1ec06d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0708a0 tx=0x7fa1fc01a040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:43.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.723+0000 7fa203400700 1 -- 172.21.15.82:0/2055943629 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa204054930 con 0x7fa20c15a850 2024-05-10T04:50:43.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.970+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa20c0cd630 con 0x7fa20c15a850 2024-05-10T04:50:43.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.970+0000 7fa203400700 1 -- 172.21.15.82:0/2055943629 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa20c0cd630 con 0x7fa20c15a850 2024-05-10T04:50:43.972 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:50:43.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa1ec06ac90 msgr2=0x7fa1ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa1ec06ac90 0x7fa1ec06d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0708a0 tx=0x7fa1fc01a040 comp rx=0 tx=0).stop 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c15a850 msgr2=0x7fa20c0c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c15a850 0x7fa20c0c8dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa20400b970 tx=0x7fa20400bc80 comp rx=0 tx=0).stop 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 shutdown_connections 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa1ec06ac90 0x7fa1ec06d1a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20c15a850 0x7fa20c0c8dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa20c072460 0x7fa20c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 --2- 172.21.15.82:0/2055943629 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa20c0cf450 0x7fa20c149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 >> 172.21.15.82:0/2055943629 conn(0x7fa20c0cfa80 msgr2=0x7fa20c0cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 shutdown_connections 2024-05-10T04:50:43.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:43.973+0000 7fa212000700 1 -- 172.21.15.82:0/2055943629 wait complete. 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi129.front.sepia.ceph.com 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:50:44.003 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-10T04:50:44.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:44.004 DEBUG:teuthology.orchestra.run.smithi129:> ip addr 2024-05-10T04:50:44.055 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:50:44.055 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:50:44.055 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:50:44.055 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:44.055 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2024-05-10T04:50:44.055 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:44.055 INFO:teuthology.orchestra.run.smithi129.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:44.055 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:38 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f0 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:39 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f1 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:60 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:61 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: inet 172.21.15.129/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft 42493sec preferred_lft 42493sec 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::ec4:7aff:fe88:7261/64 scope link 2024-05-10T04:50:44.056 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:44.058 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T04:50:44.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:44.058 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:44.058 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:44.058 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add name ceph-brx type bridge 2024-05-10T04:50:44.058 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip addr flush dev ceph-brx 2024-05-10T04:50:44.058 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set ceph-brx up 2024-05-10T04:50:44.058 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T04:50:44.058 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:44.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:44.494 DEBUG:teuthology.orchestra.run.smithi129:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:50:44.562 INFO:teuthology.orchestra.run.smithi129.stdout:1 2024-05-10T04:50:44.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:44.566 DEBUG:teuthology.orchestra.run.smithi129:> route 2024-05-10T04:50:44.625 INFO:teuthology.orchestra.run.smithi129.stdout:Kernel IP routing table 2024-05-10T04:50:44.626 INFO:teuthology.orchestra.run.smithi129.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:50:44.626 INFO:teuthology.orchestra.run.smithi129.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:50:44.626 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:50:44.626 INFO:teuthology.orchestra.run.smithi129.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:50:44.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:44.627 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:44.627 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:44.627 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:50:44.627 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:50:44.627 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:50:44.627 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:45.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:45.315 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-05-10T04:50:45.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:45.360 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list-id 2024-05-10T04:50:45.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:45.446 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:45.446 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:45.447 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T04:50:45.447 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-10T04:50:45.447 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:45.623 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-10T04:50:45.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:45.624 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:45.624 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:45.624 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-10T04:50:45.624 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T04:50:45.625 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-10T04:50:45.625 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-10T04:50:45.625 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-10T04:50:45.625 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:45.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:45.890 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:45.890 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:45.891 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set brx.0 up 2024-05-10T04:50:45.891 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T04:50:45.891 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:46.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:50:46.056 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-10T04:50:46.101 INFO:teuthology.orchestra.run.smithi129.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-10T04:50:46.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:50:46.101 DEBUG:teuthology.orchestra.run.smithi129:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-10T04:50:46.185 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T04:50:46.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:46.185 DEBUG:teuthology.orchestra.run.smithi129:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T04:50:46.397 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T04:50:46.398 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T04:50:46.398 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-05-10T04:50:47.095 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T04:50:47.095 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T04:50:47.096 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-05-10T04:50:47.096 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:50:47.096 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:50:47.132 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-10T04:50:47.133 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-10T04:50:47.133 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-05-10T04:50:47.133 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:50:47.133 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:50:47.133 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790" 2024-05-10T04:50:47.133 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790:/ 2024-05-10T04:50:47.133 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c7bb1514-6d11-4350-825d-a52cfeee72e9" will pass to kernel 2024-05-10T04:50:47.138 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:50:47.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:47.138 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-10T04:50:47.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:47.207 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:47.308 INFO:teuthology.orchestra.run.smithi129.stdout:client4624 2024-05-10T04:50:47.308 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:50:47.309 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:50:47.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:47.353 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:47.477 INFO:teuthology.orchestra.run.smithi129.stdout:client4624 2024-05-10T04:50:47.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:47.478 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:47.564 INFO:teuthology.orchestra.run.smithi129.stdout:client4624 2024-05-10T04:50:47.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:47.564 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c7bb1514-6d11-4350-825d-a52cfeee72e9.client4624/status') 2024-05-10T04:50:47.669 INFO:teuthology.orchestra.run.smithi129.stdout:instance: client.4624 (3)192.168.0.1:0/2839962635 2024-05-10T04:50:47.669 INFO:teuthology.orchestra.run.smithi129.stdout:blocklisted: false 2024-05-10T04:50:47.670 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records in 2024-05-10T04:50:47.670 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records out 2024-05-10T04:50:47.670 INFO:teuthology.orchestra.run.smithi129.stderr:69 bytes copied, 6.4304e-05 s, 1.1 MB/s 2024-05-10T04:50:47.672 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-05-10T04:50:47.672 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:50:47.672 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T04:50:47.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:50:47.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.943+0000 7f061f000700 1 Processor -- start 2024-05-10T04:50:47.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.943+0000 7f061f000700 1 -- start start 2024-05-10T04:50:47.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.945+0000 7f061f000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f06180b2ca0 0x7f06180cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:47.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.945+0000 7f061f000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0618161e40 con 0x7f061815e350 2024-05-10T04:50:47.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.945+0000 7f061f000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0618162120 con 0x7f061815df40 2024-05-10T04:50:47.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.945+0000 7f061f000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0618162400 con 0x7f06180b2ca0 2024-05-10T04:50:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f061e600700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f061815e350 0x7f06180d24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38210/0 (socket says 172.21.15.82:38210) 2024-05-10T04:50:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f061e600700 1 -- 172.21.15.82:0/395013806 learned_addr learned my addr 172.21.15.82:0/395013806 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f061dc00700 1 --2- 172.21.15.82:0/395013806 >> v2:172.21.15.129:3300/0 conn(0x7f06180b2ca0 0x7f06180cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f0617e00700 1 -- 172.21.15.82:0/395013806 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066142692 0 0) 0x7f0618161e40 con 0x7f061815e350 2024-05-10T04:50:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f0617e00700 1 -- 172.21.15.82:0/395013806 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06000035b0 con 0x7f061815e350 2024-05-10T04:50:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f061dc00700 1 -- 172.21.15.82:0/395013806 >> v1:172.21.15.129:6789/0 conn(0x7f061815df40 legacy=0x7f06180d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f0617e00700 1 -- 172.21.15.82:0/395013806 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225962091 0 0) 0x7f0618162120 con 0x7f061815df40 2024-05-10T04:50:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f061dc00700 1 -- 172.21.15.82:0/395013806 >> v1:172.21.15.82:6789/0 conn(0x7f061815e350 legacy=0x7f06180d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.946+0000 7f061dc00700 1 -- 172.21.15.82:0/395013806 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06181626e0 con 0x7f06180b2ca0 2024-05-10T04:50:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.947+0000 7f061dc00700 1 --2- 172.21.15.82:0/395013806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06180b2ca0 0x7f06180cf150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f060c009840 tx=0x7f060c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=610effb1bb2f699c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.947+0000 7f0617e00700 1 -- 172.21.15.82:0/395013806 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011830 con 0x7f06180b2ca0 2024-05-10T04:50:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.947+0000 7f0617e00700 1 -- 172.21.15.82:0/395013806 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c011990 con 0x7f06180b2ca0 2024-05-10T04:50:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.947+0000 7f0617e00700 1 -- 172.21.15.82:0/395013806 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011d20 con 0x7f06180b2ca0 2024-05-10T04:50:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.948+0000 7f061f000700 1 -- 172.21.15.82:0/395013806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06180b2ca0 msgr2=0x7f06180cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.948+0000 7f061f000700 1 --2- 172.21.15.82:0/395013806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06180b2ca0 0x7f06180cf150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f060c009840 tx=0x7f060c009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.948+0000 7f061f000700 1 -- 172.21.15.82:0/395013806 shutdown_connections 2024-05-10T04:50:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.948+0000 7f061f000700 1 --2- 172.21.15.82:0/395013806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f06180b2ca0 0x7f06180cf150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.948+0000 7f061f000700 1 -- 172.21.15.82:0/395013806 >> 172.21.15.82:0/395013806 conn(0x7f0618067600 msgr2=0x7f061806c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.948+0000 7f061f000700 1 -- 172.21.15.82:0/395013806 shutdown_connections 2024-05-10T04:50:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.948+0000 7f061f000700 1 -- 172.21.15.82:0/395013806 wait complete. 2024-05-10T04:50:47.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.950+0000 7f061f000700 1 Processor -- start 2024-05-10T04:50:47.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.950+0000 7f061f000700 1 -- start start 2024-05-10T04:50:47.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061f000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f06180b2ca0 0x7f06180ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:47.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061f000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f061815df40 0x7f06181f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061f000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f061815e350 0x7f06181f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061f000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180cc490 con 0x7f061815e350 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061f000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180caf10 con 0x7f061815df40 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061f000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06180c8ce0 con 0x7f06180b2ca0 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061e600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f061815e350 0x7f06181f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061e600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f061815e350 0x7f06181f8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54356/0 (socket says 172.21.15.82:54356) 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061d200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f061815df40 0x7f06181f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061e600700 1 -- 172.21.15.82:0/3431814440 learned_addr learned my addr 172.21.15.82:0/3431814440 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061dc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f06180b2ca0 0x7f06180ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061e600700 1 -- 172.21.15.82:0/3431814440 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f06180b2ca0 msgr2=0x7f06180ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061e600700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f06180b2ca0 0x7f06180ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061e600700 1 -- 172.21.15.82:0/3431814440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f061815df40 msgr2=0x7f06181f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061e600700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f061815df40 0x7f06181f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061e600700 1 -- 172.21.15.82:0/3431814440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c0094a0 con 0x7f061815e350 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061dc00700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f06180b2ca0 0x7f06180ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.952+0000 7f061d200700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f061815df40 0x7f06181f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.953+0000 7f061e600700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f061815e350 0x7f06181f8210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f061000ca70 tx=0x7f061000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.953+0000 7f0615600700 1 -- 172.21.15.82:0/3431814440 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061000a9e0 con 0x7f061815e350 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.953+0000 7f0615600700 1 -- 172.21.15.82:0/3431814440 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061000ab40 con 0x7f061815e350 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.953+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06180cb5c0 con 0x7f061815e350 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.953+0000 7f0615600700 1 -- 172.21.15.82:0/3431814440 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0610012400 con 0x7f061815e350 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.953+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06180cbaf0 con 0x7f061815e350 2024-05-10T04:50:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.954+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0618074af0 con 0x7f061815e350 2024-05-10T04:50:47.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.956+0000 7f0615600700 1 -- 172.21.15.82:0/3431814440 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f061001b3b0 con 0x7f061815e350 2024-05-10T04:50:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.956+0000 7f0615600700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f05f806ac90 0x7f05f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.957+0000 7f0615600700 1 -- 172.21.15.82:0/3431814440 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0610088e70 con 0x7f061815e350 2024-05-10T04:50:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.957+0000 7f061dc00700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f05f806ac90 0x7f05f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:47.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.957+0000 7f061dc00700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f05f806ac90 0x7f05f806d1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f060c009fd0 tx=0x7f060c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:47.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:47.962+0000 7f0615600700 1 -- 172.21.15.82:0/3431814440 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0610054060 con 0x7f061815e350 2024-05-10T04:50:48.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.216+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f061815e7f0 con 0x7f061815e350 2024-05-10T04:50:48.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.217+0000 7f0615600700 1 -- 172.21.15.82:0/3431814440 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0610017070 con 0x7f061815e350 2024-05-10T04:50:48.218 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:50:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f05f806ac90 msgr2=0x7f05f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f05f806ac90 0x7f05f806d1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f060c009fd0 tx=0x7f060c01c040 comp rx=0 tx=0).stop 2024-05-10T04:50:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f061815e350 msgr2=0x7f06181f8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f061815e350 0x7f06181f8210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f061000ca70 tx=0x7f061000cd80 comp rx=0 tx=0).stop 2024-05-10T04:50:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 shutdown_connections 2024-05-10T04:50:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f05f806ac90 0x7f05f806d1a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:48.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f061815e350 0x7f06181f8210 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f06180b2ca0 0x7f06180ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 --2- 172.21.15.82:0/3431814440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f061815df40 0x7f06181f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.219+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 >> 172.21.15.82:0/3431814440 conn(0x7f0618067600 msgr2=0x7f061815ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.220+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 shutdown_connections 2024-05-10T04:50:48.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:48.220+0000 7f061f000700 1 -- 172.21.15.82:0/3431814440 wait complete. 2024-05-10T04:50:48.247 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:50:48.247 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:50:48.247 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi129.front.sepia.ceph.com 2024-05-10T04:50:48.247 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-10T04:50:48.247 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-10T04:50:48.247 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:50:48.247 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:50:48.247 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:50:48.248 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-10T04:50:48.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.248 DEBUG:teuthology.orchestra.run.smithi129:> ip addr 2024-05-10T04:50:48.295 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:38 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f0 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:39 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f1 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:50:48.296 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:60 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:61 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: inet 172.21.15.129/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft 42489sec preferred_lft 42489sec 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::ec4:7aff:fe88:7261/64 scope link 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 52:7a:65:be:71:9a brd ff:ff:ff:ff:ff:ff 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::1c9d:8ff:fed7:fd3c/64 scope link 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T04:50:48.297 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 52:7a:65:be:71:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T04:50:48.298 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::507a:65ff:febe:719a/64 scope link 2024-05-10T04:50:48.298 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.299 DEBUG:teuthology.orchestra.run.smithi129:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:50:48.364 INFO:teuthology.orchestra.run.smithi129.stdout:1 2024-05-10T04:50:48.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.367 DEBUG:teuthology.orchestra.run.smithi129:> route 2024-05-10T04:50:48.415 INFO:teuthology.orchestra.run.smithi129.stdout:Kernel IP routing table 2024-05-10T04:50:48.415 INFO:teuthology.orchestra.run.smithi129.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:50:48.415 INFO:teuthology.orchestra.run.smithi129.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:50:48.416 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:50:48.416 INFO:teuthology.orchestra.run.smithi129.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:50:48.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.416 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:48.416 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:48.416 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:50:48.416 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:50:48.416 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:50:48.416 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:48.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.577 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-05-10T04:50:48.622 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T04:50:48.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.623 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list-id 2024-05-10T04:50:48.707 INFO:teuthology.orchestra.run.smithi129.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-10T04:50:48.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.708 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:48.708 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:48.708 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T04:50:48.708 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-10T04:50:48.708 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:48.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.884 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T04:50:48.951 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 3e:66:0e:be:8a:a3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::3c66:eff:febe:8aa3/64 scope link 2024-05-10T04:50:48.952 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:48.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:48.955 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-10T04:50:49.022 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:50:49.022 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:50:49.022 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:50:49.023 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:49.023 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2024-05-10T04:50:49.023 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:49.023 INFO:teuthology.orchestra.run.smithi129.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:50:49.023 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 3e:66:0e:be:8a:a3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-10T04:50:49.023 INFO:teuthology.orchestra.run.smithi129.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-10T04:50:49.023 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:49.024 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::3c66:eff:febe:8aa3/64 scope link 2024-05-10T04:50:49.024 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:50:49.025 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-10T04:50:49.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:49.025 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:49.025 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:49.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-10T04:50:49.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-10T04:50:49.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-10T04:50:49.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-10T04:50:49.025 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-10T04:50:49.025 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:49.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:49.266 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec bash -c ' 2024-05-10T04:50:49.266 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-05-10T04:50:49.266 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set brx.1 up 2024-05-10T04:50:49.266 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set dev brx.1 master ceph-brx 2024-05-10T04:50:49.266 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-05-10T04:50:49.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:50:49.432 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-10T04:50:49.477 INFO:teuthology.orchestra.run.smithi129.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-10T04:50:49.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:50:49.477 DEBUG:teuthology.orchestra.run.smithi129:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-10T04:50:49.561 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T04:50:49.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:49.562 DEBUG:teuthology.orchestra.run.smithi129:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T04:50:49.775 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T04:50:49.776 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T04:50:49.776 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-05-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-05-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:50:49.796 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:50:49.824 INFO:teuthology.orchestra.run.smithi129.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-10T04:50:49.824 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-10T04:50:49.824 INFO:teuthology.orchestra.run.smithi129.stdout:invalid new device string format 2024-05-10T04:50:49.824 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:50:49.824 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:50:49.824 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790" 2024-05-10T04:50:49.824 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790:/ 2024-05-10T04:50:49.825 INFO:teuthology.orchestra.run.smithi129.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c7bb1514-6d11-4350-825d-a52cfeee72e9" will pass to kernel 2024-05-10T04:50:49.829 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:50:49.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:49.829 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-10T04:50:49.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:49.896 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:49.980 INFO:teuthology.orchestra.run.smithi129.stdout:client4514 2024-05-10T04:50:49.980 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:50:49.980 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:50:50.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:50.025 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:50.150 INFO:teuthology.orchestra.run.smithi129.stdout:client4514 2024-05-10T04:50:50.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:50.151 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:50:50.236 INFO:teuthology.orchestra.run.smithi129.stdout:client4514 2024-05-10T04:50:50.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:50:50.237 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c7bb1514-6d11-4350-825d-a52cfeee72e9.client4514/status') 2024-05-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi129.stdout:instance: client.4514 (3)192.168.0.2:0/4281208751 2024-05-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi129.stdout:blocklisted: false 2024-05-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records in 2024-05-10T04:50:50.340 INFO:teuthology.orchestra.run.smithi129.stderr:0+1 records out 2024-05-10T04:50:50.341 INFO:teuthology.orchestra.run.smithi129.stderr:69 bytes copied, 5.0539e-05 s, 1.4 MB/s 2024-05-10T04:50:50.343 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-10T04:50:50.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:50.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.633+0000 7f2e1b600700 1 Processor -- start 2024-05-10T04:50:50.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.633+0000 7f2e1b600700 1 -- start start 2024-05-10T04:50:50.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e1b600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2e1415bfe0 0x7f2e1415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:50.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e1b600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e140b5fa0 0x7f2e141623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:50.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e1b600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e14162a70 con 0x7f2e14161fb0 2024-05-10T04:50:50.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e1b600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1415c3f0 con 0x7f2e140b5fa0 2024-05-10T04:50:50.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e1b600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e14162d50 con 0x7f2e1415bfe0 2024-05-10T04:50:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e19600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e140b5fa0 0x7f2e141623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e13e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2e14161fb0 0x7f2e140b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38224/0 (socket says 172.21.15.82:38224) 2024-05-10T04:50:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e13e00700 1 -- 172.21.15.82:0/4199494114 learned_addr learned my addr 172.21.15.82:0/4199494114 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.635+0000 7f2e18c00700 1 --2- 172.21.15.82:0/4199494114 >> v2:172.21.15.129:3300/0 conn(0x7f2e1415bfe0 0x7f2e1415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e19600700 1 -- 172.21.15.82:0/4199494114 >> v2:172.21.15.129:3300/0 conn(0x7f2e1415bfe0 msgr2=0x7f2e1415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e19600700 1 --2- 172.21.15.82:0/4199494114 >> v2:172.21.15.129:3300/0 conn(0x7f2e1415bfe0 0x7f2e1415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e19600700 1 -- 172.21.15.82:0/4199494114 >> v1:172.21.15.82:6789/0 conn(0x7f2e14161fb0 legacy=0x7f2e140b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:50.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e19600700 1 -- 172.21.15.82:0/4199494114 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1415ecf0 con 0x7f2e140b5fa0 2024-05-10T04:50:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e13400700 1 -- 172.21.15.82:0/4199494114 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446861842 0 0) 0x7f2e14162a70 con 0x7f2e14161fb0 2024-05-10T04:50:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e19600700 1 --2- 172.21.15.82:0/4199494114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e140b5fa0 0x7f2e141623c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e1408c860 tx=0x7f2e0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b9c88ca15592ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e13400700 1 -- 172.21.15.82:0/4199494114 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00e070 con 0x7f2e140b5fa0 2024-05-10T04:50:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e13400700 1 -- 172.21.15.82:0/4199494114 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00bb20 con 0x7f2e140b5fa0 2024-05-10T04:50:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.636+0000 7f2e13400700 1 -- 172.21.15.82:0/4199494114 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c012430 con 0x7f2e140b5fa0 2024-05-10T04:50:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.637+0000 7f2e1b600700 1 -- 172.21.15.82:0/4199494114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e140b5fa0 msgr2=0x7f2e141623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.637+0000 7f2e1b600700 1 --2- 172.21.15.82:0/4199494114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e140b5fa0 0x7f2e141623c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e1408c860 tx=0x7f2e0c00b330 comp rx=0 tx=0).stop 2024-05-10T04:50:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.637+0000 7f2e1b600700 1 -- 172.21.15.82:0/4199494114 shutdown_connections 2024-05-10T04:50:50.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.637+0000 7f2e1b600700 1 --2- 172.21.15.82:0/4199494114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e140b5fa0 0x7f2e141623c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.637+0000 7f2e1b600700 1 --2- 172.21.15.82:0/4199494114 >> v2:172.21.15.129:3300/0 conn(0x7f2e1415bfe0 0x7f2e1415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.637+0000 7f2e1b600700 1 -- 172.21.15.82:0/4199494114 >> 172.21.15.82:0/4199494114 conn(0x7f2e140d0a70 msgr2=0x7f2e140d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:50.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.637+0000 7f2e1b600700 1 -- 172.21.15.82:0/4199494114 shutdown_connections 2024-05-10T04:50:50.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.637+0000 7f2e1b600700 1 -- 172.21.15.82:0/4199494114 wait complete. 2024-05-10T04:50:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.640+0000 7f2e1b600700 1 Processor -- start 2024-05-10T04:50:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.640+0000 7f2e1b600700 1 -- start start 2024-05-10T04:50:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e1b600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e1415bfe0 0x7f2e14159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e1b600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e14161fb0 0x7f2e1414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e1b600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2e1415ac30 0x7f2e1415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e1b600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e141f52c0 con 0x7f2e1415bfe0 2024-05-10T04:50:50.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e1b600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14159800 con 0x7f2e14161fb0 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e1b600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1415a7a0 con 0x7f2e1415ac30 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e18c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e1415bfe0 0x7f2e14159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e18c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e1415bfe0 0x7f2e14159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54372/0 (socket says 172.21.15.82:54372) 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e13e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e14161fb0 0x7f2e1414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e18c00700 1 -- 172.21.15.82:0/91685335 learned_addr learned my addr 172.21.15.82:0/91685335 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.642+0000 7f2e19600700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2e1415ac30 0x7f2e1415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e18c00700 1 -- 172.21.15.82:0/91685335 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2e1415ac30 msgr2=0x7f2e1415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e18c00700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2e1415ac30 0x7f2e1415d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e18c00700 1 -- 172.21.15.82:0/91685335 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e14161fb0 msgr2=0x7f2e1414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e18c00700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e14161fb0 0x7f2e1414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e18c00700 1 -- 172.21.15.82:0/91685335 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c009a70 con 0x7f2e1415bfe0 2024-05-10T04:50:50.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e18c00700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e1415bfe0 0x7f2e14159200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e870 tx=0x7f2e0800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:50.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e10c00700 1 -- 172.21.15.82:0/91685335 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08009590 con 0x7f2e1415bfe0 2024-05-10T04:50:50.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e10c00700 1 -- 172.21.15.82:0/91685335 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08013680 con 0x7f2e1415bfe0 2024-05-10T04:50:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e14159b90 con 0x7f2e1415bfe0 2024-05-10T04:50:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e10c00700 1 -- 172.21.15.82:0/91685335 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080139f0 con 0x7f2e1415bfe0 2024-05-10T04:50:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.643+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1415a150 con 0x7f2e1415bfe0 2024-05-10T04:50:50.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.644+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e14074af0 con 0x7f2e1415bfe0 2024-05-10T04:50:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.646+0000 7f2e10c00700 1 -- 172.21.15.82:0/91685335 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2e08013b50 con 0x7f2e1415bfe0 2024-05-10T04:50:50.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.646+0000 7f2e10c00700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2df406ac90 0x7f2df406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.647+0000 7f2e10c00700 1 -- 172.21.15.82:0/91685335 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e08089650 con 0x7f2e1415bfe0 2024-05-10T04:50:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.647+0000 7f2e13e00700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2df406ac90 0x7f2df406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:50.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.647+0000 7f2e13e00700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2df406ac90 0x7f2df406d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e140d1cb0 tx=0x7f2e00007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:50.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.652+0000 7f2e10c00700 1 -- 172.21.15.82:0/91685335 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2e08054700 con 0x7f2e1415bfe0 2024-05-10T04:50:50.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.859+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e1415a8e0 con 0x7f2e1415bfe0 2024-05-10T04:50:50.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.860+0000 7f2e10c00700 1 -- 172.21.15.82:0/91685335 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f2e1415a8e0 con 0x7f2e1415bfe0 2024-05-10T04:50:50.861 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:50.862 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:50.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2df406ac90 msgr2=0x7f2df406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:50.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2df406ac90 0x7f2df406d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e140d1cb0 tx=0x7f2e00007e70 comp rx=0 tx=0).stop 2024-05-10T04:50:50.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e1415bfe0 msgr2=0x7f2e14159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:50.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e1415bfe0 0x7f2e14159200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e870 tx=0x7f2e0800eb80 comp rx=0 tx=0).stop 2024-05-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 shutdown_connections 2024-05-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2df406ac90 0x7f2df406d1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2e1415ac30 0x7f2e1415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e1415bfe0 0x7f2e14159200 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 --2- 172.21.15.82:0/91685335 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e14161fb0 0x7f2e1414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 >> 172.21.15.82:0/91685335 conn(0x7f2e140d0a70 msgr2=0x7f2e14160a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:50.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 shutdown_connections 2024-05-10T04:50:50.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:50.862+0000 7f2e1b600700 1 -- 172.21.15.82:0/91685335 wait complete. 2024-05-10T04:50:50.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:50.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:51.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.156+0000 7f2a2fc00700 1 Processor -- start 2024-05-10T04:50:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.156+0000 7f2a2fc00700 1 -- start start 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2fc00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2a28162150 0x7f2a2815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2fc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a2806c160 0x7f2a2806c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2fc00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a280d2c00 con 0x7f2a280cf4d0 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2fc00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2806cab0 con 0x7f2a28162150 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2fc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a28162630 con 0x7f2a2806c160 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2d200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2a28162150 0x7f2a2815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2d200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2a28162150 0x7f2a2815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54386/0 (socket says 172.21.15.82:54386) 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2d200700 1 -- 172.21.15.82:0/3705739823 learned_addr learned my addr 172.21.15.82:0/3705739823 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.158+0000 7f2a2dc00700 1 --2- 172.21.15.82:0/3705739823 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a2806c160 0x7f2a2806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.159+0000 7f2a2d200700 1 -- 172.21.15.82:0/3705739823 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a2806c160 msgr2=0x7f2a2806c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:51.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.159+0000 7f2a2d200700 1 --2- 172.21.15.82:0/3705739823 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a2806c160 0x7f2a2806c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.159+0000 7f2a2d200700 1 -- 172.21.15.82:0/3705739823 >> v1:172.21.15.129:6789/0 conn(0x7f2a280cf4d0 legacy=0x7f2a280b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.159+0000 7f2a2d200700 1 -- 172.21.15.82:0/3705739823 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28162910 con 0x7f2a28162150 2024-05-10T04:50:51.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.159+0000 7f2a2d200700 1 --2- 172.21.15.82:0/3705739823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a28162150 0x7f2a2815e610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009920 tx=0x7f2a1c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ee33b3c952aff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:51.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.159+0000 7f2a27400700 1 -- 172.21.15.82:0/3705739823 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00ba20 con 0x7f2a28162150 2024-05-10T04:50:51.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.159+0000 7f2a27400700 1 -- 172.21.15.82:0/3705739823 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00bb80 con 0x7f2a28162150 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.159+0000 7f2a27400700 1 -- 172.21.15.82:0/3705739823 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c009e70 con 0x7f2a28162150 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.160+0000 7f2a2fc00700 1 -- 172.21.15.82:0/3705739823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a28162150 msgr2=0x7f2a2815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.160+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/3705739823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a28162150 0x7f2a2815e610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009920 tx=0x7f2a1c009c30 comp rx=0 tx=0).stop 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.160+0000 7f2a2fc00700 1 -- 172.21.15.82:0/3705739823 shutdown_connections 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.160+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/3705739823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a28162150 0x7f2a2815e610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.160+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/3705739823 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a2806c160 0x7f2a2806c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.160+0000 7f2a2fc00700 1 -- 172.21.15.82:0/3705739823 >> 172.21.15.82:0/3705739823 conn(0x7f2a280d3e10 msgr2=0x7f2a280d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.160+0000 7f2a2fc00700 1 -- 172.21.15.82:0/3705739823 shutdown_connections 2024-05-10T04:50:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.160+0000 7f2a2fc00700 1 -- 172.21.15.82:0/3705739823 wait complete. 2024-05-10T04:50:51.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.162+0000 7f2a2fc00700 1 Processor -- start 2024-05-10T04:50:51.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.163+0000 7f2a2fc00700 1 -- start start 2024-05-10T04:50:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a2fc00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a2806c160 0x7f2a28160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a2fc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a280cf4d0 0x7f2a2815ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a2fc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a28162150 0x7f2a281e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a2fc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2815f150 con 0x7f2a280cf4d0 2024-05-10T04:50:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a2fc00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2815f580 con 0x7f2a2806c160 2024-05-10T04:50:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a2fc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a281f8740 con 0x7f2a28162150 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a27e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a280cf4d0 0x7f2a2815ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a27e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a280cf4d0 0x7f2a2815ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54388/0 (socket says 172.21.15.82:54388) 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a27e00700 1 -- 172.21.15.82:0/2676370161 learned_addr learned my addr 172.21.15.82:0/2676370161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a2d200700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a2806c160 0x7f2a28160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.164+0000 7f2a2dc00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a28162150 0x7f2a281e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a27e00700 1 -- 172.21.15.82:0/2676370161 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a28162150 msgr2=0x7f2a281e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a27e00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a28162150 0x7f2a281e9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a27e00700 1 -- 172.21.15.82:0/2676370161 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a2806c160 msgr2=0x7f2a28160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a27e00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a2806c160 0x7f2a28160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a27e00700 1 -- 172.21.15.82:0/2676370161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c009550 con 0x7f2a280cf4d0 2024-05-10T04:50:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a27e00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a280cf4d0 0x7f2a2815ec10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400c420 tx=0x7f2a1400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:51.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a24c00700 1 -- 172.21.15.82:0/2676370161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140052d0 con 0x7f2a280cf4d0 2024-05-10T04:50:51.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a24c00700 1 -- 172.21.15.82:0/2676370161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a14005430 con 0x7f2a280cf4d0 2024-05-10T04:50:51.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a281f8990 con 0x7f2a280cf4d0 2024-05-10T04:50:51.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a24c00700 1 -- 172.21.15.82:0/2676370161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140038c0 con 0x7f2a280cf4d0 2024-05-10T04:50:51.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.165+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a281f8f50 con 0x7f2a280cf4d0 2024-05-10T04:50:51.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.166+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a28074af0 con 0x7f2a280cf4d0 2024-05-10T04:50:51.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.167+0000 7f2a24c00700 1 -- 172.21.15.82:0/2676370161 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a14003a20 con 0x7f2a280cf4d0 2024-05-10T04:50:51.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.168+0000 7f2a24c00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2a0806ac90 0x7f2a0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.168+0000 7f2a24c00700 1 -- 172.21.15.82:0/2676370161 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a14088710 con 0x7f2a280cf4d0 2024-05-10T04:50:51.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.169+0000 7f2a2d200700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2a0806ac90 0x7f2a0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.169+0000 7f2a2d200700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2a0806ac90 0x7f2a0806d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009920 tx=0x7f2a1c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:51.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.173+0000 7f2a24c00700 1 -- 172.21.15.82:0/2676370161 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2a140537c0 con 0x7f2a280cf4d0 2024-05-10T04:50:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.377+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a281f90e0 con 0x7f2a280cf4d0 2024-05-10T04:50:51.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.377+0000 7f2a24c00700 1 -- 172.21.15.82:0/2676370161 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a14017020 con 0x7f2a280cf4d0 2024-05-10T04:50:51.379 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2a0806ac90 msgr2=0x7f2a0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2a0806ac90 0x7f2a0806d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009920 tx=0x7f2a1c008030 comp rx=0 tx=0).stop 2024-05-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a280cf4d0 msgr2=0x7f2a2815ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a280cf4d0 0x7f2a2815ec10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400c420 tx=0x7f2a1400c730 comp rx=0 tx=0).stop 2024-05-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 shutdown_connections 2024-05-10T04:50:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2a0806ac90 0x7f2a0806d1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2a28162150 0x7f2a281e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2a2806c160 0x7f2a28160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 --2- 172.21.15.82:0/2676370161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a280cf4d0 0x7f2a2815ec10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 >> 172.21.15.82:0/2676370161 conn(0x7f2a280d3e10 msgr2=0x7f2a280d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 shutdown_connections 2024-05-10T04:50:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.380+0000 7f2a2fc00700 1 -- 172.21.15.82:0/2676370161 wait complete. 2024-05-10T04:50:51.409 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:50:51.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.675+0000 7fd12d800700 1 Processor -- start 2024-05-10T04:50:51.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.675+0000 7fd12d800700 1 -- start start 2024-05-10T04:50:51.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.677+0000 7fd12d800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd12815ea10 0x7fd12806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.677+0000 7fd12d800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd1280b5c90 0x7fd1280b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.677+0000 7fd12d800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12806c5f0 con 0x7fd128158c70 2024-05-10T04:50:51.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.677+0000 7fd12d800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12815ee20 con 0x7fd12815ea10 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.677+0000 7fd12d800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280b65e0 con 0x7fd1280b5c90 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd11e000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd12815ea10 0x7fd12806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd11e000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd12815ea10 0x7fd12806ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54396/0 (socket says 172.21.15.82:54396) 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd11e000700 1 -- 172.21.15.82:0/3120245130 learned_addr learned my addr 172.21.15.82:0/3120245130 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd127400700 1 --2- 172.21.15.82:0/3120245130 >> v2:172.21.15.129:3300/0 conn(0x7fd1280b5c90 0x7fd1280b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd11e000700 1 -- 172.21.15.82:0/3120245130 >> v2:172.21.15.129:3300/0 conn(0x7fd1280b5c90 msgr2=0x7fd1280b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd11e000700 1 --2- 172.21.15.82:0/3120245130 >> v2:172.21.15.129:3300/0 conn(0x7fd1280b5c90 0x7fd1280b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd11e000700 1 -- 172.21.15.82:0/3120245130 >> v1:172.21.15.129:6789/0 conn(0x7fd128158c70 legacy=0x7fd128162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd11e000700 1 -- 172.21.15.82:0/3120245130 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128162850 con 0x7fd12815ea10 2024-05-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.678+0000 7fd11e000700 1 --2- 172.21.15.82:0/3120245130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd12806ca80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd1280ce790 tx=0x7fd110009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f1c9573deebf90 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd126000700 1 -- 172.21.15.82:0/3120245130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11000b870 con 0x7fd12815ea10 2024-05-10T04:50:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd126000700 1 -- 172.21.15.82:0/3120245130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11000b9d0 con 0x7fd12815ea10 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd126000700 1 -- 172.21.15.82:0/3120245130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11000bd60 con 0x7fd12815ea10 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd12d800700 1 -- 172.21.15.82:0/3120245130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 msgr2=0x7fd12806ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd12d800700 1 --2- 172.21.15.82:0/3120245130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd12806ca80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd1280ce790 tx=0x7fd110009bd0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd12d800700 1 -- 172.21.15.82:0/3120245130 shutdown_connections 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd12d800700 1 --2- 172.21.15.82:0/3120245130 >> v2:172.21.15.129:3300/0 conn(0x7fd1280b5c90 0x7fd1280b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd12d800700 1 --2- 172.21.15.82:0/3120245130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd12806ca80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd12d800700 1 -- 172.21.15.82:0/3120245130 >> 172.21.15.82:0/3120245130 conn(0x7fd1280d0d30 msgr2=0x7fd1280d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.679+0000 7fd12d800700 1 -- 172.21.15.82:0/3120245130 shutdown_connections 2024-05-10T04:50:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.680+0000 7fd12d800700 1 -- 172.21.15.82:0/3120245130 wait complete. 2024-05-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.682+0000 7fd12d800700 1 Processor -- start 2024-05-10T04:50:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.682+0000 7fd12d800700 1 -- start start 2024-05-10T04:50:51.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.683+0000 7fd12d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1280b5c90 0x7fd1280cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.683+0000 7fd12d800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd128158c70 0x7fd128157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.683+0000 7fd12d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd1280d2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.683+0000 7fd12d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281f6060 con 0x7fd12815ea10 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.683+0000 7fd12d800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280c9870 con 0x7fd128158c70 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.683+0000 7fd12d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281e8b30 con 0x7fd1280b5c90 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd1280d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd1280d2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54398/0 (socket says 172.21.15.82:54398) 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 -- 172.21.15.82:0/3728656028 learned_addr learned my addr 172.21.15.82:0/3728656028 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd126a00700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1280b5c90 0x7fd1280cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd11e000700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd128158c70 0x7fd128157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 -- 172.21.15.82:0/3728656028 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1280b5c90 msgr2=0x7fd1280cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1280b5c90 0x7fd1280cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 -- 172.21.15.82:0/3728656028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd128158c70 msgr2=0x7fd128157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd128158c70 0x7fd128157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 -- 172.21.15.82:0/3728656028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd110009550 con 0x7fd12815ea10 2024-05-10T04:50:51.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.684+0000 7fd127400700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd1280d2460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd12000d600 tx=0x7fd12000d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:51.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.685+0000 7fd11f400700 1 -- 172.21.15.82:0/3728656028 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200125f0 con 0x7fd12815ea10 2024-05-10T04:50:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.685+0000 7fd11f400700 1 -- 172.21.15.82:0/3728656028 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd120012750 con 0x7fd12815ea10 2024-05-10T04:50:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.685+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1281583d0 con 0x7fd12815ea10 2024-05-10T04:50:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.685+0000 7fd11f400700 1 -- 172.21.15.82:0/3728656028 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120012b00 con 0x7fd12815ea10 2024-05-10T04:50:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.685+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1280c9da0 con 0x7fd12815ea10 2024-05-10T04:50:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.686+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1280732b0 con 0x7fd12815ea10 2024-05-10T04:50:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.687+0000 7fd11f400700 1 -- 172.21.15.82:0/3728656028 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd120012c60 con 0x7fd12815ea10 2024-05-10T04:50:51.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.688+0000 7fd11f400700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd10406ac90 0x7fd10406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:51.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.688+0000 7fd11f400700 1 -- 172.21.15.82:0/3728656028 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd120089460 con 0x7fd12815ea10 2024-05-10T04:50:51.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.688+0000 7fd126a00700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd10406ac90 0x7fd10406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:51.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.688+0000 7fd126a00700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd10406ac90 0x7fd10406d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd1180012e0 tx=0x7fd118009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.692+0000 7fd11f400700 1 -- 172.21.15.82:0/3728656028 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd120054510 con 0x7fd12815ea10 2024-05-10T04:50:51.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.893+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd128074af0 con 0x7fd12815ea10 2024-05-10T04:50:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.894+0000 7fd11f400700 1 -- 172.21.15.82:0/3728656028 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd120057b30 con 0x7fd12815ea10 2024-05-10T04:50:51.895 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:50:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd10406ac90 msgr2=0x7fd10406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd10406ac90 0x7fd10406d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd1180012e0 tx=0x7fd118009040 comp rx=0 tx=0).stop 2024-05-10T04:50:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 msgr2=0x7fd1280d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd1280d2460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd12000d600 tx=0x7fd12000d910 comp rx=0 tx=0).stop 2024-05-10T04:50:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 shutdown_connections 2024-05-10T04:50:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd10406ac90 0x7fd10406d1a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd12815ea10 0x7fd1280d2460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1280b5c90 0x7fd1280cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 --2- 172.21.15.82:0/3728656028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd128158c70 0x7fd128157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 >> 172.21.15.82:0/3728656028 conn(0x7fd1280d0d30 msgr2=0x7fd1280b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 shutdown_connections 2024-05-10T04:50:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:51.896+0000 7fd12d800700 1 -- 172.21.15.82:0/3728656028 wait complete. 2024-05-10T04:50:51.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:50:52.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.186+0000 7fba52800700 1 Processor -- start 2024-05-10T04:50:52.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.186+0000 7fba52800700 1 -- start start 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.187+0000 7fba52800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba4c15e610 0x7fba4c0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.187+0000 7fba52800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c0b7910 0x7fba4c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba52800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0d2c00 con 0x7fba4c162150 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba52800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c15ea20 con 0x7fba4c15e610 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba52800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c162630 con 0x7fba4c0b7910 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba4aa00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba4c15e610 0x7fba4c0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba4aa00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba4c15e610 0x7fba4c0b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54404/0 (socket says 172.21.15.82:54404) 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba4aa00700 1 -- 172.21.15.82:0/4061992043 learned_addr learned my addr 172.21.15.82:0/4061992043 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba4be00700 1 --2- 172.21.15.82:0/4061992043 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c0b7910 0x7fba4c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba4aa00700 1 -- 172.21.15.82:0/4061992043 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c0b7910 msgr2=0x7fba4c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:52.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba4aa00700 1 --2- 172.21.15.82:0/4061992043 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c0b7910 0x7fba4c06c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba4aa00700 1 -- 172.21.15.82:0/4061992043 >> v1:172.21.15.129:6789/0 conn(0x7fba4c162150 legacy=0x7fba4c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.188+0000 7fba4aa00700 1 -- 172.21.15.82:0/4061992043 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c162910 con 0x7fba4c15e610 2024-05-10T04:50:52.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.189+0000 7fba4aa00700 1 --2- 172.21.15.82:0/4061992043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c15e610 0x7fba4c0b73d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba380098f0 tx=0x7fba38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484feed3ce529468 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.189+0000 7fba4a000700 1 -- 172.21.15.82:0/4061992043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800b8a0 con 0x7fba4c15e610 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.189+0000 7fba4a000700 1 -- 172.21.15.82:0/4061992043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3800ba00 con 0x7fba4c15e610 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.189+0000 7fba4a000700 1 -- 172.21.15.82:0/4061992043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800bd90 con 0x7fba4c15e610 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.189+0000 7fba52800700 1 -- 172.21.15.82:0/4061992043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c15e610 msgr2=0x7fba4c0b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.189+0000 7fba52800700 1 --2- 172.21.15.82:0/4061992043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c15e610 0x7fba4c0b73d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba380098f0 tx=0x7fba38009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.190+0000 7fba52800700 1 -- 172.21.15.82:0/4061992043 shutdown_connections 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.190+0000 7fba52800700 1 --2- 172.21.15.82:0/4061992043 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c0b7910 0x7fba4c06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.190+0000 7fba52800700 1 --2- 172.21.15.82:0/4061992043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c15e610 0x7fba4c0b73d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.190+0000 7fba52800700 1 -- 172.21.15.82:0/4061992043 >> 172.21.15.82:0/4061992043 conn(0x7fba4c0d3e10 msgr2=0x7fba4c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.190+0000 7fba52800700 1 -- 172.21.15.82:0/4061992043 shutdown_connections 2024-05-10T04:50:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.190+0000 7fba52800700 1 -- 172.21.15.82:0/4061992043 wait complete. 2024-05-10T04:50:52.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.192+0000 7fba52800700 1 Processor -- start 2024-05-10T04:50:52.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.192+0000 7fba52800700 1 -- start start 2024-05-10T04:50:52.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba52800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c0b7910 0x7fba4c160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba52800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba4c15e610 0x7fba4c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba52800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c162150 0x7fba4c1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba52800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c1f66b0 con 0x7fba4c0b7910 2024-05-10T04:50:52.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba52800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c14f5f0 con 0x7fba4c15e610 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba52800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c15f100 con 0x7fba4c162150 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c0b7910 0x7fba4c160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c0b7910 0x7fba4c160180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54416/0 (socket says 172.21.15.82:54416) 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 -- 172.21.15.82:0/1320804421 learned_addr learned my addr 172.21.15.82:0/1320804421 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 -- 172.21.15.82:0/1320804421 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c162150 msgr2=0x7fba4c1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c162150 0x7fba4c1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 -- 172.21.15.82:0/1320804421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba4c15e610 msgr2=0x7fba4c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4aa00700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba4c15e610 0x7fba4c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba4c15e610 0x7fba4c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 -- 172.21.15.82:0/1320804421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba38009550 con 0x7fba4c0b7910 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4aa00700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba4c15e610 0x7fba4c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.194+0000 7fba4b400700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c0b7910 0x7fba4c160180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c430 tx=0x7fba3c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.195+0000 7fba43400700 1 -- 172.21.15.82:0/1320804421 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0052d0 con 0x7fba4c0b7910 2024-05-10T04:50:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.195+0000 7fba43400700 1 -- 172.21.15.82:0/1320804421 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c005450 con 0x7fba4c0b7910 2024-05-10T04:50:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.195+0000 7fba43400700 1 -- 172.21.15.82:0/1320804421 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c006aa0 con 0x7fba4c0b7910 2024-05-10T04:50:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.195+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c15f3e0 con 0x7fba4c0b7910 2024-05-10T04:50:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.195+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c15f9a0 con 0x7fba4c0b7910 2024-05-10T04:50:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.196+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c074af0 con 0x7fba4c0b7910 2024-05-10T04:50:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.197+0000 7fba43400700 1 -- 172.21.15.82:0/1320804421 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba3c003680 con 0x7fba4c0b7910 2024-05-10T04:50:52.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.198+0000 7fba43400700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fba2c06ac90 0x7fba2c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.198+0000 7fba43400700 1 -- 172.21.15.82:0/1320804421 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba3c0885c0 con 0x7fba4c0b7910 2024-05-10T04:50:52.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.198+0000 7fba4aa00700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fba2c06ac90 0x7fba2c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.199+0000 7fba4aa00700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fba2c06ac90 0x7fba2c06d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fba4c1f8e80 tx=0x7fba38008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:52.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.202+0000 7fba43400700 1 -- 172.21.15.82:0/1320804421 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fba3c053700 con 0x7fba4c0b7910 2024-05-10T04:50:52.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.407+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba4c0b2d90 con 0x7fba4c0b7910 2024-05-10T04:50:52.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.407+0000 7fba43400700 1 -- 172.21.15.82:0/1320804421 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba3c056d20 con 0x7fba4c0b7910 2024-05-10T04:50:52.409 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:50:52.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.409+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fba2c06ac90 msgr2=0x7fba2c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.409+0000 7fba52800700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fba2c06ac90 0x7fba2c06d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fba4c1f8e80 tx=0x7fba38008030 comp rx=0 tx=0).stop 2024-05-10T04:50:52.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.409+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c0b7910 msgr2=0x7fba4c160180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.409+0000 7fba52800700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c0b7910 0x7fba4c160180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c430 tx=0x7fba3c00c7f0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.410+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 shutdown_connections 2024-05-10T04:50:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.410+0000 7fba52800700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fba2c06ac90 0x7fba2c06d1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.410+0000 7fba52800700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fba4c162150 0x7fba4c1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.410+0000 7fba52800700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c0b7910 0x7fba4c160180 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.410+0000 7fba52800700 1 --2- 172.21.15.82:0/1320804421 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fba4c15e610 0x7fba4c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.410+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 >> 172.21.15.82:0/1320804421 conn(0x7fba4c0d3e10 msgr2=0x7fba4c15cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.410+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 shutdown_connections 2024-05-10T04:50:52.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.410+0000 7fba52800700 1 -- 172.21.15.82:0/1320804421 wait complete. 2024-05-10T04:50:52.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:52.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.700+0000 7faa7b200700 1 Processor -- start 2024-05-10T04:50:52.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.700+0000 7faa7b200700 1 -- start start 2024-05-10T04:50:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.702+0000 7faa7b200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa7c0b2ca0 0x7faa7c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.702+0000 7faa7b200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c161e40 con 0x7faa7c15e350 2024-05-10T04:50:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.702+0000 7faa7b200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c162120 con 0x7faa7c15df40 2024-05-10T04:50:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.702+0000 7faa7b200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c162400 con 0x7faa7c0b2ca0 2024-05-10T04:50:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.702+0000 7faa79e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa7c0b2ca0 0x7faa7c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.702+0000 7faa7a800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faa7c15e350 0x7faa7c0d24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38234/0 (socket says 172.21.15.82:38234) 2024-05-10T04:50:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.702+0000 7faa79e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa7c0b2ca0 0x7faa7c0cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54422/0 (socket says 172.21.15.82:54422) 2024-05-10T04:50:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.702+0000 7faa7a800700 1 -- 172.21.15.82:0/3409849102 learned_addr learned my addr 172.21.15.82:0/3409849102 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.703+0000 7faa79e00700 1 -- 172.21.15.82:0/3409849102 >> v1:172.21.15.129:6789/0 conn(0x7faa7c15df40 legacy=0x7faa7c0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.703+0000 7faa79e00700 1 -- 172.21.15.82:0/3409849102 >> v1:172.21.15.82:6789/0 conn(0x7faa7c15e350 legacy=0x7faa7c0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.703+0000 7faa79e00700 1 -- 172.21.15.82:0/3409849102 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c1626e0 con 0x7faa7c0b2ca0 2024-05-10T04:50:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.703+0000 7faa79e00700 1 --2- 172.21.15.82:0/3409849102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c0b2ca0 0x7faa7c0cf150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009840 tx=0x7faa6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd9beff63b1b971 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.703+0000 7faa79400700 1 -- 172.21.15.82:0/3409849102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c011830 con 0x7faa7c0b2ca0 2024-05-10T04:50:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.703+0000 7faa79400700 1 -- 172.21.15.82:0/3409849102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c011990 con 0x7faa7c0b2ca0 2024-05-10T04:50:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.703+0000 7faa79400700 1 -- 172.21.15.82:0/3409849102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c011d20 con 0x7faa7c0b2ca0 2024-05-10T04:50:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.704+0000 7faa7b200700 1 -- 172.21.15.82:0/3409849102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c0b2ca0 msgr2=0x7faa7c0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.704+0000 7faa7b200700 1 --2- 172.21.15.82:0/3409849102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c0b2ca0 0x7faa7c0cf150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009840 tx=0x7faa6c009b50 comp rx=0 tx=0).stop 2024-05-10T04:50:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.704+0000 7faa7b200700 1 -- 172.21.15.82:0/3409849102 shutdown_connections 2024-05-10T04:50:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.704+0000 7faa7b200700 1 --2- 172.21.15.82:0/3409849102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c0b2ca0 0x7faa7c0cf150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.704+0000 7faa7b200700 1 -- 172.21.15.82:0/3409849102 >> 172.21.15.82:0/3409849102 conn(0x7faa7c067600 msgr2=0x7faa7c06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.704+0000 7faa7b200700 1 -- 172.21.15.82:0/3409849102 shutdown_connections 2024-05-10T04:50:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.704+0000 7faa7b200700 1 -- 172.21.15.82:0/3409849102 wait complete. 2024-05-10T04:50:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.707+0000 7faa7b200700 1 Processor -- start 2024-05-10T04:50:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.707+0000 7faa7b200700 1 -- start start 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.708+0000 7faa7b200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faa7c0b2ca0 0x7faa7c155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.708+0000 7faa7b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c15df40 0x7faa7c157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.708+0000 7faa7b200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa7c15e350 0x7faa7c1e9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.708+0000 7faa7b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c157b90 con 0x7faa7c15df40 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.708+0000 7faa7b200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c1e7d10 con 0x7faa7c15e350 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.708+0000 7faa7b200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c155a50 con 0x7faa7c0b2ca0 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.708+0000 7faa73e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c15df40 0x7faa7c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.708+0000 7faa73e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c15df40 0x7faa7c157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54424/0 (socket says 172.21.15.82:54424) 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa73e00700 1 -- 172.21.15.82:0/2284745364 learned_addr learned my addr 172.21.15.82:0/2284745364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa7a800700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa7c15e350 0x7faa7c1e9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa79e00700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faa7c0b2ca0 0x7faa7c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa73e00700 1 -- 172.21.15.82:0/2284745364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faa7c0b2ca0 msgr2=0x7faa7c155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa73e00700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faa7c0b2ca0 0x7faa7c155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa73e00700 1 -- 172.21.15.82:0/2284745364 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa7c15e350 msgr2=0x7faa7c1e9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa73e00700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa7c15e350 0x7faa7c1e9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa73e00700 1 -- 172.21.15.82:0/2284745364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c0094a0 con 0x7faa7c15df40 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa73e00700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c15df40 0x7faa7c157150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c430 tx=0x7faa6400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa72000700 1 -- 172.21.15.82:0/2284745364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640052d0 con 0x7faa7c15df40 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa72000700 1 -- 172.21.15.82:0/2284745364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64005430 con 0x7faa7c15df40 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c1e8b70 con 0x7faa7c15df40 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.709+0000 7faa72000700 1 -- 172.21.15.82:0/2284745364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640038c0 con 0x7faa7c15df40 2024-05-10T04:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.710+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c1e7fb0 con 0x7faa7c15df40 2024-05-10T04:50:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.711+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c074af0 con 0x7faa7c15df40 2024-05-10T04:50:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.712+0000 7faa72000700 1 -- 172.21.15.82:0/2284745364 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa64003a20 con 0x7faa7c15df40 2024-05-10T04:50:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.712+0000 7faa72000700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7faa5806ac90 0x7faa5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.713+0000 7faa72000700 1 -- 172.21.15.82:0/2284745364 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa640887a0 con 0x7faa7c15df40 2024-05-10T04:50:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.713+0000 7faa79e00700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7faa5806ac90 0x7faa5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.713+0000 7faa79e00700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7faa5806ac90 0x7faa5806d1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa6c000c00 tx=0x7faa6c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.717+0000 7faa72000700 1 -- 172.21.15.82:0/2284745364 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faa640538d0 con 0x7faa7c15df40 2024-05-10T04:50:52.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.919+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa7c0b28f0 con 0x7faa7c15df40 2024-05-10T04:50:52.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.920+0000 7faa72000700 1 -- 172.21.15.82:0/2284745364 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7faa64017090 con 0x7faa7c15df40 2024-05-10T04:50:52.922 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:52.922 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.922+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7faa5806ac90 msgr2=0x7faa5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.922+0000 7faa7b200700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7faa5806ac90 0x7faa5806d1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa6c000c00 tx=0x7faa6c008030 comp rx=0 tx=0).stop 2024-05-10T04:50:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.922+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c15df40 msgr2=0x7faa7c157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.922+0000 7faa7b200700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c15df40 0x7faa7c157150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c430 tx=0x7faa6400c7f0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.922+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 shutdown_connections 2024-05-10T04:50:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.922+0000 7faa7b200700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7faa5806ac90 0x7faa5806d1a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.923+0000 7faa7b200700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7faa7c15e350 0x7faa7c1e9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.923+0000 7faa7b200700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7faa7c0b2ca0 0x7faa7c155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.923+0000 7faa7b200700 1 --2- 172.21.15.82:0/2284745364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa7c15df40 0x7faa7c157150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.923+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 >> 172.21.15.82:0/2284745364 conn(0x7faa7c067600 msgr2=0x7faa7c15e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.923+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 shutdown_connections 2024-05-10T04:50:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:52.923+0000 7faa7b200700 1 -- 172.21.15.82:0/2284745364 wait complete. 2024-05-10T04:50:52.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:52.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.211+0000 7f0127a00700 1 Processor -- start 2024-05-10T04:50:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.211+0000 7f0127a00700 1 -- start start 2024-05-10T04:50:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0127a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f012015f610 0x7f012015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0127a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f0120161f80 0x7f0120162390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0127a00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01200b5b90 con 0x7f01200d05d0 2024-05-10T04:50:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0127a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01201628d0 con 0x7f012015f610 2024-05-10T04:50:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0127a00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0120162e40 con 0x7f0120161f80 2024-05-10T04:50:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0125000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f012015f610 0x7f012015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0125a00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f01200d05d0 0x7f01200d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38242/0 (socket says 172.21.15.82:38242) 2024-05-10T04:50:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0125000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f012015f610 0x7f012015bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54438/0 (socket says 172.21.15.82:54438) 2024-05-10T04:50:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.213+0000 7f0125a00700 1 -- 172.21.15.82:0/59744808 learned_addr learned my addr 172.21.15.82:0/59744808 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f011fe00700 1 --2- 172.21.15.82:0/59744808 >> v2:172.21.15.129:3300/0 conn(0x7f0120161f80 0x7f0120162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f0125000700 1 -- 172.21.15.82:0/59744808 >> v2:172.21.15.129:3300/0 conn(0x7f0120161f80 msgr2=0x7f0120162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f0125000700 1 --2- 172.21.15.82:0/59744808 >> v2:172.21.15.129:3300/0 conn(0x7f0120161f80 0x7f0120162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f0125000700 1 -- 172.21.15.82:0/59744808 >> v1:172.21.15.82:6789/0 conn(0x7f01200d05d0 legacy=0x7f01200d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f0125000700 1 -- 172.21.15.82:0/59744808 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120162b60 con 0x7f012015f610 2024-05-10T04:50:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f0125000700 1 --2- 172.21.15.82:0/59744808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f012015f610 0x7f012015bfd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f012006bd80 tx=0x7f0114009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f694252295d73289 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:53.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f011f400700 1 -- 172.21.15.82:0/59744808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114011830 con 0x7f012015f610 2024-05-10T04:50:53.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f011f400700 1 -- 172.21.15.82:0/59744808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0114011990 con 0x7f012015f610 2024-05-10T04:50:53.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.214+0000 7f011f400700 1 -- 172.21.15.82:0/59744808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114011d20 con 0x7f012015f610 2024-05-10T04:50:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.215+0000 7f0127a00700 1 -- 172.21.15.82:0/59744808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f012015f610 msgr2=0x7f012015bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.215+0000 7f0127a00700 1 --2- 172.21.15.82:0/59744808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f012015f610 0x7f012015bfd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f012006bd80 tx=0x7f0114009b20 comp rx=0 tx=0).stop 2024-05-10T04:50:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.215+0000 7f0127a00700 1 -- 172.21.15.82:0/59744808 shutdown_connections 2024-05-10T04:50:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.215+0000 7f0127a00700 1 --2- 172.21.15.82:0/59744808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f012015f610 0x7f012015bfd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.215+0000 7f0127a00700 1 --2- 172.21.15.82:0/59744808 >> v2:172.21.15.129:3300/0 conn(0x7f0120161f80 0x7f0120162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.215+0000 7f0127a00700 1 -- 172.21.15.82:0/59744808 >> 172.21.15.82:0/59744808 conn(0x7f012006c4d0 msgr2=0x7f012006c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.215+0000 7f0127a00700 1 -- 172.21.15.82:0/59744808 shutdown_connections 2024-05-10T04:50:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.215+0000 7f0127a00700 1 -- 172.21.15.82:0/59744808 wait complete. 2024-05-10T04:50:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.218+0000 7f0127a00700 1 Processor -- start 2024-05-10T04:50:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.218+0000 7f0127a00700 1 -- start start 2024-05-10T04:50:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0127a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01200d05d0 0x7f012015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0127a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f012015f610 0x7f012015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0127a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0120161f80 0x7f01201593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0127a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012015a540 con 0x7f01200d05d0 2024-05-10T04:50:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0127a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200ca5d0 con 0x7f0120161f80 2024-05-10T04:50:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0127a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01200ca820 con 0x7f012015f610 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0125000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01200d05d0 0x7f012015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0125000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01200d05d0 0x7f012015a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54446/0 (socket says 172.21.15.82:54446) 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.220+0000 7f0125000700 1 -- 172.21.15.82:0/4252464512 learned_addr learned my addr 172.21.15.82:0/4252464512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f0125000700 1 -- 172.21.15.82:0/4252464512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f012015f610 msgr2=0x7f012015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f0125000700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f012015f610 0x7f012015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f0125000700 1 -- 172.21.15.82:0/4252464512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0120161f80 msgr2=0x7f01201593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f0125000700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0120161f80 0x7f01201593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f0125000700 1 -- 172.21.15.82:0/4252464512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140094a0 con 0x7f01200d05d0 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f0125000700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01200d05d0 0x7f012015a970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0114009b60 tx=0x7f0114004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f011cc00700 1 -- 172.21.15.82:0/4252464512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01140036a0 con 0x7f01200d05d0 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f011cc00700 1 -- 172.21.15.82:0/4252464512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011401e070 con 0x7f01200d05d0 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01201e9730 con 0x7f01200d05d0 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f011cc00700 1 -- 172.21.15.82:0/4252464512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114003a60 con 0x7f01200d05d0 2024-05-10T04:50:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.221+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01201e8c70 con 0x7f01200d05d0 2024-05-10T04:50:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.222+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01200d1be0 con 0x7f01200d05d0 2024-05-10T04:50:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.223+0000 7f011cc00700 1 -- 172.21.15.82:0/4252464512 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0114003bc0 con 0x7f01200d05d0 2024-05-10T04:50:53.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.224+0000 7f011cc00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f010006ac90 0x7f010006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.224+0000 7f011cc00700 1 -- 172.21.15.82:0/4252464512 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f011408a450 con 0x7f01200d05d0 2024-05-10T04:50:53.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.225+0000 7f011fe00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f010006ac90 0x7f010006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.225+0000 7f011fe00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f010006ac90 0x7f010006d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01200d35f0 tx=0x7f010c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.229+0000 7f011cc00700 1 -- 172.21.15.82:0/4252464512 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0114055620 con 0x7f01200d05d0 2024-05-10T04:50:53.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.431+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0120074af0 con 0x7f01200d05d0 2024-05-10T04:50:53.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.431+0000 7f011cc00700 1 -- 172.21.15.82:0/4252464512 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0114020020 con 0x7f01200d05d0 2024-05-10T04:50:53.433 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:53.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f010006ac90 msgr2=0x7f010006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f010006ac90 0x7f010006d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01200d35f0 tx=0x7f010c008040 comp rx=0 tx=0).stop 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01200d05d0 msgr2=0x7f012015a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01200d05d0 0x7f012015a970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0114009b60 tx=0x7f0114004750 comp rx=0 tx=0).stop 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 shutdown_connections 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f010006ac90 0x7f010006d1a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0120161f80 0x7f01201593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01200d05d0 0x7f012015a970 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 --2- 172.21.15.82:0/4252464512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f012015f610 0x7f012015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 >> 172.21.15.82:0/4252464512 conn(0x7f012006c4d0 msgr2=0x7f012015dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 shutdown_connections 2024-05-10T04:50:53.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.434+0000 7f0127a00700 1 -- 172.21.15.82:0/4252464512 wait complete. 2024-05-10T04:50:53.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:50:53.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.725+0000 7fcc0dc00700 1 Processor -- start 2024-05-10T04:50:53.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.726+0000 7fcc0dc00700 1 -- start start 2024-05-10T04:50:53.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.727+0000 7fcc0dc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc08162150 0x7fcc0815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.727+0000 7fcc0dc00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc080d2c00 con 0x7fcc0806c160 2024-05-10T04:50:53.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.727+0000 7fcc0dc00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc08162630 con 0x7fcc080cf4d0 2024-05-10T04:50:53.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.727+0000 7fcc0dc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08162910 con 0x7fcc08162150 2024-05-10T04:50:53.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc07400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcc0806c160 0x7fcc0806c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38258/0 (socket says 172.21.15.82:38258) 2024-05-10T04:50:53.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc07400700 1 -- 172.21.15.82:0/1536262979 learned_addr learned my addr 172.21.15.82:0/1536262979 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06a00700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc08162150 0x7fcc0815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633949595 0 0) 0x7fcc080d2c00 con 0x7fcc0806c160 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbec0035b0 con 0x7fcc0806c160 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353143615 0 0) 0x7fcbec0035b0 con 0x7fcc0806c160 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc08162150 msgr2=0x7fcc0815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc08162150 0x7fcc0815e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 >> v1:172.21.15.129:6789/0 conn(0x7fcc080cf4d0 legacy=0x7fcc080b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08162bf0 con 0x7fcc0806c160 2024-05-10T04:50:53.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fcc000019f0 con 0x7fcc0806c160 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 >> v1:172.21.15.82:6789/0 conn(0x7fcc0806c160 legacy=0x7fcc0806c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.728+0000 7fcc06000700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbec003a30 0x7fcbec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcc06000700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec004850 0x7fcbec004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcc06000700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc08162150 0x7fcbec005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08162910 con 0x7fcbec004850 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec00bbd0 con 0x7fcbec003a30 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec00bd90 con 0x7fcc08162150 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcbffe00700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec004850 0x7fcbec004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcc06a00700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbec003a30 0x7fcbec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcc07400700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc08162150 0x7fcbec005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcbffe00700 1 -- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc08162150 msgr2=0x7fcbec005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcbffe00700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc08162150 0x7fcbec005320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcbffe00700 1 -- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbec003a30 msgr2=0x7fcbec003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcbffe00700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcbec003a30 0x7fcbec003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcbffe00700 1 -- 172.21.15.82:0/1536262979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0035b0 con 0x7fcbec004850 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.729+0000 7fcbffe00700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec004850 0x7fcbec004c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00017c0 tx=0x7fcbec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee27448fef73480c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00052d0 con 0x7fcbec004850 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0005430 con 0x7fcbec004850 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc06000700 1 -- 172.21.15.82:0/1536262979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00038c0 con 0x7fcbec004850 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc0dc00700 1 -- 172.21.15.82:0/1536262979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec004850 msgr2=0x7fcbec004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc0dc00700 1 --2- 172.21.15.82:0/1536262979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec004850 0x7fcbec004c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00017c0 tx=0x7fcbec005880 comp rx=0 tx=0).stop 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc07400700 1 -- 172.21.15.82:0/1536262979 reap_dead start 2024-05-10T04:50:53.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc0dc00700 1 -- 172.21.15.82:0/1536262979 shutdown_connections 2024-05-10T04:50:53.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc0dc00700 1 -- 172.21.15.82:0/1536262979 >> 172.21.15.82:0/1536262979 conn(0x7fcc080d3e10 msgr2=0x7fcc080d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:53.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc0dc00700 1 -- 172.21.15.82:0/1536262979 shutdown_connections 2024-05-10T04:50:53.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.730+0000 7fcc0dc00700 1 -- 172.21.15.82:0/1536262979 wait complete. 2024-05-10T04:50:53.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.733+0000 7fcc0dc00700 1 Processor -- start 2024-05-10T04:50:53.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.733+0000 7fcc0dc00700 1 -- start start 2024-05-10T04:50:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.734+0000 7fcc0dc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbec004850 0x7fcc0814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.734+0000 7fcc0dc00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc080c8160 0x7fcc080c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.734+0000 7fcc0dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc080cba90 0x7fcc080cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.734+0000 7fcc0dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080c9d70 con 0x7fcc080cba90 2024-05-10T04:50:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.734+0000 7fcc0dc00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080cb4d0 con 0x7fcc080c8160 2024-05-10T04:50:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.734+0000 7fcc0dc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080c8c70 con 0x7fcbec004850 2024-05-10T04:50:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc080cba90 0x7fcc080cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc080cba90 0x7fcc080cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54462/0 (socket says 172.21.15.82:54462) 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 -- 172.21.15.82:0/3581022061 learned_addr learned my addr 172.21.15.82:0/3581022061 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc06a00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbec004850 0x7fcc0814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcbffe00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc080c8160 0x7fcc080c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 -- 172.21.15.82:0/3581022061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbec004850 msgr2=0x7fcc0814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbec004850 0x7fcc0814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 -- 172.21.15.82:0/3581022061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc080c8160 msgr2=0x7fcc080c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc080c8160 0x7fcc080c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 -- 172.21.15.82:0/3581022061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080cc3e0 con 0x7fcc080cba90 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcc07400700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc080cba90 0x7fcc080cbea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc080d18b0 tx=0x7fcc00007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.735+0000 7fcbfea00700 1 -- 172.21.15.82:0/3581022061 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00017070 con 0x7fcc080cba90 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.736+0000 7fcbfea00700 1 -- 172.21.15.82:0/3581022061 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0000ed10 con 0x7fcc080cba90 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.736+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc080c8ec0 con 0x7fcc080cba90 2024-05-10T04:50:53.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.736+0000 7fcbfea00700 1 -- 172.21.15.82:0/3581022061 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0000eec0 con 0x7fcc080cba90 2024-05-10T04:50:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.736+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc080c96b0 con 0x7fcc080cba90 2024-05-10T04:50:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.737+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc08074af0 con 0x7fcc080cba90 2024-05-10T04:50:53.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.738+0000 7fcbfea00700 1 -- 172.21.15.82:0/3581022061 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc00013420 con 0x7fcc080cba90 2024-05-10T04:50:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.739+0000 7fcbfea00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbe406ac90 0x7fcbe406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.739+0000 7fcbfea00700 1 -- 172.21.15.82:0/3581022061 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc00089210 con 0x7fcc080cba90 2024-05-10T04:50:53.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.739+0000 7fcc06a00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbe406ac90 0x7fcbe406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:53.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.740+0000 7fcc06a00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbe406ac90 0x7fcbe406d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc080d1920 tx=0x7fcbf8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:53.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.743+0000 7fcbfea00700 1 -- 172.21.15.82:0/3581022061 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcc00054380 con 0x7fcc080cba90 2024-05-10T04:50:53.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.944+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc080cb310 con 0x7fcc080cba90 2024-05-10T04:50:53.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.945+0000 7fcbfea00700 1 -- 172.21.15.82:0/3581022061 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc080cb310 con 0x7fcc080cba90 2024-05-10T04:50:53.947 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:50:53.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbe406ac90 msgr2=0x7fcbe406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbe406ac90 0x7fcbe406d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc080d1920 tx=0x7fcbf8008040 comp rx=0 tx=0).stop 2024-05-10T04:50:53.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc080cba90 msgr2=0x7fcc080cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:53.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc080cba90 0x7fcc080cbea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc080d18b0 tx=0x7fcc00007c90 comp rx=0 tx=0).stop 2024-05-10T04:50:53.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 shutdown_connections 2024-05-10T04:50:53.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbe406ac90 0x7fcbe406d1a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc080cba90 0x7fcc080cbea0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcbec004850 0x7fcc0814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 --2- 172.21.15.82:0/3581022061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc080c8160 0x7fcc080c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:53.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.947+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 >> 172.21.15.82:0/3581022061 conn(0x7fcc080d3e10 msgr2=0x7fcc080b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:53.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.948+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 shutdown_connections 2024-05-10T04:50:53.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:53.948+0000 7fcc0dc00700 1 -- 172.21.15.82:0/3581022061 wait complete. 2024-05-10T04:50:53.974 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:50:54.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.240+0000 7f08b1c00700 1 Processor -- start 2024-05-10T04:50:54.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.240+0000 7f08b1c00700 1 -- start start 2024-05-10T04:50:54.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08b1c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f08ac162150 0x7f08ac15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08b1c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08ac0cf4d0 0x7f08ac0b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08b1c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ac0d2c00 con 0x7f08ac0b7910 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08b1c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac162630 con 0x7f08ac0cf4d0 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08b1c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac162910 con 0x7f08ac162150 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08aa000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08ac0cf4d0 0x7f08ac0b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08aa000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08ac0cf4d0 0x7f08ac0b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54464/0 (socket says 172.21.15.82:54464) 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08aa000700 1 -- 172.21.15.82:0/3460418254 learned_addr learned my addr 172.21.15.82:0/3460418254 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08aaa00700 1 --2- 172.21.15.82:0/3460418254 >> v2:172.21.15.129:3300/0 conn(0x7f08ac162150 0x7f08ac15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08aa000700 1 -- 172.21.15.82:0/3460418254 >> v2:172.21.15.129:3300/0 conn(0x7f08ac162150 msgr2=0x7f08ac15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08aa000700 1 --2- 172.21.15.82:0/3460418254 >> v2:172.21.15.129:3300/0 conn(0x7f08ac162150 0x7f08ac15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.242+0000 7f08aa000700 1 -- 172.21.15.82:0/3460418254 >> v1:172.21.15.129:6789/0 conn(0x7f08ac0b7910 legacy=0x7f08ac06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.243+0000 7f08aa000700 1 -- 172.21.15.82:0/3460418254 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac162bf0 con 0x7f08ac0cf4d0 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.243+0000 7f08aaa00700 1 --2- 172.21.15.82:0/3460418254 >> v2:172.21.15.129:3300/0 conn(0x7f08ac162150 0x7f08ac15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.243+0000 7f08aa000700 1 --2- 172.21.15.82:0/3460418254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac0cf4d0 0x7f08ac0b73d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08980098f0 tx=0x7f0898009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fdaf242bf6b38 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:54.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.243+0000 7f08a9600700 1 -- 172.21.15.82:0/3460418254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0898004230 con 0x7f08ac0cf4d0 2024-05-10T04:50:54.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.243+0000 7f08a9600700 1 -- 172.21.15.82:0/3460418254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0898004390 con 0x7f08ac0cf4d0 2024-05-10T04:50:54.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.243+0000 7f08a9600700 1 -- 172.21.15.82:0/3460418254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08980036a0 con 0x7f08ac0cf4d0 2024-05-10T04:50:54.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.244+0000 7f08b1c00700 1 -- 172.21.15.82:0/3460418254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac0cf4d0 msgr2=0x7f08ac0b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.244+0000 7f08b1c00700 1 --2- 172.21.15.82:0/3460418254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac0cf4d0 0x7f08ac0b73d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08980098f0 tx=0x7f0898009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:54.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.244+0000 7f08b1c00700 1 -- 172.21.15.82:0/3460418254 shutdown_connections 2024-05-10T04:50:54.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.244+0000 7f08b1c00700 1 --2- 172.21.15.82:0/3460418254 >> v2:172.21.15.129:3300/0 conn(0x7f08ac162150 0x7f08ac15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.244+0000 7f08b1c00700 1 --2- 172.21.15.82:0/3460418254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac0cf4d0 0x7f08ac0b73d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.244+0000 7f08b1c00700 1 -- 172.21.15.82:0/3460418254 >> 172.21.15.82:0/3460418254 conn(0x7f08ac0d3e10 msgr2=0x7f08ac0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:54.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.244+0000 7f08b1c00700 1 -- 172.21.15.82:0/3460418254 shutdown_connections 2024-05-10T04:50:54.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.244+0000 7f08b1c00700 1 -- 172.21.15.82:0/3460418254 wait complete. 2024-05-10T04:50:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.246+0000 7f08b1c00700 1 Processor -- start 2024-05-10T04:50:54.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.246+0000 7f08b1c00700 1 -- start start 2024-05-10T04:50:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08b1c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f08ac0b7910 0x7f08ac0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08b1c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08ac0cf4d0 0x7f08ac1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08b1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac162150 0x7f08ac0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08b1c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1f6ef0 con 0x7f08ac162150 2024-05-10T04:50:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08b1c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0cc640 con 0x7f08ac0cf4d0 2024-05-10T04:50:54.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08b1c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0c9b30 con 0x7f08ac0b7910 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08ab400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac162150 0x7f08ac0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08ab400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac162150 0x7f08ac0cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54478/0 (socket says 172.21.15.82:54478) 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08ab400700 1 -- 172.21.15.82:0/1023122120 learned_addr learned my addr 172.21.15.82:0/1023122120 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08aaa00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f08ac0b7910 0x7f08ac0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.248+0000 7f08aa000700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08ac0cf4d0 0x7f08ac1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08ab400700 1 -- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f08ac0b7910 msgr2=0x7f08ac0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08ab400700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f08ac0b7910 0x7f08ac0cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08ab400700 1 -- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08ac0cf4d0 msgr2=0x7f08ac1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08ab400700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08ac0cf4d0 0x7f08ac1587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08ab400700 1 -- 172.21.15.82:0/1023122120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0898009550 con 0x7f08ac162150 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08aa000700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08ac0cf4d0 0x7f08ac1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08ab400700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac162150 0x7f08ac0cbb20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f08a400b9a0 tx=0x7f08a400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08a2a00700 1 -- 172.21.15.82:0/1023122120 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a400c930 con 0x7f08ac162150 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08a2a00700 1 -- 172.21.15.82:0/1023122120 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a400ca90 con 0x7f08ac162150 2024-05-10T04:50:54.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08a2a00700 1 -- 172.21.15.82:0/1023122120 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a400ce40 con 0x7f08ac162150 2024-05-10T04:50:54.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac0c9da0 con 0x7f08ac162150 2024-05-10T04:50:54.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.249+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac0ca360 con 0x7f08ac162150 2024-05-10T04:50:54.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.250+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac074af0 con 0x7f08ac162150 2024-05-10T04:50:54.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.251+0000 7f08a2a00700 1 -- 172.21.15.82:0/1023122120 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08a401d3b0 con 0x7f08ac162150 2024-05-10T04:50:54.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.253+0000 7f08a2a00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f088c06ac90 0x7f088c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.253+0000 7f08a2a00700 1 -- 172.21.15.82:0/1023122120 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08a4088f70 con 0x7f08ac162150 2024-05-10T04:50:54.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.253+0000 7f08aaa00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f088c06ac90 0x7f088c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.254+0000 7f08aaa00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f088c06ac90 0x7f088c06d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0d1920 tx=0x7f089c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:54.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.258+0000 7f08a2a00700 1 -- 172.21.15.82:0/1023122120 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f08a40bc900 con 0x7f08ac162150 2024-05-10T04:50:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.461+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08ac161ec0 con 0x7f08ac162150 2024-05-10T04:50:54.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.462+0000 7f08a2a00700 1 -- 172.21.15.82:0/1023122120 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08a40190a0 con 0x7f08ac162150 2024-05-10T04:50:54.463 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f088c06ac90 msgr2=0x7f088c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f088c06ac90 0x7f088c06d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0d1920 tx=0x7f089c008040 comp rx=0 tx=0).stop 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac162150 msgr2=0x7f08ac0cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac162150 0x7f08ac0cbb20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f08a400b9a0 tx=0x7f08a400bcb0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 shutdown_connections 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f088c06ac90 0x7f088c06d1a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08ac162150 0x7f08ac0cbb20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f08ac0b7910 0x7f08ac0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 --2- 172.21.15.82:0/1023122120 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f08ac0cf4d0 0x7f08ac1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 >> 172.21.15.82:0/1023122120 conn(0x7f08ac0d3e10 msgr2=0x7f08ac0b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 shutdown_connections 2024-05-10T04:50:54.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.464+0000 7f08b1c00700 1 -- 172.21.15.82:0/1023122120 wait complete. 2024-05-10T04:50:54.490 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:54.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.751+0000 7f14d8600700 1 Processor -- start 2024-05-10T04:50:54.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.751+0000 7f14d8600700 1 -- start start 2024-05-10T04:50:54.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.752+0000 7f14d8600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f14d00cf800 0x7f14d015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.752+0000 7f14d8600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d01620a0 con 0x7f14d00b6090 2024-05-10T04:50:54.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14d8600700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d0162c20 con 0x7f14d00b2b90 2024-05-10T04:50:54.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14d8600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d015e9f0 con 0x7f14d00cf800 2024-05-10T04:50:54.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14d5200700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f14d00b6090 0x7f14d00d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38272/0 (socket says 172.21.15.82:38272) 2024-05-10T04:50:54.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14d5200700 1 -- 172.21.15.82:0/199977332 learned_addr learned my addr 172.21.15.82:0/199977332 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:54.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14d6600700 1 --2- 172.21.15.82:0/199977332 >> v2:172.21.15.82:3300/0 conn(0x7f14d00cf800 0x7f14d015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14cfe00700 1 -- 172.21.15.82:0/199977332 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289952430 0 0) 0x7f14d01620a0 con 0x7f14d00b6090 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14cfe00700 1 -- 172.21.15.82:0/199977332 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b80035b0 con 0x7f14d00b6090 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14d6600700 1 -- 172.21.15.82:0/199977332 >> v1:172.21.15.129:6789/0 conn(0x7f14d00b2b90 legacy=0x7f14d00b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14d6600700 1 -- 172.21.15.82:0/199977332 >> v1:172.21.15.82:6789/0 conn(0x7f14d00b6090 legacy=0x7f14d00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.753+0000 7f14d6600700 1 -- 172.21.15.82:0/199977332 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d01622f0 con 0x7f14d00cf800 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.754+0000 7f14d6600700 1 --2- 172.21.15.82:0/199977332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d00cf800 0x7f14d015e4b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009d90 tx=0x7f14c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e8fdfc71546532 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.754+0000 7f14cfe00700 1 -- 172.21.15.82:0/199977332 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800e070 con 0x7f14d00cf800 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.754+0000 7f14cfe00700 1 -- 172.21.15.82:0/199977332 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800bb20 con 0x7f14d00cf800 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.754+0000 7f14cfe00700 1 -- 172.21.15.82:0/199977332 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8012430 con 0x7f14d00cf800 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.754+0000 7f14d8600700 1 -- 172.21.15.82:0/199977332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d00cf800 msgr2=0x7f14d015e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.754+0000 7f14d8600700 1 --2- 172.21.15.82:0/199977332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d00cf800 0x7f14d015e4b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009d90 tx=0x7f14c800b330 comp rx=0 tx=0).stop 2024-05-10T04:50:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.755+0000 7f14d8600700 1 -- 172.21.15.82:0/199977332 shutdown_connections 2024-05-10T04:50:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.755+0000 7f14d8600700 1 --2- 172.21.15.82:0/199977332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d00cf800 0x7f14d015e4b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.755+0000 7f14d8600700 1 -- 172.21.15.82:0/199977332 >> 172.21.15.82:0/199977332 conn(0x7f14d00d0b60 msgr2=0x7f14d00d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.755+0000 7f14d8600700 1 -- 172.21.15.82:0/199977332 shutdown_connections 2024-05-10T04:50:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.755+0000 7f14d8600700 1 -- 172.21.15.82:0/199977332 wait complete. 2024-05-10T04:50:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.757+0000 7f14d8600700 1 Processor -- start 2024-05-10T04:50:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.757+0000 7f14d8600700 1 -- start start 2024-05-10T04:50:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.758+0000 7f14d8600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14d00b2b90 0x7f14d01523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.758+0000 7f14d8600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f14d00cf800 0x7f14d0158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d8600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d0154030 0x7f14d015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d8600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d0152910 con 0x7f14d0154030 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d8600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d01f4f80 con 0x7f14d00b2b90 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d8600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d0154480 con 0x7f14d00cf800 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d0154030 0x7f14d015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d0154030 0x7f14d015a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54482/0 (socket says 172.21.15.82:54482) 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d6600700 1 -- 172.21.15.82:0/1860477795 learned_addr learned my addr 172.21.15.82:0/1860477795 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d5c00700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14d00b2b90 0x7f14d01523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d5200700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f14d00cf800 0x7f14d0158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d6600700 1 -- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f14d00cf800 msgr2=0x7f14d0158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d6600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f14d00cf800 0x7f14d0158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d6600700 1 -- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14d00b2b90 msgr2=0x7f14d01523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d6600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14d00b2b90 0x7f14d01523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d6600700 1 -- 172.21.15.82:0/1860477795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8009a70 con 0x7f14d0154030 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.759+0000 7f14d5200700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f14d00cf800 0x7f14d0158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.760+0000 7f14d6600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d0154030 0x7f14d015a710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f14c8013000 tx=0x7f14c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:54.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.760+0000 7f14cd600700 1 -- 172.21.15.82:0/1860477795 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8012430 con 0x7f14d0154030 2024-05-10T04:50:54.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.760+0000 7f14cd600700 1 -- 172.21.15.82:0/1860477795 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8020070 con 0x7f14d0154030 2024-05-10T04:50:54.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.760+0000 7f14cd600700 1 -- 172.21.15.82:0/1860477795 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8004280 con 0x7f14d0154030 2024-05-10T04:50:54.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.760+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d0159500 con 0x7f14d0154030 2024-05-10T04:50:54.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.760+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d01552e0 con 0x7f14d0154030 2024-05-10T04:50:54.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.761+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d00732b0 con 0x7f14d0154030 2024-05-10T04:50:54.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.762+0000 7f14cd600700 1 -- 172.21.15.82:0/1860477795 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f14c80043e0 con 0x7f14d0154030 2024-05-10T04:50:54.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.763+0000 7f14cd600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14b006ac90 0x7f14b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:54.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.763+0000 7f14cd600700 1 -- 172.21.15.82:0/1860477795 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14c8022070 con 0x7f14d0154030 2024-05-10T04:50:54.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.763+0000 7f14d5c00700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14b006ac90 0x7f14b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:54.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.764+0000 7f14d5c00700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14b006ac90 0x7f14b006d1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f14c4007fd0 tx=0x7f14c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.768+0000 7f14cd600700 1 -- 172.21.15.82:0/1860477795 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f14c80560a0 con 0x7f14d0154030 2024-05-10T04:50:54.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.977+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14d0159500 con 0x7f14d0154030 2024-05-10T04:50:54.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.978+0000 7f14cd600700 1 -- 172.21.15.82:0/1860477795 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f14d0159500 con 0x7f14d0154030 2024-05-10T04:50:54.980 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:54.980 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:54.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14b006ac90 msgr2=0x7f14b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14b006ac90 0x7f14b006d1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f14c4007fd0 tx=0x7f14c4009040 comp rx=0 tx=0).stop 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d0154030 msgr2=0x7f14d015a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d0154030 0x7f14d015a710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f14c8013000 tx=0x7f14c8004ad0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 shutdown_connections 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14b006ac90 0x7f14b006d1a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14d0154030 0x7f14d015a710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f14d00b2b90 0x7f14d01523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 --2- 172.21.15.82:0/1860477795 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f14d00cf800 0x7f14d0158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 >> 172.21.15.82:0/1860477795 conn(0x7f14d00d0b60 msgr2=0x7f14d015bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 shutdown_connections 2024-05-10T04:50:54.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:54.981+0000 7f14d8600700 1 -- 172.21.15.82:0/1860477795 wait complete. 2024-05-10T04:50:55.007 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:55.008 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:55.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.271+0000 7f0f72600700 1 Processor -- start 2024-05-10T04:50:55.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.271+0000 7f0f72600700 1 -- start start 2024-05-10T04:50:55.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f72600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f6c15e790 0x7f0f6c15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f72600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c0d2590 con 0x7f0f6c15beb0 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f72600700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c15f730 con 0x7f0f6c06c1a0 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f72600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c0cec30 con 0x7f0f6c15e790 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f71200700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0f6c15beb0 0x7f0f6c15f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38278/0 (socket says 172.21.15.82:38278) 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f71200700 1 -- 172.21.15.82:0/3387457711 learned_addr learned my addr 172.21.15.82:0/3387457711 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f71c00700 1 --2- 172.21.15.82:0/3387457711 >> v2:172.21.15.82:3300/0 conn(0x7f0f6c15e790 0x7f0f6c15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f71c00700 1 -- 172.21.15.82:0/3387457711 >> v1:172.21.15.129:6789/0 conn(0x7f0f6c06c1a0 legacy=0x7f0f6c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f71c00700 1 -- 172.21.15.82:0/3387457711 >> v1:172.21.15.82:6789/0 conn(0x7f0f6c15beb0 legacy=0x7f0f6c15f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.273+0000 7f0f71c00700 1 -- 172.21.15.82:0/3387457711 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c15f450 con 0x7f0f6c15e790 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.274+0000 7f0f71c00700 1 --2- 172.21.15.82:0/3387457711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c15eba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009d90 tx=0x7f0f6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fac24c9fecad3b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.274+0000 7f0f6b400700 1 -- 172.21.15.82:0/3387457711 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400e070 con 0x7f0f6c15e790 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.274+0000 7f0f6b400700 1 -- 172.21.15.82:0/3387457711 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400bbd0 con 0x7f0f6c15e790 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.274+0000 7f0f6b400700 1 -- 172.21.15.82:0/3387457711 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64012430 con 0x7f0f6c15e790 2024-05-10T04:50:55.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.275+0000 7f0f72600700 1 -- 172.21.15.82:0/3387457711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 msgr2=0x7f0f6c15eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.275+0000 7f0f72600700 1 --2- 172.21.15.82:0/3387457711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c15eba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009d90 tx=0x7f0f6400b330 comp rx=0 tx=0).stop 2024-05-10T04:50:55.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.275+0000 7f0f72600700 1 -- 172.21.15.82:0/3387457711 shutdown_connections 2024-05-10T04:50:55.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.275+0000 7f0f72600700 1 --2- 172.21.15.82:0/3387457711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c15eba0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.275+0000 7f0f72600700 1 -- 172.21.15.82:0/3387457711 >> 172.21.15.82:0/3387457711 conn(0x7f0f6c0d3be0 msgr2=0x7f0f6c0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:55.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.275+0000 7f0f72600700 1 -- 172.21.15.82:0/3387457711 shutdown_connections 2024-05-10T04:50:55.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.275+0000 7f0f72600700 1 -- 172.21.15.82:0/3387457711 wait complete. 2024-05-10T04:50:55.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.277+0000 7f0f72600700 1 Processor -- start 2024-05-10T04:50:55.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.277+0000 7f0f72600700 1 -- start start 2024-05-10T04:50:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f72600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f6c06c1a0 0x7f0f6c0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f72600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f6c15beb0 0x7f0f6c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f72600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f72600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1f4950 con 0x7f0f6c15e790 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f72600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c155900 con 0x7f0f6c15beb0 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f72600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0b5160 con 0x7f0f6c06c1a0 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f71c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f71c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c0cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54510/0 (socket says 172.21.15.82:54510) 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f71c00700 1 -- 172.21.15.82:0/2356567327 learned_addr learned my addr 172.21.15.82:0/2356567327 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f71200700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f6c06c1a0 0x7f0f6c0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.279+0000 7f0f6be00700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f6c15beb0 0x7f0f6c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f71c00700 1 -- 172.21.15.82:0/2356567327 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f6c06c1a0 msgr2=0x7f0f6c0b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f71c00700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f6c06c1a0 0x7f0f6c0b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f71c00700 1 -- 172.21.15.82:0/2356567327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f6c15beb0 msgr2=0x7f0f6c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f71c00700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f6c15beb0 0x7f0f6c0cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f71c00700 1 -- 172.21.15.82:0/2356567327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009a70 con 0x7f0f6c15e790 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f71c00700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c0cca40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c067ae0 tx=0x7f0f64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f68c00700 1 -- 172.21.15.82:0/2356567327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640098f0 con 0x7f0f6c15e790 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f68c00700 1 -- 172.21.15.82:0/2356567327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f64020070 con 0x7f0f6c15e790 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c0b3670 con 0x7f0f6c15e790 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f68c00700 1 -- 172.21.15.82:0/2356567327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64004280 con 0x7f0f6c15e790 2024-05-10T04:50:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.280+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c0b3c30 con 0x7f0f6c15e790 2024-05-10T04:50:55.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.281+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c0b52a0 con 0x7f0f6c15e790 2024-05-10T04:50:55.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.282+0000 7f0f68c00700 1 -- 172.21.15.82:0/2356567327 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f640043e0 con 0x7f0f6c15e790 2024-05-10T04:50:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.284+0000 7f0f68c00700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0f4c06ac90 0x7f0f4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.284+0000 7f0f68c00700 1 -- 172.21.15.82:0/2356567327 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f64022070 con 0x7f0f6c15e790 2024-05-10T04:50:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.284+0000 7f0f71200700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0f4c06ac90 0x7f0f4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.284+0000 7f0f71200700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0f4c06ac90 0x7f0f4c06d1a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f60005910 tx=0x7f0f60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:55.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.288+0000 7f0f68c00700 1 -- 172.21.15.82:0/2356567327 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0f6c0b52a0 con 0x7f0f6c15e790 2024-05-10T04:50:55.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.492+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f6c0b52a0 con 0x7f0f6c15e790 2024-05-10T04:50:55.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.493+0000 7f0f68c00700 1 -- 172.21.15.82:0/2356567327 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f6c0b52a0 con 0x7f0f6c15e790 2024-05-10T04:50:55.495 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:55.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0f4c06ac90 msgr2=0x7f0f4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0f4c06ac90 0x7f0f4c06d1a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f60005910 tx=0x7f0f60009040 comp rx=0 tx=0).stop 2024-05-10T04:50:55.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 msgr2=0x7f0f6c0cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c0cca40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c067ae0 tx=0x7f0f64004ad0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 shutdown_connections 2024-05-10T04:50:55.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0f4c06ac90 0x7f0f4c06d1a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c15e790 0x7f0f6c0cca40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0f6c06c1a0 0x7f0f6c0b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 --2- 172.21.15.82:0/2356567327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f6c15beb0 0x7f0f6c0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.495+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 >> 172.21.15.82:0/2356567327 conn(0x7f0f6c0d3be0 msgr2=0x7f0f6c0b90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:55.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.496+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 shutdown_connections 2024-05-10T04:50:55.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.496+0000 7f0f72600700 1 -- 172.21.15.82:0/2356567327 wait complete. 2024-05-10T04:50:55.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:50:55.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.793+0000 7f720f200700 1 Processor -- start 2024-05-10T04:50:55.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.793+0000 7f720f200700 1 -- start start 2024-05-10T04:50:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f720f200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f720815e610 0x7f72080b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f720f200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f72080b7910 0x7f720806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f720f200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72080d2c00 con 0x7f7208162150 2024-05-10T04:50:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f720f200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720815ea20 con 0x7f720815e610 2024-05-10T04:50:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f720f200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7208162630 con 0x7f72080b7910 2024-05-10T04:50:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f720d200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f72080b7910 0x7f720806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f7207400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f720815e610 0x7f72080b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f720d200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f72080b7910 0x7f720806c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:33234/0 (socket says 172.21.15.82:33234) 2024-05-10T04:50:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f7207e00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f7208162150 0x7f72080cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:44388/0 (socket says 172.21.15.82:44388) 2024-05-10T04:50:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f7207400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f720815e610 0x7f72080b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:51480/0 (socket says 172.21.15.82:51480) 2024-05-10T04:50:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.795+0000 7f720d200700 1 -- 172.21.15.82:0/2448692366 learned_addr learned my addr 172.21.15.82:0/2448692366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f7206a00700 1 -- 172.21.15.82:0/2448692366 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148841871 0 0) 0x7f72080d2c00 con 0x7f7208162150 2024-05-10T04:50:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f7206a00700 1 -- 172.21.15.82:0/2448692366 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ec0035b0 con 0x7f7208162150 2024-05-10T04:50:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f720d200700 1 -- 172.21.15.82:0/2448692366 >> v2:172.21.15.129:3300/0 conn(0x7f720815e610 msgr2=0x7f72080b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f720d200700 1 --2- 172.21.15.82:0/2448692366 >> v2:172.21.15.129:3300/0 conn(0x7f720815e610 0x7f72080b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f720d200700 1 -- 172.21.15.82:0/2448692366 >> v1:172.21.15.129:6789/0 conn(0x7f7208162150 legacy=0x7f72080cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f720d200700 1 -- 172.21.15.82:0/2448692366 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208162910 con 0x7f72080b7910 2024-05-10T04:50:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f7207400700 1 --2- 172.21.15.82:0/2448692366 >> v2:172.21.15.129:3300/0 conn(0x7f720815e610 0x7f72080b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:50:55.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f720d200700 1 --2- 172.21.15.82:0/2448692366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f72080b7910 0x7f720806c160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7200009e50 tx=0x7f720000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1724a09beec69a7c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:55.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.796+0000 7f7206a00700 1 -- 172.21.15.82:0/2448692366 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000e070 con 0x7f72080b7910 2024-05-10T04:50:55.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f7206a00700 1 -- 172.21.15.82:0/2448692366 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720000b910 con 0x7f72080b7910 2024-05-10T04:50:55.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f7206a00700 1 -- 172.21.15.82:0/2448692366 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000bcc0 con 0x7f72080b7910 2024-05-10T04:50:55.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f720f200700 1 -- 172.21.15.82:0/2448692366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f72080b7910 msgr2=0x7f720806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f720f200700 1 --2- 172.21.15.82:0/2448692366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f72080b7910 0x7f720806c160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7200009e50 tx=0x7f720000b330 comp rx=0 tx=0).stop 2024-05-10T04:50:55.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f720f200700 1 -- 172.21.15.82:0/2448692366 shutdown_connections 2024-05-10T04:50:55.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f720f200700 1 --2- 172.21.15.82:0/2448692366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f72080b7910 0x7f720806c160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f720f200700 1 --2- 172.21.15.82:0/2448692366 >> v2:172.21.15.129:3300/0 conn(0x7f720815e610 0x7f72080b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f720f200700 1 -- 172.21.15.82:0/2448692366 >> 172.21.15.82:0/2448692366 conn(0x7f72080d3e10 msgr2=0x7f72080d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f720f200700 1 -- 172.21.15.82:0/2448692366 shutdown_connections 2024-05-10T04:50:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.797+0000 7f720f200700 1 -- 172.21.15.82:0/2448692366 wait complete. 2024-05-10T04:50:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.800+0000 7f720f200700 1 Processor -- start 2024-05-10T04:50:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.800+0000 7f720f200700 1 -- start start 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.801+0000 7f720f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72080b7910 0x7f72080ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.801+0000 7f720f200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f720815e610 0x7f7208148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.801+0000 7f720f200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7208162150 0x7f720814a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.801+0000 7f720f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72080ce550 con 0x7f72080b7910 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.801+0000 7f720f200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7208149050 con 0x7f7208162150 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.801+0000 7f720f200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720814b180 con 0x7f720815e610 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.801+0000 7f7207e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72080b7910 0x7f72080ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72080b7910 0x7f72080ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52344/0 (socket says 172.21.15.82:52344) 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207e00700 1 -- 172.21.15.82:0/1362183868 learned_addr learned my addr 172.21.15.82:0/1362183868 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207400700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f720815e610 0x7f7208148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f720d200700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7208162150 0x7f720814a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207e00700 1 -- 172.21.15.82:0/1362183868 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f720815e610 msgr2=0x7f7208148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207e00700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f720815e610 0x7f7208148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207e00700 1 -- 172.21.15.82:0/1362183868 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7208162150 msgr2=0x7f720814a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207e00700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7208162150 0x7f720814a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207e00700 1 -- 172.21.15.82:0/1362183868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40094a0 con 0x7f72080b7910 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.802+0000 7f7207e00700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72080b7910 0x7f72080ce010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71f800c4d0 tx=0x7f71f800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.803+0000 7f71ffe00700 1 -- 172.21.15.82:0/1362183868 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f800cea0 con 0x7f72080b7910 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.803+0000 7f71ffe00700 1 -- 172.21.15.82:0/1362183868 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f8005cb0 con 0x7f72080b7910 2024-05-10T04:50:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.803+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7200009b30 con 0x7f72080b7910 2024-05-10T04:50:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.803+0000 7f71ffe00700 1 -- 172.21.15.82:0/1362183868 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f80072d0 con 0x7f72080b7910 2024-05-10T04:50:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.803+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72080cd530 con 0x7f72080b7910 2024-05-10T04:50:55.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.804+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7208074af0 con 0x7f72080b7910 2024-05-10T04:50:55.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.805+0000 7f71ffe00700 1 -- 172.21.15.82:0/1362183868 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f71f8007430 con 0x7f72080b7910 2024-05-10T04:50:55.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.806+0000 7f71ffe00700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f71e806ac90 0x7f71e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:55.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.806+0000 7f71ffe00700 1 -- 172.21.15.82:0/1362183868 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71f80885f0 con 0x7f72080b7910 2024-05-10T04:50:55.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.806+0000 7f7207400700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f71e806ac90 0x7f71e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:55.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.807+0000 7f7207400700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f71e806ac90 0x7f71e806d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7208160ed0 tx=0x7f71f4009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:55.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:55.811+0000 7f71ffe00700 1 -- 172.21.15.82:0/1362183868 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f71f8053880 con 0x7f72080b7910 2024-05-10T04:50:56.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.014+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72080c8fb0 con 0x7f72080b7910 2024-05-10T04:50:56.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.015+0000 7f71ffe00700 1 -- 172.21.15.82:0/1362183868 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71f8056ea0 con 0x7f72080b7910 2024-05-10T04:50:56.018 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:50:56.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f71e806ac90 msgr2=0x7f71e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f71e806ac90 0x7f71e806d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7208160ed0 tx=0x7f71f4009210 comp rx=0 tx=0).stop 2024-05-10T04:50:56.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72080b7910 msgr2=0x7f72080ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72080b7910 0x7f72080ce010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71f800c4d0 tx=0x7f71f800c7e0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 shutdown_connections 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f71e806ac90 0x7f71e806d1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7208162150 0x7f720814a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72080b7910 0x7f72080ce010 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 --2- 172.21.15.82:0/1362183868 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f720815e610 0x7f7208148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 >> 172.21.15.82:0/1362183868 conn(0x7f72080d3e10 msgr2=0x7f720815dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 shutdown_connections 2024-05-10T04:50:56.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.018+0000 7f720f200700 1 -- 172.21.15.82:0/1362183868 wait complete. 2024-05-10T04:50:56.045 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:50:56.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.307+0000 7f348dc00700 1 Processor -- start 2024-05-10T04:50:56.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.307+0000 7f348dc00700 1 -- start start 2024-05-10T04:50:56.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.309+0000 7f348dc00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f348806c1a0 0x7f348806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.309+0000 7f348dc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815e790 0x7f348815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.309+0000 7f348dc00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34880d2590 con 0x7f348815beb0 2024-05-10T04:50:56.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.309+0000 7f348dc00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34880cec30 con 0x7f348806c1a0 2024-05-10T04:50:56.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.309+0000 7f348dc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348806caf0 con 0x7f348815e790 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f347fe00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f348806c1a0 0x7f348806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f348d200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815e790 0x7f348815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f348d200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815e790 0x7f348815eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:33250/0 (socket says 172.21.15.82:33250) 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f348d200700 1 -- 172.21.15.82:0/2022348586 learned_addr learned my addr 172.21.15.82:0/2022348586 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f347fe00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f348806c1a0 0x7f348806c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:51488/0 (socket says 172.21.15.82:51488) 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f348d200700 1 -- 172.21.15.82:0/2022348586 >> v2:172.21.15.129:3300/0 conn(0x7f348806c1a0 msgr2=0x7f348806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f348d200700 1 --2- 172.21.15.82:0/2022348586 >> v2:172.21.15.129:3300/0 conn(0x7f348806c1a0 0x7f348806c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f348d200700 1 -- 172.21.15.82:0/2022348586 >> v1:172.21.15.129:6789/0 conn(0x7f348815beb0 legacy=0x7f348815f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.310+0000 7f348d200700 1 -- 172.21.15.82:0/2022348586 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348815f730 con 0x7f348815e790 2024-05-10T04:50:56.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.311+0000 7f348d200700 1 --2- 172.21.15.82:0/2022348586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815e790 0x7f348815eba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3480009e50 tx=0x7f348000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3dc1899de395452 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:56.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.311+0000 7f3487400700 1 -- 172.21.15.82:0/2022348586 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000e070 con 0x7f348815e790 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.311+0000 7f3487400700 1 -- 172.21.15.82:0/2022348586 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348000b910 con 0x7f348815e790 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.311+0000 7f3487400700 1 -- 172.21.15.82:0/2022348586 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000bcc0 con 0x7f348815e790 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.312+0000 7f348dc00700 1 -- 172.21.15.82:0/2022348586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815e790 msgr2=0x7f348815eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.312+0000 7f348dc00700 1 --2- 172.21.15.82:0/2022348586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815e790 0x7f348815eba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3480009e50 tx=0x7f348000b330 comp rx=0 tx=0).stop 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.312+0000 7f348dc00700 1 -- 172.21.15.82:0/2022348586 shutdown_connections 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.312+0000 7f348dc00700 1 --2- 172.21.15.82:0/2022348586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815e790 0x7f348815eba0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.312+0000 7f348dc00700 1 --2- 172.21.15.82:0/2022348586 >> v2:172.21.15.129:3300/0 conn(0x7f348806c1a0 0x7f348806c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.312+0000 7f348dc00700 1 -- 172.21.15.82:0/2022348586 >> 172.21.15.82:0/2022348586 conn(0x7f34880d3be0 msgr2=0x7f34880d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.312+0000 7f348dc00700 1 -- 172.21.15.82:0/2022348586 shutdown_connections 2024-05-10T04:50:56.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.312+0000 7f348dc00700 1 -- 172.21.15.82:0/2022348586 wait complete. 2024-05-10T04:50:56.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.314+0000 7f348dc00700 1 Processor -- start 2024-05-10T04:50:56.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.314+0000 7f348dc00700 1 -- start start 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f348dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348806c1a0 0x7f3488156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f348dc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815beb0 0x7f3488146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f348dc00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f348815e790 0x7f3488146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f348dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34881571a0 con 0x7f348806c1a0 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f348dc00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34880cd440 con 0x7f348815e790 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f348dc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34880cbc70 con 0x7f348815beb0 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f3487e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348806c1a0 0x7f3488156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f3487e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348806c1a0 0x7f3488156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52358/0 (socket says 172.21.15.82:52358) 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f3487e00700 1 -- 172.21.15.82:0/3443578763 learned_addr learned my addr 172.21.15.82:0/3443578763 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f347fe00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815beb0 0x7f3488146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f348d200700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f348815e790 0x7f3488146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f3487e00700 1 -- 172.21.15.82:0/3443578763 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815beb0 msgr2=0x7f3488146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f3487e00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815beb0 0x7f3488146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f3487e00700 1 -- 172.21.15.82:0/3443578763 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f348815e790 msgr2=0x7f3488146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f3487e00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f348815e790 0x7f3488146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.316+0000 7f3487e00700 1 -- 172.21.15.82:0/3443578763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3480009b30 con 0x7f348806c1a0 2024-05-10T04:50:56.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.317+0000 7f3487e00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348806c1a0 0x7f3488156930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f347800c420 tx=0x7f347800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:56.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.317+0000 7f3484c00700 1 -- 172.21.15.82:0/3443578763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780052d0 con 0x7f348806c1a0 2024-05-10T04:50:56.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.317+0000 7f3484c00700 1 -- 172.21.15.82:0/3443578763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3478005430 con 0x7f348806c1a0 2024-05-10T04:50:56.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.317+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3488159230 con 0x7f348806c1a0 2024-05-10T04:50:56.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.317+0000 7f3484c00700 1 -- 172.21.15.82:0/3443578763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780038c0 con 0x7f348806c1a0 2024-05-10T04:50:56.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.317+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34881597f0 con 0x7f348806c1a0 2024-05-10T04:50:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.318+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3488074af0 con 0x7f348806c1a0 2024-05-10T04:50:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.319+0000 7f3484c00700 1 -- 172.21.15.82:0/3443578763 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3478003a20 con 0x7f348806c1a0 2024-05-10T04:50:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.320+0000 7f3484c00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f346406ac90 0x7f346406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.320+0000 7f3484c00700 1 -- 172.21.15.82:0/3443578763 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3478088630 con 0x7f348806c1a0 2024-05-10T04:50:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.320+0000 7f347fe00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f346406ac90 0x7f346406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.321+0000 7f347fe00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f346406ac90 0x7f346406d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f348815da60 tx=0x7f3470009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:56.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.325+0000 7f3484c00700 1 -- 172.21.15.82:0/3443578763 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3478053780 con 0x7f348806c1a0 2024-05-10T04:50:56.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.527+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34880b4190 con 0x7f348806c1a0 2024-05-10T04:50:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.528+0000 7f3484c00700 1 -- 172.21.15.82:0/3443578763 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3478017020 con 0x7f348806c1a0 2024-05-10T04:50:56.529 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f346406ac90 msgr2=0x7f346406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f346406ac90 0x7f346406d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f348815da60 tx=0x7f3470009210 comp rx=0 tx=0).stop 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348806c1a0 msgr2=0x7f3488156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348806c1a0 0x7f3488156930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f347800c420 tx=0x7f347800c730 comp rx=0 tx=0).stop 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 shutdown_connections 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f346406ac90 0x7f346406d1a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f348815e790 0x7f3488146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348806c1a0 0x7f3488156930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 --2- 172.21.15.82:0/3443578763 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f348815beb0 0x7f3488146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 >> 172.21.15.82:0/3443578763 conn(0x7f34880d3be0 msgr2=0x7f348815d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:56.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 shutdown_connections 2024-05-10T04:50:56.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.530+0000 7f348dc00700 1 -- 172.21.15.82:0/3443578763 wait complete. 2024-05-10T04:50:56.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:56.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.820+0000 7ff77e800700 1 Processor -- start 2024-05-10T04:50:56.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.820+0000 7ff77e800700 1 -- start start 2024-05-10T04:50:56.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.822+0000 7ff77e800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff778161ea0 0x7ff7781622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.822+0000 7ff77e800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780d0bd0 0x7ff7780d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.822+0000 7ff77e800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7780d2ca0 con 0x7ff7780cf490 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.822+0000 7ff77e800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7780d2720 con 0x7ff778161ea0 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.822+0000 7ff77e800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780d1520 con 0x7ff7780d0bd0 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.822+0000 7ff77d400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff7780cf490 0x7ff7780d3130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33034/0 (socket says 172.21.15.82:33034) 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.822+0000 7ff77d400700 1 -- 172.21.15.82:0/3918234643 learned_addr learned my addr 172.21.15.82:0/3918234643 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff77de00700 1 --2- 172.21.15.82:0/3918234643 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780d0bd0 0x7ff7780d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff77ca00700 1 --2- 172.21.15.82:0/3918234643 >> v2:172.21.15.129:3300/0 conn(0x7ff778161ea0 0x7ff7781622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff777e00700 1 -- 172.21.15.82:0/3918234643 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666918880 0 0) 0x7ff7780d2ca0 con 0x7ff7780cf490 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff777e00700 1 -- 172.21.15.82:0/3918234643 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7600035b0 con 0x7ff7780cf490 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff777e00700 1 -- 172.21.15.82:0/3918234643 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2213258670 0 0) 0x7ff7600035b0 con 0x7ff7780cf490 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff77de00700 1 -- 172.21.15.82:0/3918234643 >> v2:172.21.15.129:3300/0 conn(0x7ff778161ea0 msgr2=0x7ff7781622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff77de00700 1 --2- 172.21.15.82:0/3918234643 >> v2:172.21.15.129:3300/0 conn(0x7ff778161ea0 0x7ff7781622b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff77de00700 1 -- 172.21.15.82:0/3918234643 >> v1:172.21.15.82:6789/0 conn(0x7ff7780cf490 legacy=0x7ff7780d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.823+0000 7ff77de00700 1 -- 172.21.15.82:0/3918234643 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7780cf8a0 con 0x7ff7780d0bd0 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.824+0000 7ff77de00700 1 --2- 172.21.15.82:0/3918234643 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780d0bd0 0x7ff7780d0fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff770009d90 tx=0x7ff77000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d098a58a6c9149 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.824+0000 7ff777e00700 1 -- 172.21.15.82:0/3918234643 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000e070 con 0x7ff7780d0bd0 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.824+0000 7ff777e00700 1 -- 172.21.15.82:0/3918234643 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770003a20 con 0x7ff7780d0bd0 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.824+0000 7ff777e00700 1 -- 172.21.15.82:0/3918234643 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c001670 con 0x7ff7780d0bd0 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.824+0000 7ff77e800700 1 -- 172.21.15.82:0/3918234643 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780d0bd0 msgr2=0x7ff7780d0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.824+0000 7ff77e800700 1 --2- 172.21.15.82:0/3918234643 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780d0bd0 0x7ff7780d0fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff770009d90 tx=0x7ff77000b330 comp rx=0 tx=0).stop 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.825+0000 7ff77e800700 1 -- 172.21.15.82:0/3918234643 shutdown_connections 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.825+0000 7ff77e800700 1 --2- 172.21.15.82:0/3918234643 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780d0bd0 0x7ff7780d0fe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.825+0000 7ff77e800700 1 --2- 172.21.15.82:0/3918234643 >> v2:172.21.15.129:3300/0 conn(0x7ff778161ea0 0x7ff7781622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.825+0000 7ff77e800700 1 -- 172.21.15.82:0/3918234643 >> 172.21.15.82:0/3918234643 conn(0x7ff77806c8c0 msgr2=0x7ff77806ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.825+0000 7ff77e800700 1 -- 172.21.15.82:0/3918234643 shutdown_connections 2024-05-10T04:50:56.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.825+0000 7ff77e800700 1 -- 172.21.15.82:0/3918234643 wait complete. 2024-05-10T04:50:56.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.827+0000 7ff77e800700 1 Processor -- start 2024-05-10T04:50:56.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.828+0000 7ff77e800700 1 -- start start 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.829+0000 7ff77e800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780cf490 0x7ff7780ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.829+0000 7ff77e800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7780d0bd0 0x7ff778153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.829+0000 7ff77e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778161ea0 0x7ff7781544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.829+0000 7ff77e800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780cab60 con 0x7ff778161ea0 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.829+0000 7ff77e800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7781552f0 con 0x7ff7780d0bd0 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.829+0000 7ff77e800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff778159790 con 0x7ff7780cf490 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778161ea0 0x7ff7781544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778161ea0 0x7ff7781544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52368/0 (socket says 172.21.15.82:52368) 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77de00700 1 -- 172.21.15.82:0/3056572534 learned_addr learned my addr 172.21.15.82:0/3056572534 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:56.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77d400700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780cf490 0x7ff7780ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77ca00700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7780d0bd0 0x7ff778153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77de00700 1 -- 172.21.15.82:0/3056572534 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780cf490 msgr2=0x7ff7780ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77de00700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780cf490 0x7ff7780ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77de00700 1 -- 172.21.15.82:0/3056572534 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7780d0bd0 msgr2=0x7ff778153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77de00700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7780d0bd0 0x7ff778153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.830+0000 7ff77de00700 1 -- 172.21.15.82:0/3056572534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff770009a70 con 0x7ff778161ea0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.831+0000 7ff77de00700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778161ea0 0x7ff7781544f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff770004000 tx=0x7ff770004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.831+0000 7ff775600700 1 -- 172.21.15.82:0/3056572534 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770004440 con 0x7ff778161ea0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.831+0000 7ff775600700 1 -- 172.21.15.82:0/3056572534 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7700045c0 con 0x7ff778161ea0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.831+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7781599e0 con 0x7ff778161ea0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.831+0000 7ff775600700 1 -- 172.21.15.82:0/3056572534 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770004970 con 0x7ff778161ea0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.831+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff778159520 con 0x7ff778161ea0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.832+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff778074af0 con 0x7ff778161ea0 2024-05-10T04:50:56.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.833+0000 7ff775600700 1 -- 172.21.15.82:0/3056572534 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff770012430 con 0x7ff778161ea0 2024-05-10T04:50:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.834+0000 7ff775600700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff75806ac90 0x7ff75806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.834+0000 7ff775600700 1 -- 172.21.15.82:0/3056572534 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff77008b080 con 0x7ff778161ea0 2024-05-10T04:50:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.834+0000 7ff77d400700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff75806ac90 0x7ff75806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.835+0000 7ff77d400700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff75806ac90 0x7ff75806d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff76c000f60 tx=0x7ff76c001e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:56.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:56.838+0000 7ff775600700 1 -- 172.21.15.82:0/3056572534 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff770056250 con 0x7ff778161ea0 2024-05-10T04:50:57.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.044+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7780d2080 con 0x7ff778161ea0 2024-05-10T04:50:57.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.045+0000 7ff775600700 1 -- 172.21.15.82:0/3056572534 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16037 (secure 0 0 0) 0x7ff770059870 con 0x7ff778161ea0 2024-05-10T04:50:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:57.047 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:17.071122+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff75806ac90 msgr2=0x7ff75806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff75806ac90 0x7ff75806d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff76c000f60 tx=0x7ff76c001e00 comp rx=0 tx=0).stop 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778161ea0 msgr2=0x7ff7781544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778161ea0 0x7ff7781544f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff770004000 tx=0x7ff770004ad0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 shutdown_connections 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff75806ac90 0x7ff75806d1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778161ea0 0x7ff7781544f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7780cf490 0x7ff7780ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 --2- 172.21.15.82:0/3056572534 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7780d0bd0 0x7ff778153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 >> 172.21.15.82:0/3056572534 conn(0x7ff77806c8c0 msgr2=0x7ff7780ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 shutdown_connections 2024-05-10T04:50:57.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.048+0000 7ff77e800700 1 -- 172.21.15.82:0/3056572534 wait complete. 2024-05-10T04:50:57.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:57.077 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.339+0000 7fb041c00700 1 Processor -- start 2024-05-10T04:50:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.339+0000 7fb041c00700 1 -- start start 2024-05-10T04:50:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.341+0000 7fb041c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c06c1a0 0x7fb03c06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.341+0000 7fb041c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb03c15e790 0x7fb03c15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.341+0000 7fb041c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c0d2590 con 0x7fb03c15beb0 2024-05-10T04:50:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.341+0000 7fb041c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c0cec30 con 0x7fb03c15e790 2024-05-10T04:50:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.341+0000 7fb041c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c06caf0 con 0x7fb03c06c1a0 2024-05-10T04:50:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.341+0000 7fb03be00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb03c15beb0 0x7fb03c15f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33044/0 (socket says 172.21.15.82:33044) 2024-05-10T04:50:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.341+0000 7fb03be00700 1 -- 172.21.15.82:0/323472077 learned_addr learned my addr 172.21.15.82:0/323472077 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:57.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03b400700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c06c1a0 0x7fb03c06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb041200700 1 --2- 172.21.15.82:0/323472077 >> v2:172.21.15.129:3300/0 conn(0x7fb03c15e790 0x7fb03c15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760149515 0 0) 0x7fb03c0d2590 con 0x7fb03c15beb0 2024-05-10T04:50:57.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0200035b0 con 0x7fb03c15beb0 2024-05-10T04:50:57.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 272494806 0 0) 0x7fb0200035b0 con 0x7fb03c15beb0 2024-05-10T04:50:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c06c1a0 msgr2=0x7fb03c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c06c1a0 0x7fb03c06c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 >> v2:172.21.15.129:3300/0 conn(0x7fb03c15e790 msgr2=0x7fb03c15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 --2- 172.21.15.82:0/323472077 >> v2:172.21.15.129:3300/0 conn(0x7fb03c15e790 0x7fb03c15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c15f730 con 0x7fb03c15beb0 2024-05-10T04:50:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fb02c001670 con 0x7fb03c15beb0 2024-05-10T04:50:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 >> v1:172.21.15.82:6789/0 conn(0x7fb03c15beb0 legacy=0x7fb03c15f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb020003a00 0x7fb020003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.342+0000 7fb03aa00700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c06c1a0 0x7fb020004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb03aa00700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb020004d90 0x7fb0200051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0cec30 con 0x7fb020004d90 2024-05-10T04:50:57.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c06caf0 con 0x7fb020003a00 2024-05-10T04:50:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02000ba90 con 0x7fb03c06c1a0 2024-05-10T04:50:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb041200700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb020004d90 0x7fb0200051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb03be00700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb020003a00 0x7fb020003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb03b400700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c06c1a0 0x7fb020004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb041200700 1 -- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c06c1a0 msgr2=0x7fb020004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:57.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb041200700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c06c1a0 0x7fb020004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb041200700 1 -- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb020003a00 msgr2=0x7fb020003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb041200700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb020003a00 0x7fb020003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.343+0000 7fb041200700 1 -- 172.21.15.82:0/323472077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200035b0 con 0x7fb020004d90 2024-05-10T04:50:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.344+0000 7fb041200700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb020004d90 0x7fb0200051a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb03c06d290 tx=0x7fb020005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b8e472325b216a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.344+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03400ebd0 con 0x7fb020004d90 2024-05-10T04:50:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.344+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03400f040 con 0x7fb020004d90 2024-05-10T04:50:57.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.344+0000 7fb03aa00700 1 -- 172.21.15.82:0/323472077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034014480 con 0x7fb020004d90 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.344+0000 7fb041c00700 1 -- 172.21.15.82:0/323472077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb020004d90 msgr2=0x7fb0200051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.344+0000 7fb041c00700 1 --2- 172.21.15.82:0/323472077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb020004d90 0x7fb0200051a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb03c06d290 tx=0x7fb020005880 comp rx=0 tx=0).stop 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.344+0000 7fb041200700 1 -- 172.21.15.82:0/323472077 reap_dead start 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.345+0000 7fb041c00700 1 -- 172.21.15.82:0/323472077 shutdown_connections 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.345+0000 7fb041c00700 1 -- 172.21.15.82:0/323472077 >> 172.21.15.82:0/323472077 conn(0x7fb03c0d3be0 msgr2=0x7fb03c0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.345+0000 7fb041c00700 1 -- 172.21.15.82:0/323472077 shutdown_connections 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.345+0000 7fb041c00700 1 -- 172.21.15.82:0/323472077 wait complete. 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.347+0000 7fb041c00700 1 Processor -- start 2024-05-10T04:50:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.347+0000 7fb041c00700 1 -- start start 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.348+0000 7fb041c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb03c0c8840 0x7fb03c0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.348+0000 7fb041c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb03c1e72f0 0x7fb03c1e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.348+0000 7fb041c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c0b3720 0x7fb03c0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb041c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0ca0c0 con 0x7fb03c1e72f0 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb041c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0c83b0 con 0x7fb03c0c8840 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb041c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0c77c0 con 0x7fb03c0b3720 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb03c1e72f0 0x7fb03c1e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb03c1e72f0 0x7fb03c1e7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52374/0 (socket says 172.21.15.82:52374) 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 -- 172.21.15.82:0/666792067 learned_addr learned my addr 172.21.15.82:0/666792067 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03be00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb03c0c8840 0x7fb03c0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb041200700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c0b3720 0x7fb03c0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 -- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c0b3720 msgr2=0x7fb03c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c0b3720 0x7fb03c0b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 -- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb03c0c8840 msgr2=0x7fb03c0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb03c0c8840 0x7fb03c0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 -- 172.21.15.82:0/666792067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0c7a80 con 0x7fb03c1e72f0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03be00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb03c0c8840 0x7fb03c0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.349+0000 7fb03b400700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb03c1e72f0 0x7fb03c1e7700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb028011aa0 tx=0x7fb028011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.350+0000 7fb033e00700 1 -- 172.21.15.82:0/666792067 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800f980 con 0x7fb03c1e72f0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.350+0000 7fb033e00700 1 -- 172.21.15.82:0/666792067 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02800fae0 con 0x7fb03c1e72f0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.350+0000 7fb033e00700 1 -- 172.21.15.82:0/666792067 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800fe90 con 0x7fb03c1e72f0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.350+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c0c7d60 con 0x7fb03c1e72f0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.350+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c1e7c40 con 0x7fb03c1e72f0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.351+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c0d1f20 con 0x7fb03c1e72f0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.352+0000 7fb033e00700 1 -- 172.21.15.82:0/666792067 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb028014440 con 0x7fb03c1e72f0 2024-05-10T04:50:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.353+0000 7fb033e00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01c06ac90 0x7fb01c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.353+0000 7fb033e00700 1 -- 172.21.15.82:0/666792067 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb028089b00 con 0x7fb03c1e72f0 2024-05-10T04:50:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.353+0000 7fb03be00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01c06ac90 0x7fb01c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.353+0000 7fb03be00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01c06ac90 0x7fb01c06d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb03c1e98a0 tx=0x7fb02c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.357+0000 7fb033e00700 1 -- 172.21.15.82:0/666792067 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb03c0d1f20 con 0x7fb03c1e72f0 2024-05-10T04:50:57.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.558+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb03c0d1f20 con 0x7fb03c1e72f0 2024-05-10T04:50:57.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.558+0000 7fb033e00700 1 -- 172.21.15.82:0/666792067 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb03c0d1f20 con 0x7fb03c1e72f0 2024-05-10T04:50:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01c06ac90 msgr2=0x7fb01c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01c06ac90 0x7fb01c06d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb03c1e98a0 tx=0x7fb02c009040 comp rx=0 tx=0).stop 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb03c1e72f0 msgr2=0x7fb03c1e7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb03c1e72f0 0x7fb03c1e7700 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb028011aa0 tx=0x7fb028011e60 comp rx=0 tx=0).stop 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 shutdown_connections 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01c06ac90 0x7fb01c06d1a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb03c0b3720 0x7fb03c0b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb03c0c8840 0x7fb03c0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 --2- 172.21.15.82:0/666792067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb03c1e72f0 0x7fb03c1e7700 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 >> 172.21.15.82:0/666792067 conn(0x7fb03c0d3be0 msgr2=0x7fb03c15d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:57.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 shutdown_connections 2024-05-10T04:50:57.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.561+0000 7fb041c00700 1 -- 172.21.15.82:0/666792067 wait complete. 2024-05-10T04:50:57.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:50:57.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.859+0000 7f90f0e00700 1 Processor -- start 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.859+0000 7f90f0e00700 1 -- start start 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.860+0000 7f90f0e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f90ec162150 0x7f90ec15e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.861+0000 7f90f0e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0d2c00 con 0x7f90ec06c160 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.861+0000 7f90f0e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec162630 con 0x7f90ec0cf4d0 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.861+0000 7f90f0e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec162910 con 0x7f90ec162150 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.861+0000 7f90ea800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f90ec06c160 0x7f90ec06c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33058/0 (socket says 172.21.15.82:33058) 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.861+0000 7f90ea800700 1 -- 172.21.15.82:0/3313466036 learned_addr learned my addr 172.21.15.82:0/3313466036 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.861+0000 7f90e9e00700 1 --2- 172.21.15.82:0/3313466036 >> v2:172.21.15.129:3300/0 conn(0x7f90ec162150 0x7f90ec15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.861+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424358919 0 0) 0x7f90ec0d2c00 con 0x7f90ec06c160 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.861+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d00035b0 con 0x7f90ec06c160 2024-05-10T04:50:57.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2259287942 0 0) 0x7f90d00035b0 con 0x7f90ec06c160 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 >> v2:172.21.15.129:3300/0 conn(0x7f90ec162150 msgr2=0x7f90ec15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 --2- 172.21.15.82:0/3313466036 >> v2:172.21.15.129:3300/0 conn(0x7f90ec162150 0x7f90ec15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 >> v1:172.21.15.129:6789/0 conn(0x7f90ec0cf4d0 legacy=0x7f90ec0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec162bf0 con 0x7f90ec06c160 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f90e40019f0 con 0x7f90ec06c160 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 >> v1:172.21.15.82:6789/0 conn(0x7f90ec06c160 legacy=0x7f90ec06c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d0003a00 0x7f90d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d0004850 0x7f90d0004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90d00053a0 0x7f90d000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec162910 con 0x7f90d0003a00 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d000c2d0 con 0x7f90d0004850 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d000c490 con 0x7f90d00053a0 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e9e00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d0003a00 0x7f90d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e9400700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d0004850 0x7f90d0004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e9e00700 1 -- 172.21.15.82:0/3313466036 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90d00053a0 msgr2=0x7f90d000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e9e00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90d00053a0 0x7f90d000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e9e00700 1 -- 172.21.15.82:0/3313466036 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d0004850 msgr2=0x7f90d0004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e9e00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90d0004850 0x7f90d0004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.862+0000 7f90e9e00700 1 -- 172.21.15.82:0/3313466036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00035b0 con 0x7f90d0003a00 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.863+0000 7f90ea800700 1 -- 172.21.15.82:0/3313466036 reap_dead start 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.863+0000 7f90e9e00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d0003a00 0x7f90d0003e70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009b30 tx=0x7f90d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9e9a7aaee760a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.863+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00e6c0 con 0x7f90d0003a00 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.863+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc00e820 con 0x7f90d0003a00 2024-05-10T04:50:57.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.863+0000 7f90e8a00700 1 -- 172.21.15.82:0/3313466036 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc00eb90 con 0x7f90d0003a00 2024-05-10T04:50:57.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.864+0000 7f90f0e00700 1 -- 172.21.15.82:0/3313466036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d0003a00 msgr2=0x7f90d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.864+0000 7f90f0e00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d0003a00 0x7f90d0003e70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009b30 tx=0x7f90d0005880 comp rx=0 tx=0).stop 2024-05-10T04:50:57.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.864+0000 7f90f0e00700 1 -- 172.21.15.82:0/3313466036 shutdown_connections 2024-05-10T04:50:57.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.864+0000 7f90f0e00700 1 --2- 172.21.15.82:0/3313466036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90d0003a00 0x7f90d0003e70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.864+0000 7f90f0e00700 1 -- 172.21.15.82:0/3313466036 >> 172.21.15.82:0/3313466036 conn(0x7f90ec0d3e10 msgr2=0x7f90ec0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:57.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.864+0000 7f90f0e00700 1 -- 172.21.15.82:0/3313466036 shutdown_connections 2024-05-10T04:50:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.864+0000 7f90f0e00700 1 -- 172.21.15.82:0/3313466036 wait complete. 2024-05-10T04:50:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.866+0000 7f90f0e00700 1 Processor -- start 2024-05-10T04:50:57.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.866+0000 7f90f0e00700 1 -- start start 2024-05-10T04:50:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90f0e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90d0003a00 0x7f90ec14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90f0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec15ce40 0x7f90ec0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90f0e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec15d250 0x7f90ec0b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90f0e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec14c810 con 0x7f90ec15ce40 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90f0e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0c8870 con 0x7f90ec15d250 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90f0e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec15d800 con 0x7f90d0003a00 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec15ce40 0x7f90ec0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec15ce40 0x7f90ec0b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52398/0 (socket says 172.21.15.82:52398) 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9400700 1 -- 172.21.15.82:0/3584659147 learned_addr learned my addr 172.21.15.82:0/3584659147 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90ea800700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec15d250 0x7f90ec0b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90d0003a00 0x7f90ec14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9400700 1 -- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90d0003a00 msgr2=0x7f90ec14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9400700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90d0003a00 0x7f90ec14be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9400700 1 -- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec15d250 msgr2=0x7f90ec0b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9400700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec15d250 0x7f90ec0b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90e9400700 1 -- 172.21.15.82:0/3584659147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec15da50 con 0x7f90ec15ce40 2024-05-10T04:50:57.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.868+0000 7f90ea800700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec15d250 0x7f90ec0b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:57.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.869+0000 7f90e9400700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec15ce40 0x7f90ec0b46a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90d800e510 tx=0x7f90d800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:57.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.869+0000 7f90e2000700 1 -- 172.21.15.82:0/3584659147 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80052e0 con 0x7f90ec15ce40 2024-05-10T04:50:57.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.869+0000 7f90e2000700 1 -- 172.21.15.82:0/3584659147 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8005440 con 0x7f90ec15ce40 2024-05-10T04:50:57.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.869+0000 7f90e2000700 1 -- 172.21.15.82:0/3584659147 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80038c0 con 0x7f90ec15ce40 2024-05-10T04:50:57.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.869+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec15b760 con 0x7f90ec15ce40 2024-05-10T04:50:57.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.869+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec15bd20 con 0x7f90ec15ce40 2024-05-10T04:50:57.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.870+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec074af0 con 0x7f90ec15ce40 2024-05-10T04:50:57.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.871+0000 7f90e2000700 1 -- 172.21.15.82:0/3584659147 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90d8003a20 con 0x7f90ec15ce40 2024-05-10T04:50:57.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.872+0000 7f90e2000700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90cc06ac90 0x7f90cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:57.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.872+0000 7f90e2000700 1 -- 172.21.15.82:0/3584659147 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f90d8088ab0 con 0x7f90ec15ce40 2024-05-10T04:50:57.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.872+0000 7f90e9e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90cc06ac90 0x7f90cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:57.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.873+0000 7f90e9e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90cc06ac90 0x7f90cc06d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0090b0 tx=0x7f90dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:57.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:57.877+0000 7f90e2000700 1 -- 172.21.15.82:0/3584659147 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f90d8053c10 con 0x7f90ec15ce40 2024-05-10T04:50:58.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.079+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90ec0b3550 con 0x7f90ec15ce40 2024-05-10T04:50:58.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.079+0000 7f90e2000700 1 -- 172.21.15.82:0/3584659147 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90d80190a0 con 0x7f90ec15ce40 2024-05-10T04:50:58.081 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:50:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90cc06ac90 msgr2=0x7f90cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90cc06ac90 0x7f90cc06d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0090b0 tx=0x7f90dc008030 comp rx=0 tx=0).stop 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec15ce40 msgr2=0x7f90ec0b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec15ce40 0x7f90ec0b46a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f90d800e510 tx=0x7f90d800e8d0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 shutdown_connections 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90cc06ac90 0x7f90cc06d1a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec15d250 0x7f90ec0b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90d0003a00 0x7f90ec14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 --2- 172.21.15.82:0/3584659147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec15ce40 0x7f90ec0b46a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 >> 172.21.15.82:0/3584659147 conn(0x7f90ec0d3e10 msgr2=0x7f90ec0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 shutdown_connections 2024-05-10T04:50:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.082+0000 7f90f0e00700 1 -- 172.21.15.82:0/3584659147 wait complete. 2024-05-10T04:50:58.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:50:58.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.373+0000 7f99c7000700 1 Processor -- start 2024-05-10T04:50:58.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.373+0000 7f99c7000700 1 -- start start 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.375+0000 7f99c7000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f99c0158c70 0x7f99c015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c7000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99c00b5c90 0x7f99c00b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c7000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c006c5f0 con 0x7f99c0162000 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c7000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c00b65e0 con 0x7f99c00b5c90 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c7000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c006d190 con 0x7f99c0158c70 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c5000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99c00b5c90 0x7f99c00b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c5000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99c00b5c90 0x7f99c00b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52400/0 (socket says 172.21.15.82:52400) 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c5000700 1 -- 172.21.15.82:0/1068964599 learned_addr learned my addr 172.21.15.82:0/1068964599 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:58.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99bfe00700 1 --2- 172.21.15.82:0/1068964599 >> v2:172.21.15.129:3300/0 conn(0x7f99c0158c70 0x7f99c015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c5000700 1 -- 172.21.15.82:0/1068964599 >> v2:172.21.15.129:3300/0 conn(0x7f99c0158c70 msgr2=0x7f99c015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:58.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c5000700 1 --2- 172.21.15.82:0/1068964599 >> v2:172.21.15.129:3300/0 conn(0x7f99c0158c70 0x7f99c015ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c5000700 1 -- 172.21.15.82:0/1068964599 >> v1:172.21.15.129:6789/0 conn(0x7f99c0162000 legacy=0x7f99c006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:58.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.376+0000 7f99c5000700 1 -- 172.21.15.82:0/1068964599 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0162850 con 0x7f99c00b5c90 2024-05-10T04:50:58.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.377+0000 7f99c5000700 1 --2- 172.21.15.82:0/1068964599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c00b60a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f99c008cba0 tx=0x7f99b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43534ab0154cf288 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.377+0000 7f99bea00700 1 -- 172.21.15.82:0/1068964599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b800e070 con 0x7f99c00b5c90 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.377+0000 7f99bea00700 1 -- 172.21.15.82:0/1068964599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b8003a20 con 0x7f99c00b5c90 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.377+0000 7f99bea00700 1 -- 172.21.15.82:0/1068964599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8003dd0 con 0x7f99c00b5c90 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.378+0000 7f99c7000700 1 -- 172.21.15.82:0/1068964599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 msgr2=0x7f99c00b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.378+0000 7f99c7000700 1 --2- 172.21.15.82:0/1068964599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c00b60a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f99c008cba0 tx=0x7f99b800b330 comp rx=0 tx=0).stop 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.378+0000 7f99c7000700 1 -- 172.21.15.82:0/1068964599 shutdown_connections 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.378+0000 7f99c7000700 1 --2- 172.21.15.82:0/1068964599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c00b60a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.378+0000 7f99c7000700 1 --2- 172.21.15.82:0/1068964599 >> v2:172.21.15.129:3300/0 conn(0x7f99c0158c70 0x7f99c015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.378+0000 7f99c7000700 1 -- 172.21.15.82:0/1068964599 >> 172.21.15.82:0/1068964599 conn(0x7f99c00d0d30 msgr2=0x7f99c00d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.378+0000 7f99c7000700 1 -- 172.21.15.82:0/1068964599 shutdown_connections 2024-05-10T04:50:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.378+0000 7f99c7000700 1 -- 172.21.15.82:0/1068964599 wait complete. 2024-05-10T04:50:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.380+0000 7f99c7000700 1 Processor -- start 2024-05-10T04:50:58.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.380+0000 7f99c7000700 1 -- start start 2024-05-10T04:50:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99c7000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c01f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99c7000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f99c0158c70 0x7f99c0153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99c7000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f99c0162000 0x7f99c0154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99c7000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00ca8b0 con 0x7f99c00b5c90 2024-05-10T04:50:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99c7000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00ca380 con 0x7f99c0158c70 2024-05-10T04:50:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99c7000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c01e9600 con 0x7f99c0162000 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c01f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c01f3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52416/0 (socket says 172.21.15.82:52416) 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 -- 172.21.15.82:0/997404972 learned_addr learned my addr 172.21.15.82:0/997404972 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bf400700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f99c0158c70 0x7f99c0153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99c5000700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f99c0162000 0x7f99c0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 -- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f99c0162000 msgr2=0x7f99c0154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f99c0162000 0x7f99c0154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 -- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f99c0158c70 msgr2=0x7f99c0153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f99c0158c70 0x7f99c0153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 -- 172.21.15.82:0/997404972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8009b30 con 0x7f99c00b5c90 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99c5000700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f99c0162000 0x7f99c0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bf400700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f99c0158c70 0x7f99c0153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.382+0000 7f99bfe00700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c01f3f50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f99b000d830 tx=0x7f99b000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:58.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.383+0000 7f99b7e00700 1 -- 172.21.15.82:0/997404972 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00125f0 con 0x7f99c00b5c90 2024-05-10T04:50:58.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.383+0000 7f99b7e00700 1 -- 172.21.15.82:0/997404972 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0012750 con 0x7f99c00b5c90 2024-05-10T04:50:58.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.383+0000 7f99b7e00700 1 -- 172.21.15.82:0/997404972 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0012b00 con 0x7f99c00b5c90 2024-05-10T04:50:58.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.383+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c00ca5d0 con 0x7f99c00b5c90 2024-05-10T04:50:58.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.383+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c01e9290 con 0x7f99c00b5c90 2024-05-10T04:50:58.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.384+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c00c79c0 con 0x7f99c00b5c90 2024-05-10T04:50:58.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.385+0000 7f99b7e00700 1 -- 172.21.15.82:0/997404972 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f99b0012c60 con 0x7f99c00b5c90 2024-05-10T04:50:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.386+0000 7f99b7e00700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99a006ac90 0x7f99a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.386+0000 7f99b7e00700 1 -- 172.21.15.82:0/997404972 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f99b0089870 con 0x7f99c00b5c90 2024-05-10T04:50:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.386+0000 7f99bf400700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99a006ac90 0x7f99a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.387+0000 7f99bf400700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99a006ac90 0x7f99a006d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99c01f7cc0 tx=0x7f99ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.390+0000 7f99b7e00700 1 -- 172.21.15.82:0/997404972 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f99b0054890 con 0x7f99c00b5c90 2024-05-10T04:50:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.592+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99c00732b0 con 0x7f99c00b5c90 2024-05-10T04:50:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.593+0000 7f99b7e00700 1 -- 172.21.15.82:0/997404972 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99b0057eb0 con 0x7f99c00b5c90 2024-05-10T04:50:58.594 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:50:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99a006ac90 msgr2=0x7f99a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99a006ac90 0x7f99a006d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99c01f7cc0 tx=0x7f99ac008040 comp rx=0 tx=0).stop 2024-05-10T04:50:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 msgr2=0x7f99c01f3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c01f3f50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f99b000d830 tx=0x7f99b000dbf0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 shutdown_connections 2024-05-10T04:50:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99a006ac90 0x7f99a006d1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f99c0162000 0x7f99c0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c00b5c90 0x7f99c01f3f50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 --2- 172.21.15.82:0/997404972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f99c0158c70 0x7f99c0153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 >> 172.21.15.82:0/997404972 conn(0x7f99c00d0d30 msgr2=0x7f99c00b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 shutdown_connections 2024-05-10T04:50:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.595+0000 7f99c7000700 1 -- 172.21.15.82:0/997404972 wait complete. 2024-05-10T04:50:58.640 INFO:tasks.cephfs_test_runner:Starting test: test_replay_create (tasks.cephfs.test_cap_flush.TestCapFlush) MDS starts to handle client caps when it enters clientreplay stage. 2024-05-10T04:50:58.640 INFO:tasks.cephfs_test_runner:test_replay_create (tasks.cephfs.test_cap_flush.TestCapFlush) 2024-05-10T04:50:58.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:50:58.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.908+0000 7fee44200700 1 Processor -- start 2024-05-10T04:50:58.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.908+0000 7fee44200700 1 -- start start 2024-05-10T04:50:58.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.909+0000 7fee44200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fee3c15f4f0 0x7fee3c0b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.909+0000 7fee44200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fee3c0b5dd0 0x7fee3c0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee44200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c15f900 con 0x7fee3c15bfe0 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee44200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c15c3f0 con 0x7fee3c15f4f0 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee44200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c0b61e0 con 0x7fee3c0b5dd0 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee40e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fee3c15f4f0 0x7fee3c0b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee40e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fee3c15f4f0 0x7fee3c0b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52432/0 (socket says 172.21.15.82:52432) 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee40e00700 1 -- 172.21.15.82:0/1266753656 learned_addr learned my addr 172.21.15.82:0/1266753656 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee40e00700 1 -- 172.21.15.82:0/1266753656 >> v2:172.21.15.129:3300/0 conn(0x7fee3c0b5dd0 msgr2=0x7fee3c0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee42200700 1 --2- 172.21.15.82:0/1266753656 >> v2:172.21.15.129:3300/0 conn(0x7fee3c0b5dd0 0x7fee3c0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee40e00700 1 --2- 172.21.15.82:0/1266753656 >> v2:172.21.15.129:3300/0 conn(0x7fee3c0b5dd0 0x7fee3c0b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee40e00700 1 -- 172.21.15.82:0/1266753656 >> v1:172.21.15.129:6789/0 conn(0x7fee3c15bfe0 legacy=0x7fee3c161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee40e00700 1 -- 172.21.15.82:0/1266753656 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c162a70 con 0x7fee3c15f4f0 2024-05-10T04:50:58.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.910+0000 7fee42200700 1 --2- 172.21.15.82:0/1266753656 >> v2:172.21.15.129:3300/0 conn(0x7fee3c0b5dd0 0x7fee3c0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:58.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.911+0000 7fee40e00700 1 --2- 172.21.15.82:0/1266753656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0b5890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0b6670 tx=0x7fee28009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfa32d3a856f5b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.911+0000 7fee3be00700 1 -- 172.21.15.82:0/1266753656 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28004230 con 0x7fee3c15f4f0 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.911+0000 7fee3be00700 1 -- 172.21.15.82:0/1266753656 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28004390 con 0x7fee3c15f4f0 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.911+0000 7fee3be00700 1 -- 172.21.15.82:0/1266753656 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280036a0 con 0x7fee3c15f4f0 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.912+0000 7fee44200700 1 -- 172.21.15.82:0/1266753656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 msgr2=0x7fee3c0b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.912+0000 7fee44200700 1 --2- 172.21.15.82:0/1266753656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0b5890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0b6670 tx=0x7fee28009bd0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.912+0000 7fee44200700 1 -- 172.21.15.82:0/1266753656 shutdown_connections 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.912+0000 7fee44200700 1 --2- 172.21.15.82:0/1266753656 >> v2:172.21.15.129:3300/0 conn(0x7fee3c0b5dd0 0x7fee3c0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.912+0000 7fee44200700 1 --2- 172.21.15.82:0/1266753656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0b5890 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.912+0000 7fee44200700 1 -- 172.21.15.82:0/1266753656 >> 172.21.15.82:0/1266753656 conn(0x7fee3c0d0a70 msgr2=0x7fee3c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.912+0000 7fee44200700 1 -- 172.21.15.82:0/1266753656 shutdown_connections 2024-05-10T04:50:58.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.912+0000 7fee44200700 1 -- 172.21.15.82:0/1266753656 wait complete. 2024-05-10T04:50:58.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.914+0000 7fee44200700 1 Processor -- start 2024-05-10T04:50:58.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.914+0000 7fee44200700 1 -- start start 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.915+0000 7fee44200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee3c0b5dd0 0x7fee3c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee44200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee3c15bfe0 0x7fee3c1f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee44200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee44200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c0cddc0 con 0x7fee3c15f4f0 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee44200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1f4db0 con 0x7fee3c15bfe0 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee44200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c0c8d20 con 0x7fee3c0b5dd0 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee42200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee42200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52448/0 (socket says 172.21.15.82:52448) 2024-05-10T04:50:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee42200700 1 -- 172.21.15.82:0/1204195231 learned_addr learned my addr 172.21.15.82:0/1204195231 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee40e00700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee3c15bfe0 0x7fee3c1f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee41800700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee3c0b5dd0 0x7fee3c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee42200700 1 -- 172.21.15.82:0/1204195231 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee3c0b5dd0 msgr2=0x7fee3c1510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee42200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee3c0b5dd0 0x7fee3c1510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee42200700 1 -- 172.21.15.82:0/1204195231 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee3c15bfe0 msgr2=0x7fee3c1f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee42200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee3c15bfe0 0x7fee3c1f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.916+0000 7fee42200700 1 -- 172.21.15.82:0/1204195231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28009550 con 0x7fee3c15f4f0 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.917+0000 7fee42200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0ca010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fee3400cd10 tx=0x7fee3400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.917+0000 7fee39600700 1 -- 172.21.15.82:0/1204195231 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34003a20 con 0x7fee3c15f4f0 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.917+0000 7fee39600700 1 -- 172.21.15.82:0/1204195231 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee34003ba0 con 0x7fee3c15f4f0 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.917+0000 7fee39600700 1 -- 172.21.15.82:0/1204195231 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34004020 con 0x7fee3c15f4f0 2024-05-10T04:50:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.917+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c0c8f70 con 0x7fee3c15f4f0 2024-05-10T04:50:58.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.917+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c0c9250 con 0x7fee3c15f4f0 2024-05-10T04:50:58.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.918+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c074af0 con 0x7fee3c15f4f0 2024-05-10T04:50:58.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.919+0000 7fee39600700 1 -- 172.21.15.82:0/1204195231 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fee3400b040 con 0x7fee3c15f4f0 2024-05-10T04:50:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.920+0000 7fee39600700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee1c06acc0 0x7fee1c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.920+0000 7fee39600700 1 -- 172.21.15.82:0/1204195231 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fee34089920 con 0x7fee3c15f4f0 2024-05-10T04:50:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.920+0000 7fee41800700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee1c06acc0 0x7fee1c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.921+0000 7fee41800700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee1c06acc0 0x7fee1c06d1d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee30009870 tx=0x7fee30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:58.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:58.925+0000 7fee39600700 1 -- 172.21.15.82:0/1204195231 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fee340549d0 con 0x7fee3c15f4f0 2024-05-10T04:50:59.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.133+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee3c0d2210 con 0x7fee3c15f4f0 2024-05-10T04:50:59.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.134+0000 7fee39600700 1 -- 172.21.15.82:0/1204195231 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16333 (secure 0 0 0) 0x7fee3401d020 con 0x7fee3c15f4f0 2024-05-10T04:50:59.136 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:50:59.136 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:58.666687+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:50:59.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.136+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee1c06acc0 msgr2=0x7fee1c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.136+0000 7fee44200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee1c06acc0 0x7fee1c06d1d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fee30009870 tx=0x7fee30008040 comp rx=0 tx=0).stop 2024-05-10T04:50:59.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.136+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 msgr2=0x7fee3c0ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.136+0000 7fee44200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0ca010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fee3400cd10 tx=0x7fee3400a560 comp rx=0 tx=0).stop 2024-05-10T04:50:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.136+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 shutdown_connections 2024-05-10T04:50:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.137+0000 7fee44200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fee1c06acc0 0x7fee1c06d1d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.137+0000 7fee44200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee3c15f4f0 0x7fee3c0ca010 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.137+0000 7fee44200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fee3c0b5dd0 0x7fee3c1510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.137+0000 7fee44200700 1 --2- 172.21.15.82:0/1204195231 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fee3c15bfe0 0x7fee3c1f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.137+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 >> 172.21.15.82:0/1204195231 conn(0x7fee3c0d0a70 msgr2=0x7fee3c0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.137+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 shutdown_connections 2024-05-10T04:50:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.137+0000 7fee44200700 1 -- 172.21.15.82:0/1204195231 wait complete. 2024-05-10T04:50:59.163 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:50:59.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:50:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.427+0000 7f29d6600700 1 Processor -- start 2024-05-10T04:50:59.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.427+0000 7f29d6600700 1 -- start start 2024-05-10T04:50:59.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.428+0000 7f29d6600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0158c70 0x7f29d015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.428+0000 7f29d6600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29d0162000 0x7f29d006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.428+0000 7f29d6600700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d006c5f0 con 0x7f29d00b5c90 2024-05-10T04:50:59.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.428+0000 7f29d6600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d0162850 con 0x7f29d0162000 2024-05-10T04:50:59.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.428+0000 7f29d6600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0162b30 con 0x7f29d0158c70 2024-05-10T04:50:59.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.429+0000 7f29cea00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29d0162000 0x7f29d006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.429+0000 7f29cea00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29d0162000 0x7f29d006ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52458/0 (socket says 172.21.15.82:52458) 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.429+0000 7f29cea00700 1 -- 172.21.15.82:0/3809207614 learned_addr learned my addr 172.21.15.82:0/3809207614 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.429+0000 7f29cf400700 1 --2- 172.21.15.82:0/3809207614 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0158c70 0x7f29d015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.429+0000 7f29cea00700 1 -- 172.21.15.82:0/3809207614 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0158c70 msgr2=0x7f29d015ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.429+0000 7f29cea00700 1 --2- 172.21.15.82:0/3809207614 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0158c70 0x7f29d015ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.429+0000 7f29cea00700 1 -- 172.21.15.82:0/3809207614 >> v1:172.21.15.129:6789/0 conn(0x7f29d00b5c90 legacy=0x7f29d00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.429+0000 7f29cea00700 1 -- 172.21.15.82:0/3809207614 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0162e10 con 0x7f29d0162000 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.430+0000 7f29cea00700 1 --2- 172.21.15.82:0/3809207614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0162000 0x7f29d006ca80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0098f0 tx=0x7f29bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ab272df0879a23 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.430+0000 7f29ce000700 1 -- 172.21.15.82:0/3809207614 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00b8a0 con 0x7f29d0162000 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.430+0000 7f29ce000700 1 -- 172.21.15.82:0/3809207614 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00ba00 con 0x7f29d0162000 2024-05-10T04:50:59.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.430+0000 7f29ce000700 1 -- 172.21.15.82:0/3809207614 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00bd90 con 0x7f29d0162000 2024-05-10T04:50:59.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.430+0000 7f29d6600700 1 -- 172.21.15.82:0/3809207614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0162000 msgr2=0x7f29d006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.430+0000 7f29d6600700 1 --2- 172.21.15.82:0/3809207614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0162000 0x7f29d006ca80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0098f0 tx=0x7f29bc009c00 comp rx=0 tx=0).stop 2024-05-10T04:50:59.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.431+0000 7f29d6600700 1 -- 172.21.15.82:0/3809207614 shutdown_connections 2024-05-10T04:50:59.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.431+0000 7f29d6600700 1 --2- 172.21.15.82:0/3809207614 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0158c70 0x7f29d015ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.431+0000 7f29d6600700 1 --2- 172.21.15.82:0/3809207614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0162000 0x7f29d006ca80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.431+0000 7f29d6600700 1 -- 172.21.15.82:0/3809207614 >> 172.21.15.82:0/3809207614 conn(0x7f29d00d0d30 msgr2=0x7f29d00d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:59.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.431+0000 7f29d6600700 1 -- 172.21.15.82:0/3809207614 shutdown_connections 2024-05-10T04:50:59.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.431+0000 7f29d6600700 1 -- 172.21.15.82:0/3809207614 wait complete. 2024-05-10T04:50:59.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.433+0000 7f29d6600700 1 Processor -- start 2024-05-10T04:50:59.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.433+0000 7f29d6600700 1 -- start start 2024-05-10T04:50:59.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.434+0000 7f29d6600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d00b5c90 0x7f29d00cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.434+0000 7f29d6600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29d0158c70 0x7f29d015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.434+0000 7f29d6600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0162000 0x7f29d01f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.434+0000 7f29d6600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01453f0 con 0x7f29d00b5c90 2024-05-10T04:50:59.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.434+0000 7f29d6600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0146b50 con 0x7f29d0158c70 2024-05-10T04:50:59.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.434+0000 7f29d6600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01e8e40 con 0x7f29d0162000 2024-05-10T04:50:59.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d00b5c90 0x7f29d00cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d00b5c90 0x7f29d00cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52468/0 (socket says 172.21.15.82:52468) 2024-05-10T04:50:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 -- 172.21.15.82:0/1096956102 learned_addr learned my addr 172.21.15.82:0/1096956102 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cea00700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29d0158c70 0x7f29d015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cfe00700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0162000 0x7f29d01f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 -- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0162000 msgr2=0x7f29d01f8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0162000 0x7f29d01f8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 -- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29d0158c70 msgr2=0x7f29d015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29d0158c70 0x7f29d015d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 -- 172.21.15.82:0/1096956102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc009550 con 0x7f29d00b5c90 2024-05-10T04:50:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cea00700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29d0158c70 0x7f29d015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:50:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.435+0000 7f29cf400700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d00b5c90 0x7f29d00cd9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f29c000d800 tx=0x7f29c000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.436+0000 7f29c7400700 1 -- 172.21.15.82:0/1096956102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00125f0 con 0x7f29d00b5c90 2024-05-10T04:50:59.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.436+0000 7f29c7400700 1 -- 172.21.15.82:0/1096956102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c0012750 con 0x7f29d00b5c90 2024-05-10T04:50:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.436+0000 7f29c7400700 1 -- 172.21.15.82:0/1096956102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0012b00 con 0x7f29d00b5c90 2024-05-10T04:50:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.436+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d01e9090 con 0x7f29d00b5c90 2024-05-10T04:50:59.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.436+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d01e9650 con 0x7f29d00b5c90 2024-05-10T04:50:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.437+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d00732b0 con 0x7f29d00b5c90 2024-05-10T04:50:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.438+0000 7f29c7400700 1 -- 172.21.15.82:0/1096956102 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29c0012c60 con 0x7f29d00b5c90 2024-05-10T04:50:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.438+0000 7f29c7400700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f29b006acc0 0x7f29b006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.439+0000 7f29c7400700 1 -- 172.21.15.82:0/1096956102 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f29c00896c0 con 0x7f29d00b5c90 2024-05-10T04:50:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.439+0000 7f29cea00700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f29b006acc0 0x7f29b006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.439+0000 7f29cea00700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f29b006acc0 0x7f29b006d1d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009c40 tx=0x7f29bc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:59.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.444+0000 7f29c7400700 1 -- 172.21.15.82:0/1096956102 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f29c00546e0 con 0x7f29d00b5c90 2024-05-10T04:50:59.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.646+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29d0145530 con 0x7f29d00b5c90 2024-05-10T04:50:59.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.647+0000 7f29c7400700 1 -- 172.21.15.82:0/1096956102 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29d0145530 con 0x7f29d00b5c90 2024-05-10T04:50:59.648 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:50:59.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f29b006acc0 msgr2=0x7f29b006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f29b006acc0 0x7f29b006d1d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009c40 tx=0x7f29bc008030 comp rx=0 tx=0).stop 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d00b5c90 msgr2=0x7f29d00cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d00b5c90 0x7f29d00cd9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f29c000d800 tx=0x7f29c000dbc0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 shutdown_connections 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f29b006acc0 0x7f29b006d1d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f29d0162000 0x7f29d01f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d00b5c90 0x7f29d00cd9d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 --2- 172.21.15.82:0/1096956102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f29d0158c70 0x7f29d015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 >> 172.21.15.82:0/1096956102 conn(0x7f29d00d0d30 msgr2=0x7f29d00b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 shutdown_connections 2024-05-10T04:50:59.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.649+0000 7f29d6600700 1 -- 172.21.15.82:0/1096956102 wait complete. 2024-05-10T04:50:59.678 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:50:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.941+0000 7fdd93e00700 1 Processor -- start 2024-05-10T04:50:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.941+0000 7fdd93e00700 1 -- start start 2024-05-10T04:50:59.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd93e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd8c0b5c90 0x7fdd8c0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd93e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c06c5f0 con 0x7fdd8c15ea10 2024-05-10T04:50:59.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd93e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0b65e0 con 0x7fdd8c158c70 2024-05-10T04:50:59.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd93e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c15ee20 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd91e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd8c0b5c90 0x7fdd8c0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd90a00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdd8c15ea10 0x7fdd8c06ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33070/0 (socket says 172.21.15.82:33070) 2024-05-10T04:50:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd90a00700 1 -- 172.21.15.82:0/1884874841 learned_addr learned my addr 172.21.15.82:0/1884874841 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:50:59.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd91e00700 1 -- 172.21.15.82:0/1884874841 >> v1:172.21.15.129:6789/0 conn(0x7fdd8c158c70 legacy=0x7fdd8c162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.943+0000 7fdd91e00700 1 -- 172.21.15.82:0/1884874841 >> v1:172.21.15.82:6789/0 conn(0x7fdd8c15ea10 legacy=0x7fdd8c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.944+0000 7fdd91e00700 1 -- 172.21.15.82:0/1884874841 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c06d190 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.944+0000 7fdd8be00700 1 -- 172.21.15.82:0/1884874841 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158109985 0 0) 0x7fdd8c06c5f0 con 0x7fdd8c15ea10 2024-05-10T04:50:59.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.944+0000 7fdd91e00700 1 --2- 172.21.15.82:0/1884874841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c0b60a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009d90 tx=0x7fdd8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75482afe54de699d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:59.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.944+0000 7fdd8be00700 1 -- 172.21.15.82:0/1884874841 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400e070 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.944+0000 7fdd8be00700 1 -- 172.21.15.82:0/1884874841 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400bbd0 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.944+0000 7fdd8be00700 1 -- 172.21.15.82:0/1884874841 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84012430 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.945+0000 7fdd93e00700 1 -- 172.21.15.82:0/1884874841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 msgr2=0x7fdd8c0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.945+0000 7fdd93e00700 1 --2- 172.21.15.82:0/1884874841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c0b60a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009d90 tx=0x7fdd8400b330 comp rx=0 tx=0).stop 2024-05-10T04:50:59.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.945+0000 7fdd93e00700 1 -- 172.21.15.82:0/1884874841 shutdown_connections 2024-05-10T04:50:59.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.945+0000 7fdd93e00700 1 --2- 172.21.15.82:0/1884874841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c0b60a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.945+0000 7fdd93e00700 1 -- 172.21.15.82:0/1884874841 >> 172.21.15.82:0/1884874841 conn(0x7fdd8c0d0d30 msgr2=0x7fdd8c0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:50:59.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.945+0000 7fdd93e00700 1 -- 172.21.15.82:0/1884874841 shutdown_connections 2024-05-10T04:50:59.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.945+0000 7fdd93e00700 1 -- 172.21.15.82:0/1884874841 wait complete. 2024-05-10T04:50:59.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.948+0000 7fdd93e00700 1 Processor -- start 2024-05-10T04:50:59.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.948+0000 7fdd93e00700 1 -- start start 2024-05-10T04:50:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd93e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd93e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c158c70 0x7fdd8c0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd93e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c15ea10 0x7fdd8c0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd93e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c15c460 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd93e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c0cd5a0 con 0x7fdd8c15ea10 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd93e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1588b0 con 0x7fdd8c158c70 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52482/0 (socket says 172.21.15.82:52482) 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91400700 1 -- 172.21.15.82:0/2570617798 learned_addr learned my addr 172.21.15.82:0/2570617798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91e00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c15ea10 0x7fdd8c0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd90a00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c158c70 0x7fdd8c0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91400700 1 -- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c158c70 msgr2=0x7fdd8c0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91400700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c158c70 0x7fdd8c0cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91400700 1 -- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c15ea10 msgr2=0x7fdd8c0c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91400700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c15ea10 0x7fdd8c0c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:50:59.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91400700 1 -- 172.21.15.82:0/2570617798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009a70 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd91e00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c15ea10 0x7fdd8c0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.950+0000 7fdd90a00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c158c70 0x7fdd8c0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:50:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.951+0000 7fdd91400700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c158370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000c430 tx=0x7fdd8000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.951+0000 7fdd89600700 1 -- 172.21.15.82:0/2570617798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800052d0 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.951+0000 7fdd89600700 1 -- 172.21.15.82:0/2570617798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd80005430 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.951+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c0cf550 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.951+0000 7fdd89600700 1 -- 172.21.15.82:0/2570617798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800038c0 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.951+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c0cdad0 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.952+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c0732b0 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.953+0000 7fdd89600700 1 -- 172.21.15.82:0/2570617798 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdd80003a20 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.954+0000 7fdd89600700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:50:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.954+0000 7fdd89600700 1 -- 172.21.15.82:0/2570617798 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fdd800888c0 con 0x7fdd8c0b5c90 2024-05-10T04:50:59.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.954+0000 7fdd90a00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:50:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.955+0000 7fdd90a00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c1621a0 tx=0x7fdd78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:50:59.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:50:59.959+0000 7fdd89600700 1 -- 172.21.15.82:0/2570617798 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdd800538e0 con 0x7fdd8c0b5c90 2024-05-10T04:51:00.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.160+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd8c074af0 con 0x7fdd8c0b5c90 2024-05-10T04:51:00.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.160+0000 7fdd89600700 1 -- 172.21.15.82:0/2570617798 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd800170a0 con 0x7fdd8c0b5c90 2024-05-10T04:51:00.162 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:51:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 msgr2=0x7fdd6c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c1621a0 tx=0x7fdd78009040 comp rx=0 tx=0).stop 2024-05-10T04:51:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 msgr2=0x7fdd8c158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c158370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000c430 tx=0x7fdd8000c7f0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 shutdown_connections 2024-05-10T04:51:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c15ea10 0x7fdd8c0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c0b5c90 0x7fdd8c158370 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 --2- 172.21.15.82:0/2570617798 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c158c70 0x7fdd8c0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.162+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 >> 172.21.15.82:0/2570617798 conn(0x7fdd8c0d0d30 msgr2=0x7fdd8c0d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.163+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 shutdown_connections 2024-05-10T04:51:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.163+0000 7fdd93e00700 1 -- 172.21.15.82:0/2570617798 wait complete. 2024-05-10T04:51:00.191 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:51:00.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.453+0000 7ff79a200700 1 Processor -- start 2024-05-10T04:51:00.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.453+0000 7ff79a200700 1 -- start start 2024-05-10T04:51:00.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.455+0000 7ff79a200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7941678a0 0x7ff794169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.455+0000 7ff79a200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79406bd40 con 0x7ff7940ccca0 2024-05-10T04:51:00.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.455+0000 7ff79a200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79406c610 con 0x7ff79409b0d0 2024-05-10T04:51:00.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.455+0000 7ff79a200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79406c330 con 0x7ff7941678a0 2024-05-10T04:51:00.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.455+0000 7ff793400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff7940ccca0 0x7ff79406c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33084/0 (socket says 172.21.15.82:33084) 2024-05-10T04:51:00.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.455+0000 7ff793400700 1 -- 172.21.15.82:0/3512714716 learned_addr learned my addr 172.21.15.82:0/3512714716 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:00.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff793e00700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7941678a0 0x7ff794169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968499593 0 0) 0x7ff79406bd40 con 0x7ff7940ccca0 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7780035b0 con 0x7ff7940ccca0 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527716454 0 0) 0x7ff79406c610 con 0x7ff79409b0d0 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff79406bd40 con 0x7ff79409b0d0 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2251774370 0 0) 0x7ff7780035b0 con 0x7ff7940ccca0 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7941678a0 msgr2=0x7ff794169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7941678a0 0x7ff794169cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 >> v1:172.21.15.129:6789/0 conn(0x7ff79409b0d0 legacy=0x7ff7940d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940b7410 con 0x7ff7940ccca0 2024-05-10T04:51:00.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7ff7840017f0 con 0x7ff7940ccca0 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 >> v1:172.21.15.82:6789/0 conn(0x7ff7940ccca0 legacy=0x7ff79406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff778004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.456+0000 7ff792a00700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff778004850 0x7ff778004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff792a00700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7941678a0 0x7ff778005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79406c330 con 0x7ff778003bc0 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77800bb50 con 0x7ff778004850 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77800bd10 con 0x7ff7941678a0 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff793400700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff778004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff793e00700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7941678a0 0x7ff778005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff78be00700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff778004850 0x7ff778004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff793400700 1 -- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7941678a0 msgr2=0x7ff778005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff793400700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff7941678a0 0x7ff778005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff793400700 1 -- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff778004850 msgr2=0x7ff778004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff793400700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff778004850 0x7ff778004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff793400700 1 -- 172.21.15.82:0/3512714716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7780035b0 con 0x7ff778003bc0 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.457+0000 7ff793400700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff778004010 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c210 tx=0x7ff778005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548f5f27cf2456e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78400cd50 con 0x7ff778003bc0 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff784001c70 con 0x7ff778003bc0 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff792a00700 1 -- 172.21.15.82:0/3512714716 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784007310 con 0x7ff778003bc0 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff79a200700 1 -- 172.21.15.82:0/3512714716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 msgr2=0x7ff778004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff79a200700 1 --2- 172.21.15.82:0/3512714716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff778004010 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c210 tx=0x7ff778005880 comp rx=0 tx=0).stop 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff793e00700 1 -- 172.21.15.82:0/3512714716 reap_dead start 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff79a200700 1 -- 172.21.15.82:0/3512714716 shutdown_connections 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff79a200700 1 -- 172.21.15.82:0/3512714716 >> 172.21.15.82:0/3512714716 conn(0x7ff7940ce6c0 msgr2=0x7ff7940cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff79a200700 1 -- 172.21.15.82:0/3512714716 shutdown_connections 2024-05-10T04:51:00.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.458+0000 7ff79a200700 1 -- 172.21.15.82:0/3512714716 wait complete. 2024-05-10T04:51:00.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.461+0000 7ff79a200700 1 Processor -- start 2024-05-10T04:51:00.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.461+0000 7ff79a200700 1 -- start start 2024-05-10T04:51:00.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.462+0000 7ff79a200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff79414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.462+0000 7ff79a200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7940b0910 0x7ff7940b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.462+0000 7ff79a200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff794166b40 0x7ff794166f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.462+0000 7ff79a200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79414dc50 con 0x7ff778003bc0 2024-05-10T04:51:00.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.462+0000 7ff79a200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940b1430 con 0x7ff7940b0910 2024-05-10T04:51:00.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.462+0000 7ff79a200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79414fa70 con 0x7ff794166b40 2024-05-10T04:51:00.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff79414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff79414f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52498/0 (socket says 172.21.15.82:52498) 2024-05-10T04:51:00.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 -- 172.21.15.82:0/967991353 learned_addr learned my addr 172.21.15.82:0/967991353 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:00.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff78be00700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7940b0910 0x7ff7940b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793e00700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff794166b40 0x7ff794166f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 -- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff794166b40 msgr2=0x7ff794166f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff794166b40 0x7ff794166f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 -- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7940b0910 msgr2=0x7ff7940b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7940b0910 0x7ff7940b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 -- 172.21.15.82:0/967991353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940b2290 con 0x7ff778003bc0 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff78be00700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7940b0910 0x7ff7940b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.463+0000 7ff793400700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff79414f530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c800 tx=0x7ff784001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.464+0000 7ff78b400700 1 -- 172.21.15.82:0/967991353 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784005c40 con 0x7ff778003bc0 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.464+0000 7ff78b400700 1 -- 172.21.15.82:0/967991353 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff784005da0 con 0x7ff778003bc0 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.464+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7940b2720 con 0x7ff778003bc0 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.464+0000 7ff78b400700 1 -- 172.21.15.82:0/967991353 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784007310 con 0x7ff778003bc0 2024-05-10T04:51:00.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.464+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7940b1680 con 0x7ff778003bc0 2024-05-10T04:51:00.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.465+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff794074af0 con 0x7ff778003bc0 2024-05-10T04:51:00.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.466+0000 7ff78b400700 1 -- 172.21.15.82:0/967991353 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff784019070 con 0x7ff778003bc0 2024-05-10T04:51:00.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.467+0000 7ff78b400700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff77006acc0 0x7ff77006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.467+0000 7ff78b400700 1 -- 172.21.15.82:0/967991353 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff78408a680 con 0x7ff778003bc0 2024-05-10T04:51:00.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.467+0000 7ff78be00700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff77006acc0 0x7ff77006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.467+0000 7ff78be00700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff77006acc0 0x7ff77006d1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff7941f7440 tx=0x7ff77c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:00.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.471+0000 7ff78b400700 1 -- 172.21.15.82:0/967991353 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff784055860 con 0x7ff778003bc0 2024-05-10T04:51:00.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.674+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff7940ce070 con 0x7ff778003bc0 2024-05-10T04:51:00.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.674+0000 7ff78b400700 1 -- 172.21.15.82:0/967991353 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff784058e80 con 0x7ff778003bc0 2024-05-10T04:51:00.676 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:51:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff77006acc0 msgr2=0x7ff77006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff77006acc0 0x7ff77006d1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff7941f7440 tx=0x7ff77c009040 comp rx=0 tx=0).stop 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 msgr2=0x7ff79414f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff79414f530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c800 tx=0x7ff784001b00 comp rx=0 tx=0).stop 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 shutdown_connections 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff77006acc0 0x7ff77006d1d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff794166b40 0x7ff794166f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff778003bc0 0x7ff79414f530 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 --2- 172.21.15.82:0/967991353 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7940b0910 0x7ff7940b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 >> 172.21.15.82:0/967991353 conn(0x7ff7940ce6c0 msgr2=0x7ff7940ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 shutdown_connections 2024-05-10T04:51:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.677+0000 7ff79a200700 1 -- 172.21.15.82:0/967991353 wait complete. 2024-05-10T04:51:00.707 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create' 2024-05-10T04:51:00.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.969+0000 7f8fe4600700 1 Processor -- start 2024-05-10T04:51:00.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.969+0000 7f8fe4600700 1 -- start start 2024-05-10T04:51:00.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.970+0000 7f8fe4600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.970+0000 7f8fe4600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8fdc0b5dd0 0x7f8fdc0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.970+0000 7f8fe4600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc15f900 con 0x7f8fdc15bfe0 2024-05-10T04:51:00.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.970+0000 7f8fe4600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc15c3f0 con 0x7f8fdc0b5dd0 2024-05-10T04:51:00.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.970+0000 7f8fe4600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b61e0 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe2600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8fdc0b5dd0 0x7f8fdc0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe1c00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8fdc15bfe0 0x7f8fdc161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33090/0 (socket says 172.21.15.82:33090) 2024-05-10T04:51:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe1c00700 1 -- 172.21.15.82:0/2163021043 learned_addr learned my addr 172.21.15.82:0/2163021043 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe2600700 1 --2- 172.21.15.82:0/2163021043 >> v2:172.21.15.82:3300/0 conn(0x7f8fdc0b5dd0 0x7f8fdc0b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52500/0 (socket says 172.21.15.82:52500) 2024-05-10T04:51:00.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe1200700 1 --2- 172.21.15.82:0/2163021043 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe2600700 1 -- 172.21.15.82:0/2163021043 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc15f4f0 msgr2=0x7f8fdc0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:00.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe2600700 1 --2- 172.21.15.82:0/2163021043 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe2600700 1 -- 172.21.15.82:0/2163021043 >> v1:172.21.15.82:6789/0 conn(0x7f8fdc15bfe0 legacy=0x7f8fdc161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fe2600700 1 -- 172.21.15.82:0/2163021043 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc162a70 con 0x7f8fdc0b5dd0 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.971+0000 7f8fdbe00700 1 -- 172.21.15.82:0/2163021043 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453282546 0 0) 0x7f8fd0001110 con 0x7f8fdc15bfe0 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.972+0000 7f8fe2600700 1 --2- 172.21.15.82:0/2163021043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc0b5dd0 0x7f8fdc0b2890 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009d90 tx=0x7f8fd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cec0b1525e89ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.972+0000 7f8fdbe00700 1 -- 172.21.15.82:0/2163021043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400e070 con 0x7f8fdc0b5dd0 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.972+0000 7f8fdbe00700 1 -- 172.21.15.82:0/2163021043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd400bbd0 con 0x7f8fdc0b5dd0 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.972+0000 7f8fdbe00700 1 -- 172.21.15.82:0/2163021043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4012430 con 0x7f8fdc0b5dd0 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.972+0000 7f8fe4600700 1 -- 172.21.15.82:0/2163021043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc0b5dd0 msgr2=0x7f8fdc0b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.972+0000 7f8fe4600700 1 --2- 172.21.15.82:0/2163021043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc0b5dd0 0x7f8fdc0b2890 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009d90 tx=0x7f8fd400b330 comp rx=0 tx=0).stop 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.973+0000 7f8fe4600700 1 -- 172.21.15.82:0/2163021043 shutdown_connections 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.973+0000 7f8fe4600700 1 --2- 172.21.15.82:0/2163021043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc0b5dd0 0x7f8fdc0b2890 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.973+0000 7f8fe4600700 1 --2- 172.21.15.82:0/2163021043 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.973+0000 7f8fe4600700 1 -- 172.21.15.82:0/2163021043 >> 172.21.15.82:0/2163021043 conn(0x7f8fdc0d0a70 msgr2=0x7f8fdc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:00.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.973+0000 7f8fe4600700 1 -- 172.21.15.82:0/2163021043 shutdown_connections 2024-05-10T04:51:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.973+0000 7f8fe4600700 1 -- 172.21.15.82:0/2163021043 wait complete. 2024-05-10T04:51:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.975+0000 7f8fe4600700 1 Processor -- start 2024-05-10T04:51:00.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.975+0000 7f8fe4600700 1 -- start start 2024-05-10T04:51:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.976+0000 7f8fe4600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc0b5dd0 0x7f8fdc0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.976+0000 7f8fe4600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8fdc15bfe0 0x7f8fdc0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe4600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe4600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1f7530 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe4600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0cbe60 con 0x7f8fdc15bfe0 2024-05-10T04:51:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe4600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0cc950 con 0x7f8fdc0b5dd0 2024-05-10T04:51:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe2600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe2600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52506/0 (socket says 172.21.15.82:52506) 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe2600700 1 -- 172.21.15.82:0/1715824997 learned_addr learned my addr 172.21.15.82:0/1715824997 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe1c00700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc0b5dd0 0x7f8fdc0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe1200700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8fdc15bfe0 0x7f8fdc0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe2600700 1 -- 172.21.15.82:0/1715824997 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc0b5dd0 msgr2=0x7f8fdc0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe2600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc0b5dd0 0x7f8fdc0cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe2600700 1 -- 172.21.15.82:0/1715824997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8fdc15bfe0 msgr2=0x7f8fdc0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe2600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8fdc15bfe0 0x7f8fdc0b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.977+0000 7f8fe2600700 1 -- 172.21.15.82:0/1715824997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4009a70 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.978+0000 7f8fe2600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b8a90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4014040 tx=0x7f8fd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:00.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.978+0000 7f8fd9600700 1 -- 172.21.15.82:0/1715824997 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4012430 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.978+0000 7f8fd9600700 1 -- 172.21.15.82:0/1715824997 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4020070 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.978+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc1f5cf0 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.978+0000 7f8fd9600700 1 -- 172.21.15.82:0/1715824997 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4004280 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.978+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc0cc390 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.979+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc161710 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.980+0000 7f8fd9600700 1 -- 172.21.15.82:0/1715824997 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fd40043e0 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.981+0000 7f8fd9600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8fbc06ac90 0x7f8fbc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:00.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.981+0000 7f8fd9600700 1 -- 172.21.15.82:0/1715824997 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8fd4022070 con 0x7f8fdc15f4f0 2024-05-10T04:51:00.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.981+0000 7f8fe1c00700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8fbc06ac90 0x7f8fbc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:00.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.982+0000 7f8fe1c00700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8fbc06ac90 0x7f8fbc06d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0000f60 tx=0x7f8fd0007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:00.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:00.986+0000 7f8fd9600700 1 -- 172.21.15.82:0/1715824997 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8fd40563c0 con 0x7f8fdc15f4f0 2024-05-10T04:51:01.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.271+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]} v 0) v1 -- 0x7f8fdc15e9c0 con 0x7f8fdc15f4f0 2024-05-10T04:51:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.695+0000 7f8fd9600700 1 -- 172.21.15.82:0/1715824997 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]}]=0 v68) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8fd40599e0 con 0x7f8fdc15f4f0 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8fbc06ac90 msgr2=0x7f8fbc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8fbc06ac90 0x7f8fbc06d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0000f60 tx=0x7f8fd0007c90 comp rx=0 tx=0).stop 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc15f4f0 msgr2=0x7f8fdc0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b8a90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4014040 tx=0x7f8fd4004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 shutdown_connections 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8fbc06ac90 0x7f8fbc06d1a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fdc15f4f0 0x7f8fdc0b8a90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8fdc0b5dd0 0x7f8fdc0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 --2- 172.21.15.82:0/1715824997 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8fdc15bfe0 0x7f8fdc0b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 >> 172.21.15.82:0/1715824997 conn(0x7f8fdc0d0a70 msgr2=0x7f8fdc06c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 shutdown_connections 2024-05-10T04:51:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.698+0000 7f8fe4600700 1 -- 172.21.15.82:0/1715824997 wait complete. 2024-05-10T04:51:01.725 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-10T04:51:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.992+0000 7ff765e00700 1 Processor -- start 2024-05-10T04:51:01.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.992+0000 7ff765e00700 1 -- start start 2024-05-10T04:51:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.993+0000 7ff765e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 0x7ff76015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff765e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff76006c160 0x7ff76006c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff765e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7600d2c00 con 0x7ff7600cf4d0 2024-05-10T04:51:01.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff765e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76006cab0 con 0x7ff76006c160 2024-05-10T04:51:01.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff765e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff760162630 con 0x7ff760162150 2024-05-10T04:51:01.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75f400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff76006c160 0x7ff76006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:01.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75e000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff7600cf4d0 0x7ff7600b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33104/0 (socket says 172.21.15.82:33104) 2024-05-10T04:51:01.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75e000700 1 -- 172.21.15.82:0/3870262961 learned_addr learned my addr 172.21.15.82:0/3870262961 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:01.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75f400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff76006c160 0x7ff76006c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52522/0 (socket says 172.21.15.82:52522) 2024-05-10T04:51:01.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75ea00700 1 --2- 172.21.15.82:0/3870262961 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 0x7ff76015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75f400700 1 -- 172.21.15.82:0/3870262961 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 msgr2=0x7ff76015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:02.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75f400700 1 --2- 172.21.15.82:0/3870262961 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 0x7ff76015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75f400700 1 -- 172.21.15.82:0/3870262961 >> v1:172.21.15.82:6789/0 conn(0x7ff7600cf4d0 legacy=0x7ff7600b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75f400700 1 -- 172.21.15.82:0/3870262961 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff760162910 con 0x7ff76006c160 2024-05-10T04:51:02.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.994+0000 7ff75d600700 1 -- 172.21.15.82:0/3870262961 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121933366 0 0) 0x7ff7600d2c00 con 0x7ff7600cf4d0 2024-05-10T04:51:02.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.995+0000 7ff75f400700 1 --2- 172.21.15.82:0/3870262961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff76006c570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff758009d90 tx=0x7ff75800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b6552a404c2351 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:02.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.995+0000 7ff75d600700 1 -- 172.21.15.82:0/3870262961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800e070 con 0x7ff76006c160 2024-05-10T04:51:02.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.995+0000 7ff75d600700 1 -- 172.21.15.82:0/3870262961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75800bbd0 con 0x7ff76006c160 2024-05-10T04:51:02.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.995+0000 7ff75d600700 1 -- 172.21.15.82:0/3870262961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758012430 con 0x7ff76006c160 2024-05-10T04:51:02.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.996+0000 7ff765e00700 1 -- 172.21.15.82:0/3870262961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 msgr2=0x7ff76006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.996+0000 7ff765e00700 1 --2- 172.21.15.82:0/3870262961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff76006c570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff758009d90 tx=0x7ff75800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:02.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.996+0000 7ff765e00700 1 -- 172.21.15.82:0/3870262961 shutdown_connections 2024-05-10T04:51:02.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.996+0000 7ff765e00700 1 --2- 172.21.15.82:0/3870262961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff76006c570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.996+0000 7ff765e00700 1 --2- 172.21.15.82:0/3870262961 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 0x7ff76015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.996+0000 7ff765e00700 1 -- 172.21.15.82:0/3870262961 >> 172.21.15.82:0/3870262961 conn(0x7ff7600d3e10 msgr2=0x7ff7600d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:02.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.996+0000 7ff765e00700 1 -- 172.21.15.82:0/3870262961 shutdown_connections 2024-05-10T04:51:02.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.996+0000 7ff765e00700 1 -- 172.21.15.82:0/3870262961 wait complete. 2024-05-10T04:51:02.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.999+0000 7ff765e00700 1 Processor -- start 2024-05-10T04:51:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:01.999+0000 7ff765e00700 1 -- start start 2024-05-10T04:51:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.000+0000 7ff765e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff7600cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.000+0000 7ff765e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7600cf4d0 0x7ff76014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.000+0000 7ff765e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 0x7ff76014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff765e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600b0490 con 0x7ff76006c160 2024-05-10T04:51:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff765e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600ab840 con 0x7ff7600cf4d0 2024-05-10T04:51:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff765e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600ad380 con 0x7ff760162150 2024-05-10T04:51:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff7600cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff7600cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52538/0 (socket says 172.21.15.82:52538) 2024-05-10T04:51:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 -- 172.21.15.82:0/2870479251 learned_addr learned my addr 172.21.15.82:0/2870479251 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75f400700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 0x7ff76014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75e000700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7600cf4d0 0x7ff76014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 -- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 msgr2=0x7ff76014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 0x7ff76014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 -- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7600cf4d0 msgr2=0x7ff76014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7600cf4d0 0x7ff76014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 -- 172.21.15.82:0/2870479251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758009a70 con 0x7ff76006c160 2024-05-10T04:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75e000700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7600cf4d0 0x7ff76014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.001+0000 7ff75ea00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff7600cde20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff75000d7d0 tx=0x7ff75000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.002+0000 7ff757400700 1 -- 172.21.15.82:0/2870479251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500125f0 con 0x7ff76006c160 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.002+0000 7ff757400700 1 -- 172.21.15.82:0/2870479251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff750012750 con 0x7ff76006c160 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.002+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7600ad110 con 0x7ff76006c160 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.002+0000 7ff757400700 1 -- 172.21.15.82:0/2870479251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750012ac0 con 0x7ff76006c160 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.002+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7600b1a40 con 0x7ff76006c160 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.003+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff760074af0 con 0x7ff76006c160 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.004+0000 7ff757400700 1 -- 172.21.15.82:0/2870479251 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff750012c20 con 0x7ff76006c160 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.004+0000 7ff757400700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff74006ac90 0x7ff74006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.005+0000 7ff757400700 1 -- 172.21.15.82:0/2870479251 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff750089870 con 0x7ff76006c160 2024-05-10T04:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.005+0000 7ff75e000700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff74006ac90 0x7ff74006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.006+0000 7ff75e000700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff74006ac90 0x7ff74006d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff76014c540 tx=0x7ff74c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:02.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.010+0000 7ff757400700 1 -- 172.21.15.82:0/2870479251 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff750054890 con 0x7ff76006c160 2024-05-10T04:51:02.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.211+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff7600b3550 con 0x7ff76006c160 2024-05-10T04:51:02.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.216+0000 7ff757400700 1 -- 172.21.15.82:0/2870479251 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff750012ed0 con 0x7ff76006c160 2024-05-10T04:51:02.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.218+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff74006ac90 msgr2=0x7ff74006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.218+0000 7ff765e00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff74006ac90 0x7ff74006d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff76014c540 tx=0x7ff74c009040 comp rx=0 tx=0).stop 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 msgr2=0x7ff7600cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff7600cde20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff75000d7d0 tx=0x7ff75000db90 comp rx=0 tx=0).stop 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 shutdown_connections 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff74006ac90 0x7ff74006d1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff760162150 0x7ff76014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff76006c160 0x7ff7600cde20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 --2- 172.21.15.82:0/2870479251 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff7600cf4d0 0x7ff76014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 >> 172.21.15.82:0/2870479251 conn(0x7ff7600d3e10 msgr2=0x7ff7600b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 shutdown_connections 2024-05-10T04:51:02.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.219+0000 7ff765e00700 1 -- 172.21.15.82:0/2870479251 wait complete. 2024-05-10T04:51:02.245 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T04:51:02.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T04:51:02.329 DEBUG:teuthology.orchestra.run.smithi129:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T04:51:02.429 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T04:51:02.429 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:51:02.429 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:02.474 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:51:02.474 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:02.561 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:51:02.561 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:02.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:02.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.947+0000 7fc290800700 1 Processor -- start 2024-05-10T04:51:02.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.947+0000 7fc290800700 1 -- start start 2024-05-10T04:51:02.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.949+0000 7fc290800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880b2b90 0x7fc28815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.949+0000 7fc290800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2880b6090 0x7fc2880d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.949+0000 7fc290800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2881620a0 con 0x7fc2880cf800 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.949+0000 7fc290800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc288162c20 con 0x7fc2880b6090 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.949+0000 7fc290800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28815e9f0 con 0x7fc2880b2b90 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.949+0000 7fc28e800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2880b6090 0x7fc2880d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.949+0000 7fc28d400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc2880cf800 0x7fc2880b5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33110/0 (socket says 172.21.15.82:33110) 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28d400700 1 -- 172.21.15.82:0/1978325315 learned_addr learned my addr 172.21.15.82:0/1978325315 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28de00700 1 --2- 172.21.15.82:0/1978325315 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880b2b90 0x7fc28815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28e800700 1 -- 172.21.15.82:0/1978325315 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880b2b90 msgr2=0x7fc28815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28e800700 1 --2- 172.21.15.82:0/1978325315 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880b2b90 0x7fc28815e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28e800700 1 -- 172.21.15.82:0/1978325315 >> v1:172.21.15.82:6789/0 conn(0x7fc2880cf800 legacy=0x7fc2880b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28e800700 1 -- 172.21.15.82:0/1978325315 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2881622f0 con 0x7fc2880b6090 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28ca00700 1 -- 172.21.15.82:0/1978325315 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415253248 0 0) 0x7fc2881620a0 con 0x7fc2880cf800 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28de00700 1 --2- 172.21.15.82:0/1978325315 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880b2b90 0x7fc28815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28e800700 1 --2- 172.21.15.82:0/1978325315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2880b6090 0x7fc2880d2990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc284009d90 tx=0x7fc28400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf783a535e9c683a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:02.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.950+0000 7fc28ca00700 1 -- 172.21.15.82:0/1978325315 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28400e070 con 0x7fc2880b6090 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc28ca00700 1 -- 172.21.15.82:0/1978325315 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28400bbd0 con 0x7fc2880b6090 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc28ca00700 1 -- 172.21.15.82:0/1978325315 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284012430 con 0x7fc2880b6090 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc290800700 1 -- 172.21.15.82:0/1978325315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2880b6090 msgr2=0x7fc2880d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc290800700 1 --2- 172.21.15.82:0/1978325315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2880b6090 0x7fc2880d2990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc284009d90 tx=0x7fc28400b330 comp rx=0 tx=0).stop 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc290800700 1 -- 172.21.15.82:0/1978325315 shutdown_connections 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc290800700 1 --2- 172.21.15.82:0/1978325315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2880b6090 0x7fc2880d2990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc290800700 1 --2- 172.21.15.82:0/1978325315 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880b2b90 0x7fc28815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc290800700 1 -- 172.21.15.82:0/1978325315 >> 172.21.15.82:0/1978325315 conn(0x7fc2880d0b60 msgr2=0x7fc2880d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc290800700 1 -- 172.21.15.82:0/1978325315 shutdown_connections 2024-05-10T04:51:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.951+0000 7fc290800700 1 -- 172.21.15.82:0/1978325315 wait complete. 2024-05-10T04:51:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.954+0000 7fc290800700 1 Processor -- start 2024-05-10T04:51:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.954+0000 7fc290800700 1 -- start start 2024-05-10T04:51:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.955+0000 7fc290800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2880b2b90 0x7fc2880c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.955+0000 7fc290800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880cf800 0x7fc2881f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.955+0000 7fc290800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc288160770 0x7fc2880cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.955+0000 7fc290800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880c8810 con 0x7fc288160770 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.955+0000 7fc290800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880ca200 con 0x7fc2880b2b90 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.955+0000 7fc290800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881602e0 con 0x7fc2880cf800 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc288160770 0x7fc2880cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc288160770 0x7fc2880cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52558/0 (socket says 172.21.15.82:52558) 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 -- 172.21.15.82:0/379691753 learned_addr learned my addr 172.21.15.82:0/379691753 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28de00700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2880b2b90 0x7fc2880c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28d400700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880cf800 0x7fc2881f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 -- 172.21.15.82:0/379691753 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880cf800 msgr2=0x7fc2881f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880cf800 0x7fc2881f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 -- 172.21.15.82:0/379691753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2880b2b90 msgr2=0x7fc2880c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2880b2b90 0x7fc2880c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 -- 172.21.15.82:0/379691753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284009a70 con 0x7fc288160770 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.956+0000 7fc28e800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc288160770 0x7fc2880cd490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc28400b370 tx=0x7fc284004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.957+0000 7fc282000700 1 -- 172.21.15.82:0/379691753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284012430 con 0x7fc288160770 2024-05-10T04:51:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.957+0000 7fc282000700 1 -- 172.21.15.82:0/379691753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284020070 con 0x7fc288160770 2024-05-10T04:51:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.957+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2880cd9d0 con 0x7fc288160770 2024-05-10T04:51:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.957+0000 7fc282000700 1 -- 172.21.15.82:0/379691753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284004260 con 0x7fc288160770 2024-05-10T04:51:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.957+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28815fc90 con 0x7fc288160770 2024-05-10T04:51:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.958+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2880732b0 con 0x7fc288160770 2024-05-10T04:51:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.959+0000 7fc282000700 1 -- 172.21.15.82:0/379691753 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc2840043c0 con 0x7fc288160770 2024-05-10T04:51:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.959+0000 7fc282000700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc26c06ac90 0x7fc26c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.960+0000 7fc282000700 1 -- 172.21.15.82:0/379691753 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc284022070 con 0x7fc288160770 2024-05-10T04:51:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.960+0000 7fc28de00700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc26c06ac90 0x7fc26c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:02.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.960+0000 7fc28de00700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc26c06ac90 0x7fc26c06d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00c900 tx=0x7fc27c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:02.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:02.964+0000 7fc282000700 1 -- 172.21.15.82:0/379691753 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc2840567a0 con 0x7fc288160770 2024-05-10T04:51:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.170+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc288074af0 con 0x7fc288160770 2024-05-10T04:51:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.171+0000 7fc282000700 1 -- 172.21.15.82:0/379691753 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16333 (secure 0 0 0) 0x7fc284059dc0 con 0x7fc288160770 2024-05-10T04:51:03.173 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:03.173 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:58.666687+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:03.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.173+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc26c06ac90 msgr2=0x7fc26c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.173+0000 7fc290800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc26c06ac90 0x7fc26c06d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00c900 tx=0x7fc27c008040 comp rx=0 tx=0).stop 2024-05-10T04:51:03.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.173+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc288160770 msgr2=0x7fc2880cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.173+0000 7fc290800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc288160770 0x7fc2880cd490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc28400b370 tx=0x7fc284004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.173+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 shutdown_connections 2024-05-10T04:51:03.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.173+0000 7fc290800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc26c06ac90 0x7fc26c06d1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.173+0000 7fc290800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc288160770 0x7fc2880cd490 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.174+0000 7fc290800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc2880b2b90 0x7fc2880c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.174+0000 7fc290800700 1 --2- 172.21.15.82:0/379691753 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc2880cf800 0x7fc2881f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.174+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 >> 172.21.15.82:0/379691753 conn(0x7fc2880d0b60 msgr2=0x7fc2880b9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:03.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.174+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 shutdown_connections 2024-05-10T04:51:03.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.174+0000 7fc290800700 1 -- 172.21.15.82:0/379691753 wait complete. 2024-05-10T04:51:03.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:51:03.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:51:03.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.467+0000 7f1836000700 1 Processor -- start 2024-05-10T04:51:03.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.467+0000 7f1836000700 1 -- start start 2024-05-10T04:51:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.469+0000 7f1836000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18300b47e0 0x7f18300cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.469+0000 7f1836000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f183006e800 0x7f183006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.469+0000 7f1836000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183015c4e0 con 0x7f183015b9c0 2024-05-10T04:51:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.469+0000 7f1836000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183015c710 con 0x7f183006e800 2024-05-10T04:51:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.469+0000 7f1836000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18300cf940 con 0x7f18300b47e0 2024-05-10T04:51:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.469+0000 7f182fe00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f183015b9c0 0x7f183015bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33112/0 (socket says 172.21.15.82:33112) 2024-05-10T04:51:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.469+0000 7f182fe00700 1 -- 172.21.15.82:0/3289036047 learned_addr learned my addr 172.21.15.82:0/3289036047 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:03.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182ea00700 1 --2- 172.21.15.82:0/3289036047 >> v2:172.21.15.129:3300/0 conn(0x7f183006e800 0x7f183006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499427047 0 0) 0x7f183015c4e0 con 0x7f183015b9c0 2024-05-10T04:51:03.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182f400700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18300b47e0 0x7f18300cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18140035b0 con 0x7f183015b9c0 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2332113228 0 0) 0x7f18140035b0 con 0x7f183015b9c0 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18300b47e0 msgr2=0x7f18300cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18300b47e0 0x7f18300cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 >> v2:172.21.15.129:3300/0 conn(0x7f183006e800 msgr2=0x7f183006ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 --2- 172.21.15.82:0/3289036047 >> v2:172.21.15.129:3300/0 conn(0x7f183006e800 0x7f183006ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183006f150 con 0x7f183015b9c0 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f18280019f0 con 0x7f183015b9c0 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 >> v1:172.21.15.82:6789/0 conn(0x7f183015b9c0 legacy=0x7f183015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1814003a00 0x7f1814003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814004850 0x7f1814004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18300b47e0 0x7f18140051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183015c710 con 0x7f1814003a00 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300cf940 con 0x7f1814004850 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.470+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181400dc20 con 0x7f18300b47e0 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182f400700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1814003a00 0x7f1814003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182fe00700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18300b47e0 0x7f18140051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182ea00700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814004850 0x7f1814004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182f400700 1 -- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18300b47e0 msgr2=0x7f18140051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182f400700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18300b47e0 0x7f18140051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182f400700 1 -- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814004850 msgr2=0x7f1814004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182f400700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814004850 0x7f1814004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182f400700 1 -- 172.21.15.82:0/3289036047 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140035b0 con 0x7f1814003a00 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.471+0000 7f182f400700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1814003a00 0x7f1814003e70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1820009b60 tx=0x7f1814005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94eb8e2915d87726 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.472+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000e6c0 con 0x7f1814003a00 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.472+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000e820 con 0x7f1814003a00 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.472+0000 7f182e000700 1 -- 172.21.15.82:0/3289036047 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000eb90 con 0x7f1814003a00 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.472+0000 7f1836000700 1 -- 172.21.15.82:0/3289036047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1814003a00 msgr2=0x7f1814003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.472+0000 7f1836000700 1 --2- 172.21.15.82:0/3289036047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1814003a00 0x7f1814003e70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1820009b60 tx=0x7f1814005880 comp rx=0 tx=0).stop 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.472+0000 7f182fe00700 1 -- 172.21.15.82:0/3289036047 reap_dead start 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.472+0000 7f1836000700 1 -- 172.21.15.82:0/3289036047 shutdown_connections 2024-05-10T04:51:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.472+0000 7f1836000700 1 -- 172.21.15.82:0/3289036047 >> 172.21.15.82:0/3289036047 conn(0x7f18300b1830 msgr2=0x7f18300b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:03.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.473+0000 7f1836000700 1 -- 172.21.15.82:0/3289036047 shutdown_connections 2024-05-10T04:51:03.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.473+0000 7f1836000700 1 -- 172.21.15.82:0/3289036047 wait complete. 2024-05-10T04:51:03.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.475+0000 7f1836000700 1 Processor -- start 2024-05-10T04:51:03.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.476+0000 7f1836000700 1 -- start start 2024-05-10T04:51:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.477+0000 7f1836000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814003a00 0x7f183014cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.477+0000 7f1836000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18301f4f90 0x7f18301f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.477+0000 7f1836000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18301f7df0 0x7f1830150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.477+0000 7f1836000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301f4b70 con 0x7f18301f7df0 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.477+0000 7f1836000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300c5910 con 0x7f1814003a00 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.477+0000 7f1836000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18301f8350 con 0x7f18301f4f90 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18301f7df0 0x7f1830150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18301f7df0 0x7f1830150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52582/0 (socket says 172.21.15.82:52582) 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 -- 172.21.15.82:0/812098029 learned_addr learned my addr 172.21.15.82:0/812098029 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182f400700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814003a00 0x7f183014cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182ea00700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18301f4f90 0x7f18301f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 -- 172.21.15.82:0/812098029 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18301f4f90 msgr2=0x7f18301f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18301f4f90 0x7f18301f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 -- 172.21.15.82:0/812098029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814003a00 msgr2=0x7f183014cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814003a00 0x7f183014cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 -- 172.21.15.82:0/812098029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18301f4240 con 0x7f18301f7df0 2024-05-10T04:51:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.478+0000 7f182fe00700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18301f7df0 0x7f1830150810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f183015f180 tx=0x7f182800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.479+0000 7f1827400700 1 -- 172.21.15.82:0/812098029 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800adb0 con 0x7f18301f7df0 2024-05-10T04:51:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.479+0000 7f1827400700 1 -- 172.21.15.82:0/812098029 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18280133f0 con 0x7f18301f7df0 2024-05-10T04:51:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.479+0000 7f1827400700 1 -- 172.21.15.82:0/812098029 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18280137a0 con 0x7f18301f7df0 2024-05-10T04:51:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.479+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183014d4e0 con 0x7f18301f7df0 2024-05-10T04:51:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.479+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18301f44b0 con 0x7f18301f7df0 2024-05-10T04:51:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.480+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830074af0 con 0x7f18301f7df0 2024-05-10T04:51:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.481+0000 7f1827400700 1 -- 172.21.15.82:0/812098029 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1828013900 con 0x7f18301f7df0 2024-05-10T04:51:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.482+0000 7f1827400700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f181006ac90 0x7f181006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.482+0000 7f1827400700 1 -- 172.21.15.82:0/812098029 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f182808a7f0 con 0x7f18301f7df0 2024-05-10T04:51:03.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.482+0000 7f182f400700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f181006ac90 0x7f181006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.483+0000 7f182f400700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f181006ac90 0x7f181006d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18200090b0 tx=0x7f1820008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.485+0000 7f1827400700 1 -- 172.21.15.82:0/812098029 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1828055920 con 0x7f18301f7df0 2024-05-10T04:51:03.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.692+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18300cee40 con 0x7f18301f7df0 2024-05-10T04:51:03.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.692+0000 7f1827400700 1 -- 172.21.15.82:0/812098029 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1828058f40 con 0x7f18301f7df0 2024-05-10T04:51:03.694 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f181006ac90 msgr2=0x7f181006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f181006ac90 0x7f181006d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18200090b0 tx=0x7f1820008030 comp rx=0 tx=0).stop 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18301f7df0 msgr2=0x7f1830150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18301f7df0 0x7f1830150810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f183015f180 tx=0x7f182800a640 comp rx=0 tx=0).stop 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 shutdown_connections 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f181006ac90 0x7f181006d1a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18301f7df0 0x7f1830150810 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1814003a00 0x7f183014cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 --2- 172.21.15.82:0/812098029 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f18301f4f90 0x7f18301f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 >> 172.21.15.82:0/812098029 conn(0x7f18300b1830 msgr2=0x7f183006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 shutdown_connections 2024-05-10T04:51:03.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.695+0000 7f1836000700 1 -- 172.21.15.82:0/812098029 wait complete. 2024-05-10T04:51:03.723 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:51:03.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.986+0000 7fb03d000700 1 Processor -- start 2024-05-10T04:51:03.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.986+0000 7fb03d000700 1 -- start start 2024-05-10T04:51:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb03d000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb038162150 0x7fb03815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb03d000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb0380cf4d0 0x7fb0380b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb03d000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0380b7910 0x7fb03806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb03d000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0380d2c00 con 0x7fb038162150 2024-05-10T04:51:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb03d000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb038162630 con 0x7fb0380cf4d0 2024-05-10T04:51:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb03d000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb038162910 con 0x7fb0380b7910 2024-05-10T04:51:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb035e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb038162150 0x7fb03815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb035e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb038162150 0x7fb03815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52594/0 (socket says 172.21.15.82:52594) 2024-05-10T04:51:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb035e00700 1 -- 172.21.15.82:0/2728102122 learned_addr learned my addr 172.21.15.82:0/2728102122 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:03.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb035400700 1 --2- 172.21.15.82:0/2728102122 >> v2:172.21.15.129:3300/0 conn(0x7fb0380cf4d0 0x7fb0380b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.988+0000 7fb036800700 1 --2- 172.21.15.82:0/2728102122 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0380b7910 0x7fb03806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb035e00700 1 -- 172.21.15.82:0/2728102122 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0380b7910 msgr2=0x7fb03806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb035e00700 1 --2- 172.21.15.82:0/2728102122 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0380b7910 0x7fb03806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb035e00700 1 -- 172.21.15.82:0/2728102122 >> v2:172.21.15.129:3300/0 conn(0x7fb0380cf4d0 msgr2=0x7fb0380b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb035e00700 1 --2- 172.21.15.82:0/2728102122 >> v2:172.21.15.129:3300/0 conn(0x7fb0380cf4d0 0x7fb0380b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb035e00700 1 -- 172.21.15.82:0/2728102122 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038162bf0 con 0x7fb038162150 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb035e00700 1 --2- 172.21.15.82:0/2728102122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038162150 0x7fb03815e610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0280098f0 tx=0x7fb028009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6fdb66e99e8504 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb034a00700 1 -- 172.21.15.82:0/2728102122 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800b860 con 0x7fb038162150 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb034a00700 1 -- 172.21.15.82:0/2728102122 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02800b9c0 con 0x7fb038162150 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.989+0000 7fb034a00700 1 -- 172.21.15.82:0/2728102122 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800bd50 con 0x7fb038162150 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 -- 172.21.15.82:0/2728102122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038162150 msgr2=0x7fb03815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 --2- 172.21.15.82:0/2728102122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038162150 0x7fb03815e610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0280098f0 tx=0x7fb028009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 -- 172.21.15.82:0/2728102122 shutdown_connections 2024-05-10T04:51:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 --2- 172.21.15.82:0/2728102122 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0380b7910 0x7fb03806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 --2- 172.21.15.82:0/2728102122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038162150 0x7fb03815e610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 --2- 172.21.15.82:0/2728102122 >> v2:172.21.15.129:3300/0 conn(0x7fb0380cf4d0 0x7fb0380b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 -- 172.21.15.82:0/2728102122 >> 172.21.15.82:0/2728102122 conn(0x7fb0380d3e10 msgr2=0x7fb0380d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:03.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 -- 172.21.15.82:0/2728102122 shutdown_connections 2024-05-10T04:51:03.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.990+0000 7fb03d000700 1 -- 172.21.15.82:0/2728102122 wait complete. 2024-05-10T04:51:03.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.992+0000 7fb03d000700 1 Processor -- start 2024-05-10T04:51:03.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.993+0000 7fb03d000700 1 -- start start 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb03d000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0380b7910 0x7fb0381f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb03d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0380cf4d0 0x7fb0381e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb03d000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb038162150 0x7fb038150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb03d000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0381f50d0 con 0x7fb0380cf4d0 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb03d000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0381566c0 con 0x7fb0380b7910 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb03d000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0381e93b0 con 0x7fb038162150 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb035400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0380cf4d0 0x7fb0381e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb035400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0380cf4d0 0x7fb0381e8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52598/0 (socket says 172.21.15.82:52598) 2024-05-10T04:51:03.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.994+0000 7fb035400700 1 -- 172.21.15.82:0/1257408777 learned_addr learned my addr 172.21.15.82:0/1257408777 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb035e00700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0380b7910 0x7fb0381f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb036800700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb038162150 0x7fb038150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb035400700 1 -- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb038162150 msgr2=0x7fb038150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb035400700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb038162150 0x7fb038150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb035400700 1 -- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0380b7910 msgr2=0x7fb0381f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb035400700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0380b7910 0x7fb0381f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb035400700 1 -- 172.21.15.82:0/1257408777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb028009550 con 0x7fb0380cf4d0 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb036800700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb038162150 0x7fb038150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb035400700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0380cf4d0 0x7fb0381e8e70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb02400d7d0 tx=0x7fb02400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb02e000700 1 -- 172.21.15.82:0/1257408777 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0240125f0 con 0x7fb0380cf4d0 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb02e000700 1 -- 172.21.15.82:0/1257408777 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024012750 con 0x7fb0380cf4d0 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb038155ab0 con 0x7fb0380cf4d0 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.995+0000 7fb02e000700 1 -- 172.21.15.82:0/1257408777 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024012ae0 con 0x7fb0380cf4d0 2024-05-10T04:51:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.996+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb038156070 con 0x7fb0380cf4d0 2024-05-10T04:51:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.996+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb038074af0 con 0x7fb0380cf4d0 2024-05-10T04:51:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.997+0000 7fb02e000700 1 -- 172.21.15.82:0/1257408777 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb024012c40 con 0x7fb0380cf4d0 2024-05-10T04:51:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.998+0000 7fb02e000700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01806ac90 0x7fb01806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:04.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.998+0000 7fb02e000700 1 -- 172.21.15.82:0/1257408777 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb024089550 con 0x7fb0380cf4d0 2024-05-10T04:51:04.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.999+0000 7fb035e00700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01806ac90 0x7fb01806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:04.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:03.999+0000 7fb035e00700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01806ac90 0x7fb01806d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb0280098f0 tx=0x7fb028008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:04.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.003+0000 7fb02e000700 1 -- 172.21.15.82:0/1257408777 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb024054570 con 0x7fb0380cf4d0 2024-05-10T04:51:04.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.211+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb038161ec0 con 0x7fb0380cf4d0 2024-05-10T04:51:04.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.211+0000 7fb02e000700 1 -- 172.21.15.82:0/1257408777 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb024057b90 con 0x7fb0380cf4d0 2024-05-10T04:51:04.213 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:51:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01806ac90 msgr2=0x7fb01806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01806ac90 0x7fb01806d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb0280098f0 tx=0x7fb028008030 comp rx=0 tx=0).stop 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0380cf4d0 msgr2=0x7fb0381e8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0380cf4d0 0x7fb0381e8e70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb02400d7d0 tx=0x7fb02400dae0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 shutdown_connections 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb01806ac90 0x7fb01806d1a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb038162150 0x7fb038150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0380b7910 0x7fb0381f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 --2- 172.21.15.82:0/1257408777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0380cf4d0 0x7fb0381e8e70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 >> 172.21.15.82:0/1257408777 conn(0x7fb0380d3e10 msgr2=0x7fb03815a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 shutdown_connections 2024-05-10T04:51:04.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.214+0000 7fb03d000700 1 -- 172.21.15.82:0/1257408777 wait complete. 2024-05-10T04:51:04.241 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:51:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.504+0000 7fc68f000700 1 Processor -- start 2024-05-10T04:51:04.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.504+0000 7fc68f000700 1 -- start start 2024-05-10T04:51:04.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.506+0000 7fc68f000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc68806ef10 0x7fc6880cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.506+0000 7fc68f000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc68815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.506+0000 7fc68f000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6880ce3a0 con 0x7fc6880b47e0 2024-05-10T04:51:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.506+0000 7fc68f000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68815c710 con 0x7fc68806ef10 2024-05-10T04:51:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.506+0000 7fc68f000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880cf940 con 0x7fc68815b9c0 2024-05-10T04:51:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.506+0000 7fc67fe00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc68806ef10 0x7fc6880cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:04.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.506+0000 7fc68d000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc68815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc68d000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc68815bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:33486/0 (socket says 172.21.15.82:33486) 2024-05-10T04:51:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc68d000700 1 -- 172.21.15.82:0/1035370653 learned_addr learned my addr 172.21.15.82:0/1035370653 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc687e00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc6880b47e0 0x7fc68806e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:44432/0 (socket says 172.21.15.82:44432) 2024-05-10T04:51:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc67fe00700 1 -- 172.21.15.82:0/1035370653 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 msgr2=0x7fc68815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc67fe00700 1 --2- 172.21.15.82:0/1035370653 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc68815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc67fe00700 1 -- 172.21.15.82:0/1035370653 >> v1:172.21.15.129:6789/0 conn(0x7fc6880b47e0 legacy=0x7fc68806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc67fe00700 1 -- 172.21.15.82:0/1035370653 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880b4bf0 con 0x7fc68806ef10 2024-05-10T04:51:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc68d000700 1 --2- 172.21.15.82:0/1035370653 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc68815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.507+0000 7fc687400700 1 -- 172.21.15.82:0/1035370653 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438323249 0 0) 0x7fc6880ce3a0 con 0x7fc6880b47e0 2024-05-10T04:51:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.508+0000 7fc67fe00700 1 --2- 172.21.15.82:0/1035370653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc68806ef10 0x7fc6880cf400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc670009840 tx=0x7fc670009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=343c0bf5537ace58 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:04.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.508+0000 7fc687400700 1 -- 172.21.15.82:0/1035370653 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670011830 con 0x7fc68806ef10 2024-05-10T04:51:04.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.508+0000 7fc687400700 1 -- 172.21.15.82:0/1035370653 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc670011990 con 0x7fc68806ef10 2024-05-10T04:51:04.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.508+0000 7fc687400700 1 -- 172.21.15.82:0/1035370653 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670011d20 con 0x7fc68806ef10 2024-05-10T04:51:04.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.509+0000 7fc68f000700 1 -- 172.21.15.82:0/1035370653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc68806ef10 msgr2=0x7fc6880cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:04.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.509+0000 7fc68f000700 1 --2- 172.21.15.82:0/1035370653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc68806ef10 0x7fc6880cf400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc670009840 tx=0x7fc670009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:04.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.509+0000 7fc68f000700 1 -- 172.21.15.82:0/1035370653 shutdown_connections 2024-05-10T04:51:04.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.509+0000 7fc68f000700 1 --2- 172.21.15.82:0/1035370653 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc68815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.509+0000 7fc68f000700 1 --2- 172.21.15.82:0/1035370653 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc68806ef10 0x7fc6880cf400 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.509+0000 7fc68f000700 1 -- 172.21.15.82:0/1035370653 >> 172.21.15.82:0/1035370653 conn(0x7fc6880b1830 msgr2=0x7fc6880b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:04.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.509+0000 7fc68f000700 1 -- 172.21.15.82:0/1035370653 shutdown_connections 2024-05-10T04:51:04.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.509+0000 7fc68f000700 1 -- 172.21.15.82:0/1035370653 wait complete. 2024-05-10T04:51:04.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.511+0000 7fc68f000700 1 Processor -- start 2024-05-10T04:51:04.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.511+0000 7fc68f000700 1 -- start start 2024-05-10T04:51:04.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc68f000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6880b47e0 0x7fc68814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:04.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc68f000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc6880cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:04.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc68f000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6880cb600 0x7fc68815dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:04.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc68f000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc688159f90 con 0x7fc6880b47e0 2024-05-10T04:51:04.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc68f000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880cbac0 con 0x7fc6880cb600 2024-05-10T04:51:04.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc68f000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880cbd10 con 0x7fc68815b9c0 2024-05-10T04:51:04.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc687e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6880b47e0 0x7fc68814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:04.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc687e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6880b47e0 0x7fc68814f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52608/0 (socket says 172.21.15.82:52608) 2024-05-10T04:51:04.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc687e00700 1 -- 172.21.15.82:0/2068203440 learned_addr learned my addr 172.21.15.82:0/2068203440 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:04.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc68d000700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6880cb600 0x7fc68815dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:04.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.513+0000 7fc67fe00700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc6880cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:04.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc687e00700 1 -- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 msgr2=0x7fc6880cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:04.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc687e00700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc6880cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc687e00700 1 -- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6880cb600 msgr2=0x7fc68815dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc687e00700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6880cb600 0x7fc68815dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc687e00700 1 -- 172.21.15.82:0/2068203440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680009b30 con 0x7fc6880b47e0 2024-05-10T04:51:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc68d000700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6880cb600 0x7fc68815dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc687e00700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6880b47e0 0x7fc68814f0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c550 tx=0x7fc67800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc684c00700 1 -- 172.21.15.82:0/2068203440 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678004c80 con 0x7fc6880b47e0 2024-05-10T04:51:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc684c00700 1 -- 172.21.15.82:0/2068203440 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc678004e00 con 0x7fc6880b47e0 2024-05-10T04:51:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6700094a0 con 0x7fc6880b47e0 2024-05-10T04:51:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc684c00700 1 -- 172.21.15.82:0/2068203440 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678007310 con 0x7fc6880b47e0 2024-05-10T04:51:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.514+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6880cc2d0 con 0x7fc6880b47e0 2024-05-10T04:51:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.515+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc688074af0 con 0x7fc6880b47e0 2024-05-10T04:51:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.516+0000 7fc684c00700 1 -- 172.21.15.82:0/2068203440 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc678007470 con 0x7fc6880b47e0 2024-05-10T04:51:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.517+0000 7fc684c00700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc66406ac90 0x7fc66406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.517+0000 7fc684c00700 1 -- 172.21.15.82:0/2068203440 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc6780891f0 con 0x7fc6880b47e0 2024-05-10T04:51:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.518+0000 7fc67fe00700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc66406ac90 0x7fc66406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.518+0000 7fc67fe00700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc66406ac90 0x7fc66406d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc6700090b0 tx=0x7fc67001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:04.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.522+0000 7fc684c00700 1 -- 172.21.15.82:0/2068203440 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc678054210 con 0x7fc6880b47e0 2024-05-10T04:51:04.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.726+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6880721d0 con 0x7fc6880b47e0 2024-05-10T04:51:04.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.727+0000 7fc684c00700 1 -- 172.21.15.82:0/2068203440 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc678057830 con 0x7fc6880b47e0 2024-05-10T04:51:04.728 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:51:04.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc66406ac90 msgr2=0x7fc66406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:04.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc66406ac90 0x7fc66406d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc6700090b0 tx=0x7fc67001c040 comp rx=0 tx=0).stop 2024-05-10T04:51:04.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6880b47e0 msgr2=0x7fc68814f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:04.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6880b47e0 0x7fc68814f0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c550 tx=0x7fc67800c910 comp rx=0 tx=0).stop 2024-05-10T04:51:04.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 shutdown_connections 2024-05-10T04:51:04.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc66406ac90 0x7fc66406d1a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc6880cb600 0x7fc68815dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6880b47e0 0x7fc68814f0a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 --2- 172.21.15.82:0/2068203440 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc68815b9c0 0x7fc6880cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:04.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 >> 172.21.15.82:0/2068203440 conn(0x7fc6880b1830 msgr2=0x7fc688151560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:04.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 shutdown_connections 2024-05-10T04:51:04.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:04.729+0000 7fc68f000700 1 -- 172.21.15.82:0/2068203440 wait complete. 2024-05-10T04:51:04.756 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:51:05.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.019+0000 7fde8d800700 1 Processor -- start 2024-05-10T04:51:05.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.019+0000 7fde8d800700 1 -- start start 2024-05-10T04:51:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde8d800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde880b2f50 0x7fde88161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde8d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880d3030 0x7fde880d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde8d800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde880d28c0 con 0x7fde880d0630 2024-05-10T04:51:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde8d800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde880b3360 con 0x7fde880b2f50 2024-05-10T04:51:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde8d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde881624e0 con 0x7fde880d3030 2024-05-10T04:51:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde86a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde880b2f50 0x7fde88161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde86a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde880b2f50 0x7fde88161fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52612/0 (socket says 172.21.15.82:52612) 2024-05-10T04:51:05.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde86a00700 1 -- 172.21.15.82:0/4146194280 learned_addr learned my addr 172.21.15.82:0/4146194280 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde86000700 1 --2- 172.21.15.82:0/4146194280 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880d3030 0x7fde880d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde86a00700 1 -- 172.21.15.82:0/4146194280 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880d3030 msgr2=0x7fde880d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde86a00700 1 --2- 172.21.15.82:0/4146194280 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880d3030 0x7fde880d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.021+0000 7fde86a00700 1 -- 172.21.15.82:0/4146194280 >> v1:172.21.15.129:6789/0 conn(0x7fde880d0630 legacy=0x7fde880d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.022+0000 7fde86a00700 1 -- 172.21.15.82:0/4146194280 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880d2ba0 con 0x7fde880b2f50 2024-05-10T04:51:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.022+0000 7fde86a00700 1 --2- 172.21.15.82:0/4146194280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880b2f50 0x7fde88161fa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fde78009e50 tx=0x7fde7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fcfcf84896bb09 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.022+0000 7fde85600700 1 -- 172.21.15.82:0/4146194280 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800e070 con 0x7fde880b2f50 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.022+0000 7fde85600700 1 -- 172.21.15.82:0/4146194280 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7800b9c0 con 0x7fde880b2f50 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.022+0000 7fde85600700 1 -- 172.21.15.82:0/4146194280 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800bd70 con 0x7fde880b2f50 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.023+0000 7fde8d800700 1 -- 172.21.15.82:0/4146194280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880b2f50 msgr2=0x7fde88161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.023+0000 7fde8d800700 1 --2- 172.21.15.82:0/4146194280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880b2f50 0x7fde88161fa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fde78009e50 tx=0x7fde7800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.023+0000 7fde8d800700 1 -- 172.21.15.82:0/4146194280 shutdown_connections 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.023+0000 7fde8d800700 1 --2- 172.21.15.82:0/4146194280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880b2f50 0x7fde88161fa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.023+0000 7fde8d800700 1 --2- 172.21.15.82:0/4146194280 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880d3030 0x7fde880d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.023+0000 7fde8d800700 1 -- 172.21.15.82:0/4146194280 >> 172.21.15.82:0/4146194280 conn(0x7fde8806c3f0 msgr2=0x7fde8806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.023+0000 7fde8d800700 1 -- 172.21.15.82:0/4146194280 shutdown_connections 2024-05-10T04:51:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.023+0000 7fde8d800700 1 -- 172.21.15.82:0/4146194280 wait complete. 2024-05-10T04:51:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.025+0000 7fde8d800700 1 Processor -- start 2024-05-10T04:51:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.025+0000 7fde8d800700 1 -- start start 2024-05-10T04:51:05.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde8d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880b2f50 0x7fde880ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde8d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880d0630 0x7fde881e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde8d800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde880d3030 0x7fde881ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde8d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88153510 con 0x7fde880d0630 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde8d800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde880c7aa0 con 0x7fde880d3030 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde8d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde88152400 con 0x7fde880b2f50 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880d0630 0x7fde881e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880d0630 0x7fde881e9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52616/0 (socket says 172.21.15.82:52616) 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86000700 1 -- 172.21.15.82:0/1718378883 learned_addr learned my addr 172.21.15.82:0/1718378883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86a00700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880b2f50 0x7fde880ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde87400700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde880d3030 0x7fde881ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86000700 1 -- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880b2f50 msgr2=0x7fde880ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86000700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880b2f50 0x7fde880ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86000700 1 -- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde880d3030 msgr2=0x7fde881ea4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86000700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde880d3030 0x7fde881ea4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.027+0000 7fde86000700 1 -- 172.21.15.82:0/1718378883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78009b30 con 0x7fde880d0630 2024-05-10T04:51:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.028+0000 7fde87400700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde880d3030 0x7fde881ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.028+0000 7fde86000700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880d0630 0x7fde881e9f90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde7400d800 tx=0x7fde7400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.028+0000 7fde7ea00700 1 -- 172.21.15.82:0/1718378883 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740125f0 con 0x7fde880d0630 2024-05-10T04:51:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.028+0000 7fde7ea00700 1 -- 172.21.15.82:0/1718378883 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74012750 con 0x7fde880d0630 2024-05-10T04:51:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.028+0000 7fde7ea00700 1 -- 172.21.15.82:0/1718378883 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74012b00 con 0x7fde880d0630 2024-05-10T04:51:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.028+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde88152640 con 0x7fde880d0630 2024-05-10T04:51:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.028+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde88152890 con 0x7fde880d0630 2024-05-10T04:51:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.029+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde88074af0 con 0x7fde880d0630 2024-05-10T04:51:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.030+0000 7fde7ea00700 1 -- 172.21.15.82:0/1718378883 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fde74012c60 con 0x7fde880d0630 2024-05-10T04:51:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.031+0000 7fde7ea00700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde6806ac90 0x7fde6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.032+0000 7fde7ea00700 1 -- 172.21.15.82:0/1718378883 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fde740897b0 con 0x7fde880d0630 2024-05-10T04:51:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.032+0000 7fde86a00700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde6806ac90 0x7fde6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.032+0000 7fde86a00700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde6806ac90 0x7fde6806d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde78009e50 tx=0x7fde78009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:05.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.036+0000 7fde7ea00700 1 -- 172.21.15.82:0/1718378883 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fde74054860 con 0x7fde880d0630 2024-05-10T04:51:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.253+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde880b34a0 con 0x7fde880d0630 2024-05-10T04:51:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.254+0000 7fde7ea00700 1 -- 172.21.15.82:0/1718378883 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fde74057e80 con 0x7fde880d0630 2024-05-10T04:51:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde6806ac90 msgr2=0x7fde6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde6806ac90 0x7fde6806d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde78009e50 tx=0x7fde78009000 comp rx=0 tx=0).stop 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880d0630 msgr2=0x7fde881e9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880d0630 0x7fde881e9f90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde7400d800 tx=0x7fde7400dbc0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 shutdown_connections 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fde6806ac90 0x7fde6806d1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fde880d3030 0x7fde881ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fde880b2f50 0x7fde880ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 --2- 172.21.15.82:0/1718378883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde880d0630 0x7fde881e9f90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 >> 172.21.15.82:0/1718378883 conn(0x7fde8806c3f0 msgr2=0x7fde880b8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 shutdown_connections 2024-05-10T04:51:05.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.256+0000 7fde8d800700 1 -- 172.21.15.82:0/1718378883 wait complete. 2024-05-10T04:51:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-05-10T04:51:05.284 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T04:51:05.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:05.285 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-10T04:51:05.356 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:51:05.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:05.357 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T04:51:05.412 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:51:05.414 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:51:05.414 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:05.416 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:51:05.466 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:51:05.466 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:05.554 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:51:05.554 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:05.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.901+0000 7fa195200700 1 Processor -- start 2024-05-10T04:51:05.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.901+0000 7fa195200700 1 -- start start 2024-05-10T04:51:05.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.903+0000 7fa195200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa19015df40 0x7fa1900d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.903+0000 7fa195200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa19015e350 0x7fa1900d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.903+0000 7fa195200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa190161e40 con 0x7fa1900b2ca0 2024-05-10T04:51:05.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.903+0000 7fa195200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900d0e30 con 0x7fa19015df40 2024-05-10T04:51:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.903+0000 7fa195200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900d3500 con 0x7fa19015e350 2024-05-10T04:51:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.903+0000 7fa18f400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa1900b2ca0 0x7fa1900cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55362/0 (socket says 172.21.15.82:55362) 2024-05-10T04:51:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.903+0000 7fa18f400700 1 -- 172.21.15.82:0/1029036330 learned_addr learned my addr 172.21.15.82:0/1029036330 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa187e00700 1 --2- 172.21.15.82:0/1029036330 >> v2:172.21.15.129:3300/0 conn(0x7fa19015df40 0x7fa1900d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa18fe00700 1 --2- 172.21.15.82:0/1029036330 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa19015e350 0x7fa1900d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa18ea00700 1 -- 172.21.15.82:0/1029036330 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713406725 0 0) 0x7fa190161e40 con 0x7fa1900b2ca0 2024-05-10T04:51:05.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa18ea00700 1 -- 172.21.15.82:0/1029036330 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1740035b0 con 0x7fa1900b2ca0 2024-05-10T04:51:05.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa18fe00700 1 -- 172.21.15.82:0/1029036330 >> v2:172.21.15.129:3300/0 conn(0x7fa19015df40 msgr2=0x7fa1900d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:05.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa18fe00700 1 --2- 172.21.15.82:0/1029036330 >> v2:172.21.15.129:3300/0 conn(0x7fa19015df40 0x7fa1900d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa18fe00700 1 -- 172.21.15.82:0/1029036330 >> v1:172.21.15.82:6789/0 conn(0x7fa1900b2ca0 legacy=0x7fa1900cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa18fe00700 1 -- 172.21.15.82:0/1029036330 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190162120 con 0x7fa19015e350 2024-05-10T04:51:05.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.904+0000 7fa187e00700 1 --2- 172.21.15.82:0/1029036330 >> v2:172.21.15.129:3300/0 conn(0x7fa19015df40 0x7fa1900d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:05.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.905+0000 7fa18fe00700 1 --2- 172.21.15.82:0/1029036330 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa19015e350 0x7fa1900d08f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa188009d90 tx=0x7fa18800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dbd13c779c78062 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:05.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.905+0000 7fa18ea00700 1 -- 172.21.15.82:0/1029036330 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800e070 con 0x7fa19015e350 2024-05-10T04:51:05.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.905+0000 7fa18ea00700 1 -- 172.21.15.82:0/1029036330 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800bb20 con 0x7fa19015e350 2024-05-10T04:51:05.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.905+0000 7fa18ea00700 1 -- 172.21.15.82:0/1029036330 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188012430 con 0x7fa19015e350 2024-05-10T04:51:05.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.905+0000 7fa195200700 1 -- 172.21.15.82:0/1029036330 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa19015e350 msgr2=0x7fa1900d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.905+0000 7fa195200700 1 --2- 172.21.15.82:0/1029036330 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa19015e350 0x7fa1900d08f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa188009d90 tx=0x7fa18800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:05.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.906+0000 7fa195200700 1 -- 172.21.15.82:0/1029036330 shutdown_connections 2024-05-10T04:51:05.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.906+0000 7fa195200700 1 --2- 172.21.15.82:0/1029036330 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa19015e350 0x7fa1900d08f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.906+0000 7fa195200700 1 --2- 172.21.15.82:0/1029036330 >> v2:172.21.15.129:3300/0 conn(0x7fa19015df40 0x7fa1900d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.906+0000 7fa195200700 1 -- 172.21.15.82:0/1029036330 >> 172.21.15.82:0/1029036330 conn(0x7fa190067600 msgr2=0x7fa19006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.906+0000 7fa195200700 1 -- 172.21.15.82:0/1029036330 shutdown_connections 2024-05-10T04:51:05.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.906+0000 7fa195200700 1 -- 172.21.15.82:0/1029036330 wait complete. 2024-05-10T04:51:05.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.908+0000 7fa195200700 1 Processor -- start 2024-05-10T04:51:05.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.908+0000 7fa195200700 1 -- start start 2024-05-10T04:51:05.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.909+0000 7fa195200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1900b2ca0 0x7fa1901519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.909+0000 7fa195200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa19015df40 0x7fa19015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.909+0000 7fa195200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa19015e350 0x7fa190158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.909+0000 7fa195200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190152c00 con 0x7fa19015e350 2024-05-10T04:51:05.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.909+0000 7fa195200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19015b3d0 con 0x7fa19015df40 2024-05-10T04:51:05.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.909+0000 7fa195200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1901f3c40 con 0x7fa1900b2ca0 2024-05-10T04:51:05.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa19015e350 0x7fa190158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa19015e350 0x7fa190158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43284/0 (socket says 172.21.15.82:43284) 2024-05-10T04:51:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18f400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1900b2ca0 0x7fa1901519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18fe00700 1 -- 172.21.15.82:0/2365603626 learned_addr learned my addr 172.21.15.82:0/2365603626 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa187e00700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa19015df40 0x7fa19015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18fe00700 1 -- 172.21.15.82:0/2365603626 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1900b2ca0 msgr2=0x7fa1901519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18fe00700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1900b2ca0 0x7fa1901519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18fe00700 1 -- 172.21.15.82:0/2365603626 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa19015df40 msgr2=0x7fa19015aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:05.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18fe00700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa19015df40 0x7fa19015aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.910+0000 7fa18fe00700 1 -- 172.21.15.82:0/2365603626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1780094a0 con 0x7fa19015e350 2024-05-10T04:51:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.911+0000 7fa18fe00700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa19015e350 0x7fa190158930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa1900d3640 tx=0x7fa188004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.911+0000 7fa187400700 1 -- 172.21.15.82:0/2365603626 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880129f0 con 0x7fa19015e350 2024-05-10T04:51:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.911+0000 7fa187400700 1 -- 172.21.15.82:0/2365603626 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188020070 con 0x7fa19015e350 2024-05-10T04:51:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.911+0000 7fa187400700 1 -- 172.21.15.82:0/2365603626 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188012db0 con 0x7fa19015e350 2024-05-10T04:51:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.911+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa188009a70 con 0x7fa19015e350 2024-05-10T04:51:05.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.911+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1901f3e90 con 0x7fa19015e350 2024-05-10T04:51:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.912+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190074af0 con 0x7fa19015e350 2024-05-10T04:51:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.913+0000 7fa187400700 1 -- 172.21.15.82:0/2365603626 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa188004040 con 0x7fa19015e350 2024-05-10T04:51:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.914+0000 7fa187400700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa16c06ac90 0x7fa16c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.914+0000 7fa187400700 1 -- 172.21.15.82:0/2365603626 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa188022070 con 0x7fa19015e350 2024-05-10T04:51:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.914+0000 7fa18f400700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa16c06ac90 0x7fa16c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:05.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.915+0000 7fa18f400700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa16c06ac90 0x7fa16c06d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa180007fd0 tx=0x7fa180007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:05.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:05.918+0000 7fa187400700 1 -- 172.21.15.82:0/2365603626 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa1880560a0 con 0x7fa19015e350 2024-05-10T04:51:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.122+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1900d1fa0 con 0x7fa19015e350 2024-05-10T04:51:06.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.124+0000 7fa187400700 1 -- 172.21.15.82:0/2365603626 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16333 (secure 0 0 0) 0x7fa18802c020 con 0x7fa19015e350 2024-05-10T04:51:06.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:06.126 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:58.666687+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa16c06ac90 msgr2=0x7fa16c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa16c06ac90 0x7fa16c06d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa180007fd0 tx=0x7fa180007dc0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa19015e350 msgr2=0x7fa190158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa19015e350 0x7fa190158930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa1900d3640 tx=0x7fa188004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 shutdown_connections 2024-05-10T04:51:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa16c06ac90 0x7fa16c06d1a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa19015e350 0x7fa190158930 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa1900b2ca0 0x7fa1901519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 --2- 172.21.15.82:0/2365603626 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa19015df40 0x7fa19015aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 >> 172.21.15.82:0/2365603626 conn(0x7fa190067600 msgr2=0x7fa19015e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 shutdown_connections 2024-05-10T04:51:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.126+0000 7fa195200700 1 -- 172.21.15.82:0/2365603626 wait complete. 2024-05-10T04:51:06.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:51:06.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:51:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.419+0000 7f476ec00700 1 Processor -- start 2024-05-10T04:51:06.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.420+0000 7f476ec00700 1 -- start start 2024-05-10T04:51:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.421+0000 7f476ec00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815beb0 0x7f476815f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.421+0000 7f476ec00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f476815e790 0x7f476815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.421+0000 7f476ec00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47680d2590 con 0x7f476806c1a0 2024-05-10T04:51:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.421+0000 7f476ec00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47680cec30 con 0x7f476815e790 2024-05-10T04:51:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.421+0000 7f476ec00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476815fe90 con 0x7f476815beb0 2024-05-10T04:51:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.421+0000 7f476ce00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f476806c1a0 0x7f476806c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55364/0 (socket says 172.21.15.82:55364) 2024-05-10T04:51:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f476ce00700 1 -- 172.21.15.82:0/1762150740 learned_addr learned my addr 172.21.15.82:0/1762150740 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f476d800700 1 --2- 172.21.15.82:0/1762150740 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815beb0 0x7f476815f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f476e200700 1 --2- 172.21.15.82:0/1762150740 >> v2:172.21.15.129:3300/0 conn(0x7f476815e790 0x7f476815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f4767e00700 1 -- 172.21.15.82:0/1762150740 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937762964 0 0) 0x7f47680d2590 con 0x7f476806c1a0 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f4767e00700 1 -- 172.21.15.82:0/1762150740 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47500035b0 con 0x7f476806c1a0 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f476d800700 1 -- 172.21.15.82:0/1762150740 >> v2:172.21.15.129:3300/0 conn(0x7f476815e790 msgr2=0x7f476815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f476d800700 1 --2- 172.21.15.82:0/1762150740 >> v2:172.21.15.129:3300/0 conn(0x7f476815e790 0x7f476815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f476d800700 1 -- 172.21.15.82:0/1762150740 >> v1:172.21.15.82:6789/0 conn(0x7f476806c1a0 legacy=0x7f476806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f4767e00700 1 -- 172.21.15.82:0/1762150740 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825632100 0 0) 0x7f47500035b0 con 0x7f476806c1a0 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.422+0000 7f476d800700 1 -- 172.21.15.82:0/1762150740 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476815f730 con 0x7f476815beb0 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.423+0000 7f476d800700 1 --2- 172.21.15.82:0/1762150740 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815beb0 0x7f476815f950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f475c009840 tx=0x7f475c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfb4079da9f33191 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.423+0000 7f4767e00700 1 -- 172.21.15.82:0/1762150740 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c011830 con 0x7f476815beb0 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.423+0000 7f4767e00700 1 -- 172.21.15.82:0/1762150740 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c011990 con 0x7f476815beb0 2024-05-10T04:51:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.423+0000 7f4767e00700 1 -- 172.21.15.82:0/1762150740 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c011d20 con 0x7f476815beb0 2024-05-10T04:51:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.424+0000 7f476ec00700 1 -- 172.21.15.82:0/1762150740 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815beb0 msgr2=0x7f476815f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.424+0000 7f476ec00700 1 --2- 172.21.15.82:0/1762150740 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815beb0 0x7f476815f950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f475c009840 tx=0x7f475c009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.424+0000 7f476ec00700 1 -- 172.21.15.82:0/1762150740 shutdown_connections 2024-05-10T04:51:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.424+0000 7f476ec00700 1 --2- 172.21.15.82:0/1762150740 >> v2:172.21.15.129:3300/0 conn(0x7f476815e790 0x7f476815eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.424+0000 7f476ec00700 1 --2- 172.21.15.82:0/1762150740 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815beb0 0x7f476815f950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.424+0000 7f476ec00700 1 -- 172.21.15.82:0/1762150740 >> 172.21.15.82:0/1762150740 conn(0x7f47680d3be0 msgr2=0x7f47680d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.424+0000 7f476ec00700 1 -- 172.21.15.82:0/1762150740 shutdown_connections 2024-05-10T04:51:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.424+0000 7f476ec00700 1 -- 172.21.15.82:0/1762150740 wait complete. 2024-05-10T04:51:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.426+0000 7f476ec00700 1 Processor -- start 2024-05-10T04:51:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.426+0000 7f476ec00700 1 -- start start 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476ec00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476806c1a0 0x7f47681f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476ec00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f476815beb0 0x7f47680b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476ec00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815e790 0x7f47680cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476ec00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4768154000 con 0x7f476806c1a0 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476ec00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47680b61c0 con 0x7f476815beb0 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476ec00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47681f7540 con 0x7f476815e790 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476806c1a0 0x7f47681f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476806c1a0 0x7f47681f7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43290/0 (socket says 172.21.15.82:43290) 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476d800700 1 -- 172.21.15.82:0/2930625786 learned_addr learned my addr 172.21.15.82:0/2930625786 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476ce00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f476815beb0 0x7f47680b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476e200700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815e790 0x7f47680cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476d800700 1 -- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815e790 msgr2=0x7f47680cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476d800700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815e790 0x7f47680cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476d800700 1 -- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f476815beb0 msgr2=0x7f47680b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476d800700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f476815beb0 0x7f47680b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476d800700 1 -- 172.21.15.82:0/2930625786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c0094a0 con 0x7f476806c1a0 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476ce00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f476815beb0 0x7f47680b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.428+0000 7f476e200700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815e790 0x7f47680cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.429+0000 7f476d800700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476806c1a0 0x7f47681f7000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f475c000c00 tx=0x7f475c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.429+0000 7f4765600700 1 -- 172.21.15.82:0/2930625786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c01aa70 con 0x7f476806c1a0 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.429+0000 7f4765600700 1 -- 172.21.15.82:0/2930625786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c01abd0 con 0x7f476806c1a0 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.429+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47680b6410 con 0x7f476806c1a0 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.429+0000 7f4765600700 1 -- 172.21.15.82:0/2930625786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c0243f0 con 0x7f476806c1a0 2024-05-10T04:51:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.429+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47680c7790 con 0x7f476806c1a0 2024-05-10T04:51:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.430+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4768074af0 con 0x7f476806c1a0 2024-05-10T04:51:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.431+0000 7f4765600700 1 -- 172.21.15.82:0/2930625786 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f475c02d450 con 0x7f476806c1a0 2024-05-10T04:51:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.432+0000 7f4765600700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f474806acc0 0x7f474806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.432+0000 7f4765600700 1 -- 172.21.15.82:0/2930625786 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f475c08a760 con 0x7f476806c1a0 2024-05-10T04:51:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.432+0000 7f476ce00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f474806acc0 0x7f474806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.433+0000 7f476ce00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f474806acc0 0x7f474806d1d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f476815c9e0 tx=0x7f4754009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.437+0000 7f4765600700 1 -- 172.21.15.82:0/2930625786 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f475c0558a0 con 0x7f476806c1a0 2024-05-10T04:51:06.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.638+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f476815ed60 con 0x7f476806c1a0 2024-05-10T04:51:06.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.638+0000 7f4765600700 1 -- 172.21.15.82:0/2930625786 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f475c058ec0 con 0x7f476806c1a0 2024-05-10T04:51:06.640 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f474806acc0 msgr2=0x7f474806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f474806acc0 0x7f474806d1d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f476815c9e0 tx=0x7f4754009040 comp rx=0 tx=0).stop 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476806c1a0 msgr2=0x7f47681f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476806c1a0 0x7f47681f7000 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f475c000c00 tx=0x7f475c004750 comp rx=0 tx=0).stop 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 shutdown_connections 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f474806acc0 0x7f474806d1d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f476815e790 0x7f47680cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f476806c1a0 0x7f47681f7000 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 --2- 172.21.15.82:0/2930625786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f476815beb0 0x7f47680b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 >> 172.21.15.82:0/2930625786 conn(0x7f47680d3be0 msgr2=0x7f476815d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 shutdown_connections 2024-05-10T04:51:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.641+0000 7f476ec00700 1 -- 172.21.15.82:0/2930625786 wait complete. 2024-05-10T04:51:06.668 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:51:06.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.932+0000 7f17e9a00700 1 Processor -- start 2024-05-10T04:51:06.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.932+0000 7f17e9a00700 1 -- start start 2024-05-10T04:51:06.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.934+0000 7f17e9a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e4162150 0x7f17e415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.934+0000 7f17e9a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17e406c160 0x7f17e406c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.934+0000 7f17e9a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e40d2c00 con 0x7f17e40cf4d0 2024-05-10T04:51:06.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.934+0000 7f17e9a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e406cab0 con 0x7f17e406c160 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.934+0000 7f17e9a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4162630 con 0x7f17e4162150 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.934+0000 7f17e3400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17e406c160 0x7f17e406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.934+0000 7f17e3400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17e406c160 0x7f17e406c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43298/0 (socket says 172.21.15.82:43298) 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.934+0000 7f17e3400700 1 -- 172.21.15.82:0/98923183 learned_addr learned my addr 172.21.15.82:0/98923183 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e2a00700 1 --2- 172.21.15.82:0/98923183 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e4162150 0x7f17e415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e3400700 1 -- 172.21.15.82:0/98923183 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e4162150 msgr2=0x7f17e415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e3400700 1 --2- 172.21.15.82:0/98923183 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e4162150 0x7f17e415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e3400700 1 -- 172.21.15.82:0/98923183 >> v1:172.21.15.129:6789/0 conn(0x7f17e40cf4d0 legacy=0x7f17e40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e3400700 1 -- 172.21.15.82:0/98923183 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4162910 con 0x7f17e406c160 2024-05-10T04:51:06.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e3400700 1 --2- 172.21.15.82:0/98923183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e406c160 0x7f17e406c570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009e50 tx=0x7f17dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d770b068f0e3550 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:06.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e2000700 1 -- 172.21.15.82:0/98923183 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00e070 con 0x7f17e406c160 2024-05-10T04:51:06.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e2000700 1 -- 172.21.15.82:0/98923183 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00b9c0 con 0x7f17e406c160 2024-05-10T04:51:06.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.935+0000 7f17e2000700 1 -- 172.21.15.82:0/98923183 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00bd70 con 0x7f17e406c160 2024-05-10T04:51:06.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.936+0000 7f17e9a00700 1 -- 172.21.15.82:0/98923183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e406c160 msgr2=0x7f17e406c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.936+0000 7f17e9a00700 1 --2- 172.21.15.82:0/98923183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e406c160 0x7f17e406c570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009e50 tx=0x7f17dc00b330 comp rx=0 tx=0).stop 2024-05-10T04:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.936+0000 7f17e9a00700 1 -- 172.21.15.82:0/98923183 shutdown_connections 2024-05-10T04:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.936+0000 7f17e9a00700 1 --2- 172.21.15.82:0/98923183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e406c160 0x7f17e406c570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.936+0000 7f17e9a00700 1 --2- 172.21.15.82:0/98923183 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e4162150 0x7f17e415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.936+0000 7f17e9a00700 1 -- 172.21.15.82:0/98923183 >> 172.21.15.82:0/98923183 conn(0x7f17e40d3e10 msgr2=0x7f17e40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.936+0000 7f17e9a00700 1 -- 172.21.15.82:0/98923183 shutdown_connections 2024-05-10T04:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.936+0000 7f17e9a00700 1 -- 172.21.15.82:0/98923183 wait complete. 2024-05-10T04:51:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.938+0000 7f17e9a00700 1 Processor -- start 2024-05-10T04:51:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.939+0000 7f17e9a00700 1 -- start start 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e9a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17e406c160 0x7f17e414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e9a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e40cf4d0 0x7f17e415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e9a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e4162150 0x7f17e414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e9a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e414dbf0 con 0x7f17e4162150 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e9a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e41616a0 con 0x7f17e406c160 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e9a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e415ecf0 con 0x7f17e40cf4d0 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e4162150 0x7f17e414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e4162150 0x7f17e414ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43300/0 (socket says 172.21.15.82:43300) 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e3400700 1 -- 172.21.15.82:0/1590005586 learned_addr learned my addr 172.21.15.82:0/1590005586 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17e2a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17e406c160 0x7f17e414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.940+0000 7f17dbe00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e40cf4d0 0x7f17e415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17e3400700 1 -- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e40cf4d0 msgr2=0x7f17e415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17e3400700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e40cf4d0 0x7f17e415fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17e3400700 1 -- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17e406c160 msgr2=0x7f17e414d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17e3400700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17e406c160 0x7f17e414d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17e3400700 1 -- 172.21.15.82:0/1590005586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc009b30 con 0x7f17e4162150 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17dbe00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e40cf4d0 0x7f17e415fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17e3400700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e4162150 0x7f17e414ed90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f17e40b6a00 tx=0x7f17dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17daa00700 1 -- 172.21.15.82:0/1590005586 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0048b0 con 0x7f17e4162150 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17daa00700 1 -- 172.21.15.82:0/1590005586 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc0099b0 con 0x7f17e4162150 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e415ef90 con 0x7f17e4162150 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.941+0000 7f17daa00700 1 -- 172.21.15.82:0/1590005586 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc01b670 con 0x7f17e4162150 2024-05-10T04:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.942+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e415f550 con 0x7f17e4162150 2024-05-10T04:51:06.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.942+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e4074af0 con 0x7f17e4162150 2024-05-10T04:51:06.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.943+0000 7f17daa00700 1 -- 172.21.15.82:0/1590005586 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f17dc01b7d0 con 0x7f17e4162150 2024-05-10T04:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.944+0000 7f17daa00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f17c006ac90 0x7f17c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.944+0000 7f17daa00700 1 -- 172.21.15.82:0/1590005586 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f17dc08acd0 con 0x7f17e4162150 2024-05-10T04:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.944+0000 7f17e2a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f17c006ac90 0x7f17c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.945+0000 7f17e2a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f17c006ac90 0x7f17c006d1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f17d4006b20 tx=0x7f17d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:06.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:06.949+0000 7f17daa00700 1 -- 172.21.15.82:0/1590005586 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f17dc055e10 con 0x7f17e4162150 2024-05-10T04:51:07.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.152+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17e414f860 con 0x7f17e4162150 2024-05-10T04:51:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.152+0000 7f17daa00700 1 -- 172.21.15.82:0/1590005586 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17dc059430 con 0x7f17e4162150 2024-05-10T04:51:07.154 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f17c006ac90 msgr2=0x7f17c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f17c006ac90 0x7f17c006d1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f17d4006b20 tx=0x7f17d4008040 comp rx=0 tx=0).stop 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e4162150 msgr2=0x7f17e414ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e4162150 0x7f17e414ed90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f17e40b6a00 tx=0x7f17dc004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 shutdown_connections 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f17c006ac90 0x7f17c006d1a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17e4162150 0x7f17e414ed90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17e406c160 0x7f17e414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 --2- 172.21.15.82:0/1590005586 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f17e40cf4d0 0x7f17e415fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 >> 172.21.15.82:0/1590005586 conn(0x7f17e40d3e10 msgr2=0x7f17e415b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 shutdown_connections 2024-05-10T04:51:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.155+0000 7f17e9a00700 1 -- 172.21.15.82:0/1590005586 wait complete. 2024-05-10T04:51:07.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:51:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.452+0000 7f6925400700 1 Processor -- start 2024-05-10T04:51:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.452+0000 7f6925400700 1 -- start start 2024-05-10T04:51:07.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.454+0000 7f6925400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f692006c160 0x7f692006c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.454+0000 7f6925400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69200d2c00 con 0x7f6920162150 2024-05-10T04:51:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.454+0000 7f6925400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692006cab0 con 0x7f692015e610 2024-05-10T04:51:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.454+0000 7f6925400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692015ea20 con 0x7f692006c160 2024-05-10T04:51:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.454+0000 7f691e800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6920162150 0x7f69200cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55368/0 (socket says 172.21.15.82:55368) 2024-05-10T04:51:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.454+0000 7f691e800700 1 -- 172.21.15.82:0/2919424122 learned_addr learned my addr 172.21.15.82:0/2919424122 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.455+0000 7f691f200700 1 --2- 172.21.15.82:0/2919424122 >> v2:172.21.15.129:3300/0 conn(0x7f692006c160 0x7f692006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.455+0000 7f691d400700 1 -- 172.21.15.82:0/2919424122 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383340110 0 0) 0x7f69200d2c00 con 0x7f6920162150 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.455+0000 7f691d400700 1 -- 172.21.15.82:0/2919424122 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69040035b0 con 0x7f6920162150 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.455+0000 7f691f200700 1 -- 172.21.15.82:0/2919424122 >> v1:172.21.15.129:6789/0 conn(0x7f692015e610 legacy=0x7f69200b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.455+0000 7f691f200700 1 -- 172.21.15.82:0/2919424122 >> v1:172.21.15.82:6789/0 conn(0x7f6920162150 legacy=0x7f69200cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.455+0000 7f691f200700 1 -- 172.21.15.82:0/2919424122 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920162630 con 0x7f692006c160 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.455+0000 7f691f200700 1 --2- 172.21.15.82:0/2919424122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692006c160 0x7f692006c570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6918009d90 tx=0x7f691800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93ea9bffcfa77b45 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.456+0000 7f691d400700 1 -- 172.21.15.82:0/2919424122 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800e070 con 0x7f692006c160 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.456+0000 7f691d400700 1 -- 172.21.15.82:0/2919424122 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691800bb20 con 0x7f692006c160 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.456+0000 7f691d400700 1 -- 172.21.15.82:0/2919424122 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918012430 con 0x7f692006c160 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.456+0000 7f6925400700 1 -- 172.21.15.82:0/2919424122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692006c160 msgr2=0x7f692006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.456+0000 7f6925400700 1 --2- 172.21.15.82:0/2919424122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692006c160 0x7f692006c570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6918009d90 tx=0x7f691800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.456+0000 7f6925400700 1 -- 172.21.15.82:0/2919424122 shutdown_connections 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.456+0000 7f6925400700 1 --2- 172.21.15.82:0/2919424122 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692006c160 0x7f692006c570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.456+0000 7f6925400700 1 -- 172.21.15.82:0/2919424122 >> 172.21.15.82:0/2919424122 conn(0x7f69200d3e10 msgr2=0x7f69200d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:07.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.457+0000 7f6925400700 1 -- 172.21.15.82:0/2919424122 shutdown_connections 2024-05-10T04:51:07.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.457+0000 7f6925400700 1 -- 172.21.15.82:0/2919424122 wait complete. 2024-05-10T04:51:07.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.459+0000 7f6925400700 1 Processor -- start 2024-05-10T04:51:07.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.459+0000 7f6925400700 1 -- start start 2024-05-10T04:51:07.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.460+0000 7f6925400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f692006c160 0x7f692014eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.460+0000 7f6925400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692015e610 0x7f69201e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.460+0000 7f6925400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6920162150 0x7f6920153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.460+0000 7f6925400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69201534c0 con 0x7f6920162150 2024-05-10T04:51:07.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.460+0000 7f6925400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920153f80 con 0x7f692015e610 2024-05-10T04:51:07.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.460+0000 7f6925400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692015efc0 con 0x7f692006c160 2024-05-10T04:51:07.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6920162150 0x7f6920153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6920162150 0x7f6920153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43310/0 (socket says 172.21.15.82:43310) 2024-05-10T04:51:07.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 -- 172.21.15.82:0/3804715622 learned_addr learned my addr 172.21.15.82:0/3804715622 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:07.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691e800700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f692006c160 0x7f692014eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691de00700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692015e610 0x7f69201e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 -- 172.21.15.82:0/3804715622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f692006c160 msgr2=0x7f692014eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f692006c160 0x7f692014eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 -- 172.21.15.82:0/3804715622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692015e610 msgr2=0x7f69201e9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692015e610 0x7f69201e9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 -- 172.21.15.82:0/3804715622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918009a70 con 0x7f6920162150 2024-05-10T04:51:07.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.461+0000 7f691f200700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6920162150 0x7f6920153630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6918013000 tx=0x7f6918004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:07.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.462+0000 7f6916a00700 1 -- 172.21.15.82:0/3804715622 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918012430 con 0x7f6920162150 2024-05-10T04:51:07.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.462+0000 7f6916a00700 1 -- 172.21.15.82:0/3804715622 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6918020070 con 0x7f6920162150 2024-05-10T04:51:07.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.462+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69201ea260 con 0x7f6920162150 2024-05-10T04:51:07.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.462+0000 7f6916a00700 1 -- 172.21.15.82:0/3804715622 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918004280 con 0x7f6920162150 2024-05-10T04:51:07.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.462+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692015f4f0 con 0x7f6920162150 2024-05-10T04:51:07.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.463+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6920074af0 con 0x7f6920162150 2024-05-10T04:51:07.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.464+0000 7f6916a00700 1 -- 172.21.15.82:0/3804715622 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f69180043e0 con 0x7f6920162150 2024-05-10T04:51:07.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.465+0000 7f6916a00700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f690006ac90 0x7f690006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.465+0000 7f6916a00700 1 -- 172.21.15.82:0/3804715622 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f6918022070 con 0x7f6920162150 2024-05-10T04:51:07.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.465+0000 7f691e800700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f690006ac90 0x7f690006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.465+0000 7f691e800700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f690006ac90 0x7f690006d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69100011e0 tx=0x7f6910009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.469+0000 7f6916a00700 1 -- 172.21.15.82:0/3804715622 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6918056290 con 0x7f6920162150 2024-05-10T04:51:07.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.670+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69201ea490 con 0x7f6920162150 2024-05-10T04:51:07.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.670+0000 7f6916a00700 1 -- 172.21.15.82:0/3804715622 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69180598b0 con 0x7f6920162150 2024-05-10T04:51:07.672 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:51:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f690006ac90 msgr2=0x7f690006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f690006ac90 0x7f690006d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69100011e0 tx=0x7f6910009040 comp rx=0 tx=0).stop 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6920162150 msgr2=0x7f6920153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6920162150 0x7f6920153630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6918013000 tx=0x7f6918004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 shutdown_connections 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f690006ac90 0x7f690006d1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6920162150 0x7f6920153630 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f692006c160 0x7f692014eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 --2- 172.21.15.82:0/3804715622 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f692015e610 0x7f69201e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 >> 172.21.15.82:0/3804715622 conn(0x7f69200d3e10 msgr2=0x7f6920158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 shutdown_connections 2024-05-10T04:51:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.673+0000 7f6925400700 1 -- 172.21.15.82:0/3804715622 wait complete. 2024-05-10T04:51:07.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:51:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.961+0000 7f3858a00700 1 Processor -- start 2024-05-10T04:51:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.962+0000 7f3858a00700 1 -- start start 2024-05-10T04:51:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3858a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3854071ef0 0x7f38540cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3858a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38540b4220 0x7f385406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3858a00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3854072460 con 0x7f3854144090 2024-05-10T04:51:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3858a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540ce0a0 con 0x7f3854071ef0 2024-05-10T04:51:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3858a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540ce380 con 0x7f38540b4220 2024-05-10T04:51:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3852800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3854071ef0 0x7f38540cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3852800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3854071ef0 0x7f38540cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43326/0 (socket says 172.21.15.82:43326) 2024-05-10T04:51:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3852800700 1 -- 172.21.15.82:0/2558096456 learned_addr learned my addr 172.21.15.82:0/2558096456 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3851e00700 1 --1- 172.21.15.82:0/2558096456 >> v1:172.21.15.82:6789/0 conn(0x7f3854144090 0x7f38540b3b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55382/0 (socket says 172.21.15.82:55382) 2024-05-10T04:51:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3853200700 1 --2- 172.21.15.82:0/2558096456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38540b4220 0x7f385406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3852800700 1 -- 172.21.15.82:0/2558096456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38540b4220 msgr2=0x7f385406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3852800700 1 --2- 172.21.15.82:0/2558096456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38540b4220 0x7f385406d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3852800700 1 -- 172.21.15.82:0/2558096456 >> v1:172.21.15.82:6789/0 conn(0x7f3854144090 legacy=0x7f38540b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.964+0000 7f3852800700 1 -- 172.21.15.82:0/2558096456 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38540ce660 con 0x7f3854071ef0 2024-05-10T04:51:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.965+0000 7f3852800700 1 --2- 172.21.15.82:0/2558096456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f38540cee60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f384400bb90 tx=0x7f384400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8810316d9e27418 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.965+0000 7f3851400700 1 -- 172.21.15.82:0/2558096456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400dd50 con 0x7f3854071ef0 2024-05-10T04:51:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.965+0000 7f3851400700 1 -- 172.21.15.82:0/2558096456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844010470 con 0x7f3854071ef0 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.965+0000 7f3851400700 1 -- 172.21.15.82:0/2558096456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844010800 con 0x7f3854071ef0 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.966+0000 7f3858a00700 1 -- 172.21.15.82:0/2558096456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 msgr2=0x7f38540cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.966+0000 7f3858a00700 1 --2- 172.21.15.82:0/2558096456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f38540cee60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f384400bb90 tx=0x7f384400bea0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.966+0000 7f3858a00700 1 -- 172.21.15.82:0/2558096456 shutdown_connections 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.966+0000 7f3858a00700 1 --2- 172.21.15.82:0/2558096456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38540b4220 0x7f385406d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.966+0000 7f3858a00700 1 --2- 172.21.15.82:0/2558096456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f38540cee60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.966+0000 7f3858a00700 1 -- 172.21.15.82:0/2558096456 >> 172.21.15.82:0/2558096456 conn(0x7f38540b1600 msgr2=0x7f38540b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.966+0000 7f3858a00700 1 -- 172.21.15.82:0/2558096456 shutdown_connections 2024-05-10T04:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.966+0000 7f3858a00700 1 -- 172.21.15.82:0/2558096456 wait complete. 2024-05-10T04:51:07.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.969+0000 7f3858a00700 1 Processor -- start 2024-05-10T04:51:07.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.969+0000 7f3858a00700 1 -- start start 2024-05-10T04:51:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.970+0000 7f3858a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f385413f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3858a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3854144090 0x7f385413d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3858a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3854142850 0x7f3854142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3858a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854140090 con 0x7f3854071ef0 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3858a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38541f1730 con 0x7f3854142850 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3858a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3854140eb0 con 0x7f3854144090 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f385413f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f385413f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43330/0 (socket says 172.21.15.82:43330) 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 -- 172.21.15.82:0/710048291 learned_addr learned my addr 172.21.15.82:0/710048291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 -- 172.21.15.82:0/710048291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3854144090 msgr2=0x7f385413d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3854144090 0x7f385413d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 -- 172.21.15.82:0/710048291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3854142850 msgr2=0x7f3854142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3854142850 0x7f3854142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 -- 172.21.15.82:0/710048291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384400b7f0 con 0x7f3854071ef0 2024-05-10T04:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.971+0000 7f3852800700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f385413f710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3854073230 tx=0x7f3844004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.972+0000 7f384aa00700 1 -- 172.21.15.82:0/710048291 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384401f070 con 0x7f3854071ef0 2024-05-10T04:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.972+0000 7f384aa00700 1 -- 172.21.15.82:0/710048291 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38440038b0 con 0x7f3854071ef0 2024-05-10T04:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.972+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38541431a0 con 0x7f3854071ef0 2024-05-10T04:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.972+0000 7f384aa00700 1 -- 172.21.15.82:0/710048291 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844003c60 con 0x7f3854071ef0 2024-05-10T04:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.972+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38541402a0 con 0x7f3854071ef0 2024-05-10T04:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.973+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854074af0 con 0x7f3854071ef0 2024-05-10T04:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.974+0000 7f384aa00700 1 -- 172.21.15.82:0/710048291 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3844019400 con 0x7f3854071ef0 2024-05-10T04:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.975+0000 7f384aa00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f383406ac90 0x7f383406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.975+0000 7f384aa00700 1 -- 172.21.15.82:0/710048291 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f384408cff0 con 0x7f3854071ef0 2024-05-10T04:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.975+0000 7f3851e00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f383406ac90 0x7f383406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.976+0000 7f3851e00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f383406ac90 0x7f383406d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38540b4670 tx=0x7f3840007a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:07.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:07.980+0000 7f384aa00700 1 -- 172.21.15.82:0/710048291 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3844058100 con 0x7f3854071ef0 2024-05-10T04:51:08.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.197+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f38540b49a0 con 0x7f3854071ef0 2024-05-10T04:51:08.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.197+0000 7f384aa00700 1 -- 172.21.15.82:0/710048291 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f384405b720 con 0x7f3854071ef0 2024-05-10T04:51:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f383406ac90 msgr2=0x7f383406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f383406ac90 0x7f383406d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f38540b4670 tx=0x7f3840007a50 comp rx=0 tx=0).stop 2024-05-10T04:51:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 msgr2=0x7f385413f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f385413f710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3854073230 tx=0x7f3844004750 comp rx=0 tx=0).stop 2024-05-10T04:51:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 shutdown_connections 2024-05-10T04:51:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f383406ac90 0x7f383406d1a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3854142850 0x7f3854142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3854071ef0 0x7f385413f710 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 --2- 172.21.15.82:0/710048291 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3854144090 0x7f385413d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 >> 172.21.15.82:0/710048291 conn(0x7f38540b1600 msgr2=0x7f385415a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 shutdown_connections 2024-05-10T04:51:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.200+0000 7f3858a00700 1 -- 172.21.15.82:0/710048291 wait complete. 2024-05-10T04:51:08.204 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-05-10T04:51:08.228 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-10T04:51:08.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:08.230 DEBUG:teuthology.orchestra.run.smithi129:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-10T04:51:08.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:51:08.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:08.314 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-10T04:51:08.367 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:51:08.367 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:08.411 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:51:08.412 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:08.495 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:51:08.496 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:08.580 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:08.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.881+0000 7f910b200700 1 Processor -- start 2024-05-10T04:51:08.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.881+0000 7f910b200700 1 -- start start 2024-05-10T04:51:08.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.883+0000 7f910b200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f910415df40 0x7f91040d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:08.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.883+0000 7f910b200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9104161e40 con 0x7f910415e350 2024-05-10T04:51:08.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.883+0000 7f910b200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9104162120 con 0x7f91040b2ca0 2024-05-10T04:51:08.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.883+0000 7f910b200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9104162400 con 0x7f910415df40 2024-05-10T04:51:08.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.883+0000 7f910a800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f910415e350 0x7f91040d24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55398/0 (socket says 172.21.15.82:55398) 2024-05-10T04:51:08.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.883+0000 7f910a800700 1 -- 172.21.15.82:0/3222384987 learned_addr learned my addr 172.21.15.82:0/3222384987 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:08.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9109400700 1 --2- 172.21.15.82:0/3222384987 >> v2:172.21.15.129:3300/0 conn(0x7f910415df40 0x7f91040d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:08.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519780972 0 0) 0x7f9104161e40 con 0x7f910415e350 2024-05-10T04:51:08.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90ec0035b0 con 0x7f910415e350 2024-05-10T04:51:08.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1011518446 0 0) 0x7f90ec0035b0 con 0x7f910415e350 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 >> v2:172.21.15.129:3300/0 conn(0x7f910415df40 msgr2=0x7f91040d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 --2- 172.21.15.82:0/3222384987 >> v2:172.21.15.129:3300/0 conn(0x7f910415df40 0x7f91040d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 >> v1:172.21.15.129:6789/0 conn(0x7f91040b2ca0 legacy=0x7f91040cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91041626e0 con 0x7f910415e350 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f91000019f0 con 0x7f910415e350 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 >> v1:172.21.15.82:6789/0 conn(0x7f910415e350 legacy=0x7f91040d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec003a00 0x7f90ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec004850 0x7f90ec004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.884+0000 7f9108a00700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90ec0053a0 0x7f90ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9104162400 con 0x7f90ec004850 2024-05-10T04:51:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec00c2d0 con 0x7f90ec003a00 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec00c490 con 0x7f90ec0053a0 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9109e00700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec003a00 0x7f90ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9109400700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec004850 0x7f90ec004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f910a800700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90ec0053a0 0x7f90ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9109400700 1 -- 172.21.15.82:0/3222384987 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90ec0053a0 msgr2=0x7f90ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9109400700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f90ec0053a0 0x7f90ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9109400700 1 -- 172.21.15.82:0/3222384987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec003a00 msgr2=0x7f90ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9109400700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec003a00 0x7f90ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f9109400700 1 -- 172.21.15.82:0/3222384987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0035b0 con 0x7f90ec004850 2024-05-10T04:51:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.885+0000 7f910a800700 1 -- 172.21.15.82:0/3222384987 reap_dead start 2024-05-10T04:51:08.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f9109400700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec004850 0x7f90ec004c60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f91040d17b0 tx=0x7f90ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12e2eced9513e5d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:08.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400e6c0 con 0x7f90ec004850 2024-05-10T04:51:08.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f400e820 con 0x7f90ec004850 2024-05-10T04:51:08.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f9108a00700 1 -- 172.21.15.82:0/3222384987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400eb90 con 0x7f90ec004850 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f910b200700 1 -- 172.21.15.82:0/3222384987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec004850 msgr2=0x7f90ec004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f910b200700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec004850 0x7f90ec004c60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f91040d17b0 tx=0x7f90ec005880 comp rx=0 tx=0).stop 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f910b200700 1 -- 172.21.15.82:0/3222384987 shutdown_connections 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f910b200700 1 --2- 172.21.15.82:0/3222384987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90ec004850 0x7f90ec004c60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.886+0000 7f910b200700 1 -- 172.21.15.82:0/3222384987 >> 172.21.15.82:0/3222384987 conn(0x7f9104067600 msgr2=0x7f910406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.887+0000 7f910b200700 1 -- 172.21.15.82:0/3222384987 shutdown_connections 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.887+0000 7f910b200700 1 -- 172.21.15.82:0/3222384987 wait complete. 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.889+0000 7f910b200700 1 Processor -- start 2024-05-10T04:51:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.889+0000 7f910b200700 1 -- start start 2024-05-10T04:51:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910b200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec004850 0x7f91041551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910b200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9104155900 0x7f9104157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91040b7390 0x7f91040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9104156070 con 0x7f91040b7390 2024-05-10T04:51:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910b200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91041f75a0 con 0x7f90ec004850 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910b200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9104155720 con 0x7f9104155900 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91040b7390 0x7f91040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91040b7390 0x7f91040b77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43344/0 (socket says 172.21.15.82:43344) 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910a800700 1 -- 172.21.15.82:0/3029949685 learned_addr learned my addr 172.21.15.82:0/3029949685 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f9109e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec004850 0x7f91041551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910a800700 1 -- 172.21.15.82:0/3029949685 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9104155900 msgr2=0x7f9104157780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910a800700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9104155900 0x7f9104157780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910a800700 1 -- 172.21.15.82:0/3029949685 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec004850 msgr2=0x7f91041551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910a800700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec004850 0x7f91041551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.891+0000 7f910a800700 1 -- 172.21.15.82:0/3029949685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91041f3d30 con 0x7f91040b7390 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.892+0000 7f910a800700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91040b7390 0x7f91040b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f910408cf30 tx=0x7f910000a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.892+0000 7f90fe000700 1 -- 172.21.15.82:0/3029949685 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910000ad00 con 0x7f91040b7390 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.892+0000 7f90fe000700 1 -- 172.21.15.82:0/3029949685 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910000ae80 con 0x7f91040b7390 2024-05-10T04:51:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.892+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91040b7ce0 con 0x7f91040b7390 2024-05-10T04:51:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.892+0000 7f90fe000700 1 -- 172.21.15.82:0/3029949685 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9100013630 con 0x7f91040b7390 2024-05-10T04:51:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.892+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91041f7ad0 con 0x7f91040b7390 2024-05-10T04:51:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.893+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9104074af0 con 0x7f91040b7390 2024-05-10T04:51:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.894+0000 7f90fe000700 1 -- 172.21.15.82:0/3029949685 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9100013790 con 0x7f91040b7390 2024-05-10T04:51:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.895+0000 7f90fe000700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90e806ac90 0x7f90e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.895+0000 7f90fe000700 1 -- 172.21.15.82:0/3029949685 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9100089c90 con 0x7f91040b7390 2024-05-10T04:51:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.895+0000 7f9109e00700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90e806ac90 0x7f90e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.896+0000 7f9109e00700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90e806ac90 0x7f90e806d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f90f8007fd0 tx=0x7f90f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:08.900+0000 7f90fe000700 1 -- 172.21.15.82:0/3029949685 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9100054d40 con 0x7f91040b7390 2024-05-10T04:51:09.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.110+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91040d1fa0 con 0x7f91040b7390 2024-05-10T04:51:09.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.111+0000 7f90fe000700 1 -- 172.21.15.82:0/3029949685 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16333 (secure 0 0 0) 0x7f9100058360 con 0x7f91040b7390 2024-05-10T04:51:09.113 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:09.113 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:58.666687+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:09.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90e806ac90 msgr2=0x7f90e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90e806ac90 0x7f90e806d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f90f8007fd0 tx=0x7f90f8009040 comp rx=0 tx=0).stop 2024-05-10T04:51:09.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91040b7390 msgr2=0x7f91040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91040b7390 0x7f91040b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f910408cf30 tx=0x7f910000a5f0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 shutdown_connections 2024-05-10T04:51:09.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f90e806ac90 0x7f90e806d1a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91040b7390 0x7f91040b77a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f90ec004850 0x7f91041551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 --2- 172.21.15.82:0/3029949685 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9104155900 0x7f9104157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 >> 172.21.15.82:0/3029949685 conn(0x7f9104067600 msgr2=0x7f91040b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:09.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 shutdown_connections 2024-05-10T04:51:09.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.114+0000 7f910b200700 1 -- 172.21.15.82:0/3029949685 wait complete. 2024-05-10T04:51:09.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:51:09.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:51:09.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.407+0000 7ff046c00700 1 Processor -- start 2024-05-10T04:51:09.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.407+0000 7ff046c00700 1 -- start start 2024-05-10T04:51:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.409+0000 7ff046c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0400b39e0 0x7ff0400b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.409+0000 7ff046c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400cb9d0 con 0x7ff0400d05b0 2024-05-10T04:51:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.409+0000 7ff046c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400b17b0 con 0x7ff0400b13a0 2024-05-10T04:51:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.409+0000 7ff046c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04015ec70 con 0x7ff0400b39e0 2024-05-10T04:51:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.409+0000 7ff044c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0400b39e0 0x7ff0400b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.409+0000 7ff044c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0400b39e0 0x7ff0400b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43356/0 (socket says 172.21.15.82:43356) 2024-05-10T04:51:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.409+0000 7ff03f400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff0400d05b0 0x7ff0400cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55404/0 (socket says 172.21.15.82:55404) 2024-05-10T04:51:09.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.409+0000 7ff044c00700 1 -- 172.21.15.82:0/4232123902 learned_addr learned my addr 172.21.15.82:0/4232123902 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:09.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.410+0000 7ff044c00700 1 -- 172.21.15.82:0/4232123902 >> v1:172.21.15.129:6789/0 conn(0x7ff0400b13a0 legacy=0x7ff0400cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.410+0000 7ff044c00700 1 -- 172.21.15.82:0/4232123902 >> v1:172.21.15.82:6789/0 conn(0x7ff0400d05b0 legacy=0x7ff0400cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.410+0000 7ff044c00700 1 -- 172.21.15.82:0/4232123902 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400ce240 con 0x7ff0400b39e0 2024-05-10T04:51:09.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.410+0000 7ff044c00700 1 --2- 172.21.15.82:0/4232123902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0400b1fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff038009e50 tx=0x7ff03800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bd23c7affc6d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:09.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.410+0000 7ff03ea00700 1 -- 172.21.15.82:0/4232123902 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03800e070 con 0x7ff0400b39e0 2024-05-10T04:51:09.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.410+0000 7ff03ea00700 1 -- 172.21.15.82:0/4232123902 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03800b9c0 con 0x7ff0400b39e0 2024-05-10T04:51:09.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.410+0000 7ff03ea00700 1 -- 172.21.15.82:0/4232123902 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03800bd70 con 0x7ff0400b39e0 2024-05-10T04:51:09.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.411+0000 7ff046c00700 1 -- 172.21.15.82:0/4232123902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 msgr2=0x7ff0400b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.411+0000 7ff046c00700 1 --2- 172.21.15.82:0/4232123902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0400b1fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff038009e50 tx=0x7ff03800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:09.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.411+0000 7ff046c00700 1 -- 172.21.15.82:0/4232123902 shutdown_connections 2024-05-10T04:51:09.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.411+0000 7ff046c00700 1 --2- 172.21.15.82:0/4232123902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0400b1fe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.411+0000 7ff046c00700 1 -- 172.21.15.82:0/4232123902 >> 172.21.15.82:0/4232123902 conn(0x7ff0400b26a0 msgr2=0x7ff0400b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:09.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.411+0000 7ff046c00700 1 -- 172.21.15.82:0/4232123902 shutdown_connections 2024-05-10T04:51:09.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.411+0000 7ff046c00700 1 -- 172.21.15.82:0/4232123902 wait complete. 2024-05-10T04:51:09.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.414+0000 7ff046c00700 1 Processor -- start 2024-05-10T04:51:09.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.414+0000 7ff046c00700 1 -- start start 2024-05-10T04:51:09.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff046c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0400b13a0 0x7ff040154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff046c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0401602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff046c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0400d05b0 0x7ff040160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff046c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401f8cf0 con 0x7ff0400b39e0 2024-05-10T04:51:09.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff046c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400ca040 con 0x7ff0400b13a0 2024-05-10T04:51:09.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff046c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400b0870 con 0x7ff0400d05b0 2024-05-10T04:51:09.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff03f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0401602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff03f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0401602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43364/0 (socket says 172.21.15.82:43364) 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.415+0000 7ff03f400700 1 -- 172.21.15.82:0/3114551528 learned_addr learned my addr 172.21.15.82:0/3114551528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff03fe00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0400b13a0 0x7ff040154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff044c00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0400d05b0 0x7ff040160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff03f400700 1 -- 172.21.15.82:0/3114551528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0400d05b0 msgr2=0x7ff040160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff03f400700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0400d05b0 0x7ff040160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff03f400700 1 -- 172.21.15.82:0/3114551528 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0400b13a0 msgr2=0x7ff040154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff03f400700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0400b13a0 0x7ff040154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff03f400700 1 -- 172.21.15.82:0/3114551528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009b30 con 0x7ff0400b39e0 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff03f400700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0401602d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00c4d0 tx=0x7ff02c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff037e00700 1 -- 172.21.15.82:0/3114551528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c005cb0 con 0x7ff0400b39e0 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff037e00700 1 -- 172.21.15.82:0/3114551528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c005e10 con 0x7ff0400b39e0 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff037e00700 1 -- 172.21.15.82:0/3114551528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0072d0 con 0x7ff0400b39e0 2024-05-10T04:51:09.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.416+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0401f8860 con 0x7ff0400b39e0 2024-05-10T04:51:09.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.417+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0401f8210 con 0x7ff0400b39e0 2024-05-10T04:51:09.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.418+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff040074af0 con 0x7ff0400b39e0 2024-05-10T04:51:09.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.419+0000 7ff037e00700 1 -- 172.21.15.82:0/3114551528 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff02c007430 con 0x7ff0400b39e0 2024-05-10T04:51:09.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.419+0000 7ff037e00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff02006ac90 0x7ff02006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.420+0000 7ff037e00700 1 -- 172.21.15.82:0/3114551528 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff02c088640 con 0x7ff0400b39e0 2024-05-10T04:51:09.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.420+0000 7ff03fe00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff02006ac90 0x7ff02006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.420+0000 7ff03fe00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff02006ac90 0x7ff02006d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff030007fd0 tx=0x7ff030009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.425+0000 7ff037e00700 1 -- 172.21.15.82:0/3114551528 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff02c0537b0 con 0x7ff0400b39e0 2024-05-10T04:51:09.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.625+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0401f8b40 con 0x7ff0400b39e0 2024-05-10T04:51:09.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.626+0000 7ff037e00700 1 -- 172.21.15.82:0/3114551528 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff02c0170a0 con 0x7ff0400b39e0 2024-05-10T04:51:09.627 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:51:09.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff02006ac90 msgr2=0x7ff02006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff02006ac90 0x7ff02006d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff030007fd0 tx=0x7ff030009040 comp rx=0 tx=0).stop 2024-05-10T04:51:09.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 msgr2=0x7ff0401602d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0401602d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00c4d0 tx=0x7ff02c00c7e0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 shutdown_connections 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff02006ac90 0x7ff02006d1a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0400d05b0 0x7ff040160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0400b13a0 0x7ff040154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 --2- 172.21.15.82:0/3114551528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0400b39e0 0x7ff0401602d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 >> 172.21.15.82:0/3114551528 conn(0x7ff0400b26a0 msgr2=0x7ff04015e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 shutdown_connections 2024-05-10T04:51:09.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.628+0000 7ff046c00700 1 -- 172.21.15.82:0/3114551528 wait complete. 2024-05-10T04:51:09.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:51:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.920+0000 7ffad7c00700 1 Processor -- start 2024-05-10T04:51:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.920+0000 7ffad7c00700 1 -- start start 2024-05-10T04:51:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.921+0000 7ffad7c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.921+0000 7ffad7c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ffad0162000 0x7ffad006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.921+0000 7ffad7c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad006c5f0 con 0x7ffad00b5c90 2024-05-10T04:51:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.921+0000 7ffad7c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad0162850 con 0x7ffad0162000 2024-05-10T04:51:09.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.921+0000 7ffad7c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0162b30 con 0x7ffad0158c70 2024-05-10T04:51:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.922+0000 7ffacfe00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ffad0162000 0x7ffad006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.922+0000 7ffad5200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.922+0000 7ffacfe00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ffad0162000 0x7ffad006ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:32924/0 (socket says 172.21.15.82:32924) 2024-05-10T04:51:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.922+0000 7ffacfe00700 1 -- 172.21.15.82:0/1934444998 learned_addr learned my addr 172.21.15.82:0/1934444998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffacf400700 1 -- 172.21.15.82:0/1934444998 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413838323 0 0) 0x7ffad006c5f0 con 0x7ffad00b5c90 2024-05-10T04:51:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffad5200700 1 -- 172.21.15.82:0/1934444998 >> v2:172.21.15.129:3300/0 conn(0x7ffad0162000 msgr2=0x7ffad006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffad5200700 1 --2- 172.21.15.82:0/1934444998 >> v2:172.21.15.129:3300/0 conn(0x7ffad0162000 0x7ffad006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffad5200700 1 -- 172.21.15.82:0/1934444998 >> v1:172.21.15.129:6789/0 conn(0x7ffad00b5c90 legacy=0x7ffad00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffad5200700 1 -- 172.21.15.82:0/1934444998 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0162e10 con 0x7ffad0158c70 2024-05-10T04:51:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffacfe00700 1 --2- 172.21.15.82:0/1934444998 >> v2:172.21.15.129:3300/0 conn(0x7ffad0162000 0x7ffad006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:09.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffad5200700 1 --2- 172.21.15.82:0/1934444998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad015ea10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009840 tx=0x7ffac4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b5b3735f5dcb23 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffacf400700 1 -- 172.21.15.82:0/1934444998 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4011830 con 0x7ffad0158c70 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffacf400700 1 -- 172.21.15.82:0/1934444998 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4011990 con 0x7ffad0158c70 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.923+0000 7ffacf400700 1 -- 172.21.15.82:0/1934444998 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4011d20 con 0x7ffad0158c70 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.924+0000 7ffad7c00700 1 -- 172.21.15.82:0/1934444998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 msgr2=0x7ffad015ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.924+0000 7ffad7c00700 1 --2- 172.21.15.82:0/1934444998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad015ea10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009840 tx=0x7ffac4009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.924+0000 7ffad7c00700 1 -- 172.21.15.82:0/1934444998 shutdown_connections 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.924+0000 7ffad7c00700 1 --2- 172.21.15.82:0/1934444998 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad015ea10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.924+0000 7ffad7c00700 1 --2- 172.21.15.82:0/1934444998 >> v2:172.21.15.129:3300/0 conn(0x7ffad0162000 0x7ffad006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.924+0000 7ffad7c00700 1 -- 172.21.15.82:0/1934444998 >> 172.21.15.82:0/1934444998 conn(0x7ffad00d0d30 msgr2=0x7ffad00d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.924+0000 7ffad7c00700 1 -- 172.21.15.82:0/1934444998 shutdown_connections 2024-05-10T04:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.924+0000 7ffad7c00700 1 -- 172.21.15.82:0/1934444998 wait complete. 2024-05-10T04:51:09.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.926+0000 7ffad7c00700 1 Processor -- start 2024-05-10T04:51:09.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.927+0000 7ffad7c00700 1 -- start start 2024-05-10T04:51:09.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad7c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad00b5c90 0x7ffad00cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad7c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad00c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad7c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0162000 0x7ffad00cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad7c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00cb150 con 0x7ffad00b5c90 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad7c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c9b60 con 0x7ffad0162000 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad7c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00ce2e0 con 0x7ffad0158c70 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad00b5c90 0x7ffad00cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad5200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad00b5c90 0x7ffad00cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43374/0 (socket says 172.21.15.82:43374) 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.928+0000 7ffad5200700 1 -- 172.21.15.82:0/4105876003 learned_addr learned my addr 172.21.15.82:0/4105876003 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffacfe00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad00c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffad5c00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0162000 0x7ffad00cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffad5200700 1 -- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 msgr2=0x7ffad00c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffad5200700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad00c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffad5200700 1 -- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0162000 msgr2=0x7ffad00cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffad5200700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0162000 0x7ffad00cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffad5200700 1 -- 172.21.15.82:0/4105876003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc009550 con 0x7ffad00b5c90 2024-05-10T04:51:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffad5c00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0162000 0x7ffad00cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffad5200700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad00b5c90 0x7ffad00cdc40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009fd0 tx=0x7ffac4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffaccc00700 1 -- 172.21.15.82:0/4105876003 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40036a0 con 0x7ffad00b5c90 2024-05-10T04:51:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.929+0000 7ffaccc00700 1 -- 172.21.15.82:0/4105876003 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac401e070 con 0x7ffad00b5c90 2024-05-10T04:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.930+0000 7ffaccc00700 1 -- 172.21.15.82:0/4105876003 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4003a20 con 0x7ffad00b5c90 2024-05-10T04:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.930+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac40094a0 con 0x7ffad00b5c90 2024-05-10T04:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.930+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad00cb640 con 0x7ffad00b5c90 2024-05-10T04:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.931+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad00732b0 con 0x7ffad00b5c90 2024-05-10T04:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.932+0000 7ffaccc00700 1 -- 172.21.15.82:0/4105876003 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffac4003b80 con 0x7ffad00b5c90 2024-05-10T04:51:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.932+0000 7ffaccc00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ffab006ac90 0x7ffab006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.932+0000 7ffaccc00700 1 -- 172.21.15.82:0/4105876003 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ffac408a460 con 0x7ffad00b5c90 2024-05-10T04:51:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.933+0000 7ffacfe00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ffab006ac90 0x7ffab006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.933+0000 7ffacfe00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ffab006ac90 0x7ffab006d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffad01ea3a0 tx=0x7ffabc0092c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:09.937+0000 7ffaccc00700 1 -- 172.21.15.82:0/4105876003 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffac4055510 con 0x7ffad00b5c90 2024-05-10T04:51:10.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.139+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffad0074af0 con 0x7ffad00b5c90 2024-05-10T04:51:10.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.140+0000 7ffaccc00700 1 -- 172.21.15.82:0/4105876003 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffac4058b30 con 0x7ffad00b5c90 2024-05-10T04:51:10.140 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ffab006ac90 msgr2=0x7ffab006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ffab006ac90 0x7ffab006d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffad01ea3a0 tx=0x7ffabc0092c0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad00b5c90 msgr2=0x7ffad00cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad00b5c90 0x7ffad00cdc40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffac4009fd0 tx=0x7ffac4004750 comp rx=0 tx=0).stop 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 shutdown_connections 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ffab006ac90 0x7ffab006d1a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffad0162000 0x7ffad00cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad00b5c90 0x7ffad00cdc40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 --2- 172.21.15.82:0/4105876003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ffad0158c70 0x7ffad00c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 >> 172.21.15.82:0/4105876003 conn(0x7ffad00d0d30 msgr2=0x7ffad00b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:10.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.142+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 shutdown_connections 2024-05-10T04:51:10.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.143+0000 7ffad7c00700 1 -- 172.21.15.82:0/4105876003 wait complete. 2024-05-10T04:51:10.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:51:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.440+0000 7f3778a00700 1 Processor -- start 2024-05-10T04:51:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.440+0000 7f3778a00700 1 -- start start 2024-05-10T04:51:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.442+0000 7f3778a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3774071f10 0x7f37740cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.442+0000 7f3778a00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377415eb70 con 0x7f37740b3a30 2024-05-10T04:51:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.442+0000 7f3778a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377415ee50 con 0x7f377415ae70 2024-05-10T04:51:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.442+0000 7f3778a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377415f130 con 0x7f3774071f10 2024-05-10T04:51:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.442+0000 7f3772800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3774071f10 0x7f37740cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.442+0000 7f3772800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3774071f10 0x7f37740cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43388/0 (socket says 172.21.15.82:43388) 2024-05-10T04:51:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.442+0000 7f3772800700 1 -- 172.21.15.82:0/302158446 learned_addr learned my addr 172.21.15.82:0/302158446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.442+0000 7f3773200700 1 --1- 172.21.15.82:0/302158446 >> v1:172.21.15.82:6789/0 conn(0x7f37740b3a30 0x7f37740b3e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55408/0 (socket says 172.21.15.82:55408) 2024-05-10T04:51:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.443+0000 7f3772800700 1 -- 172.21.15.82:0/302158446 >> v1:172.21.15.129:6789/0 conn(0x7f377415ae70 legacy=0x7f377406f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.443+0000 7f3772800700 1 -- 172.21.15.82:0/302158446 >> v1:172.21.15.82:6789/0 conn(0x7f37740b3a30 legacy=0x7f37740b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.443+0000 7f3772800700 1 -- 172.21.15.82:0/302158446 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377415f410 con 0x7f3774071f10 2024-05-10T04:51:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.443+0000 7f3772800700 1 --2- 172.21.15.82:0/302158446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774071f10 0x7f37740cde20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f376400bb90 tx=0x7f376400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad309bafefd4749 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.443+0000 7f3771400700 1 -- 172.21.15.82:0/302158446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400dd50 con 0x7f3774071f10 2024-05-10T04:51:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.443+0000 7f3771400700 1 -- 172.21.15.82:0/302158446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764010470 con 0x7f3774071f10 2024-05-10T04:51:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.443+0000 7f3771400700 1 -- 172.21.15.82:0/302158446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764010800 con 0x7f3774071f10 2024-05-10T04:51:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.444+0000 7f3778a00700 1 -- 172.21.15.82:0/302158446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774071f10 msgr2=0x7f37740cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.444+0000 7f3778a00700 1 --2- 172.21.15.82:0/302158446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774071f10 0x7f37740cde20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f376400bb90 tx=0x7f376400bea0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.444+0000 7f3778a00700 1 -- 172.21.15.82:0/302158446 shutdown_connections 2024-05-10T04:51:10.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.444+0000 7f3778a00700 1 --2- 172.21.15.82:0/302158446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774071f10 0x7f37740cde20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.444+0000 7f3778a00700 1 -- 172.21.15.82:0/302158446 >> 172.21.15.82:0/302158446 conn(0x7f37740cf770 msgr2=0x7f37740cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:10.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.444+0000 7f3778a00700 1 -- 172.21.15.82:0/302158446 shutdown_connections 2024-05-10T04:51:10.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.444+0000 7f3778a00700 1 -- 172.21.15.82:0/302158446 wait complete. 2024-05-10T04:51:10.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.447+0000 7f3778a00700 1 Processor -- start 2024-05-10T04:51:10.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.447+0000 7f3778a00700 1 -- start start 2024-05-10T04:51:10.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.448+0000 7f3778a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3774071f10 0x7f377414e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.448+0000 7f3778a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37740b3a30 0x7f3774151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.448+0000 7f3778a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f377415ae70 0x7f3774151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.448+0000 7f3778a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740ac970 con 0x7f37740b3a30 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.448+0000 7f3778a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740ae100 con 0x7f3774071f10 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.448+0000 7f3778a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37741f4af0 con 0x7f377415ae70 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.448+0000 7f3771e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37740b3a30 0x7f3774151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3771e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37740b3a30 0x7f3774151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43394/0 (socket says 172.21.15.82:43394) 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3771e00700 1 -- 172.21.15.82:0/832638100 learned_addr learned my addr 172.21.15.82:0/832638100 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3772800700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3774071f10 0x7f377414e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3773200700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f377415ae70 0x7f3774151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3771e00700 1 -- 172.21.15.82:0/832638100 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f377415ae70 msgr2=0x7f3774151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3771e00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f377415ae70 0x7f3774151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3771e00700 1 -- 172.21.15.82:0/832638100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3774071f10 msgr2=0x7f377414e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3771e00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3774071f10 0x7f377414e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3771e00700 1 -- 172.21.15.82:0/832638100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376400b7f0 con 0x7f37740b3a30 2024-05-10T04:51:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.449+0000 7f3771e00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37740b3a30 0x7f3774151000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f376000c420 tx=0x7f376000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.450+0000 7f376aa00700 1 -- 172.21.15.82:0/832638100 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600052d0 con 0x7f37740b3a30 2024-05-10T04:51:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.450+0000 7f376aa00700 1 -- 172.21.15.82:0/832638100 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760005430 con 0x7f37740b3a30 2024-05-10T04:51:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.450+0000 7f376aa00700 1 -- 172.21.15.82:0/832638100 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600038c0 con 0x7f37740b3a30 2024-05-10T04:51:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.450+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377414e830 con 0x7f37740b3a30 2024-05-10T04:51:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.450+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37741f5020 con 0x7f37740b3a30 2024-05-10T04:51:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.451+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3774074af0 con 0x7f37740b3a30 2024-05-10T04:51:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.452+0000 7f376aa00700 1 -- 172.21.15.82:0/832638100 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3760003a20 con 0x7f37740b3a30 2024-05-10T04:51:10.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.453+0000 7f376aa00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f375406acc0 0x7f375406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.453+0000 7f376aa00700 1 -- 172.21.15.82:0/832638100 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3760088730 con 0x7f37740b3a30 2024-05-10T04:51:10.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.453+0000 7f3772800700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f375406acc0 0x7f375406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.454+0000 7f3772800700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f375406acc0 0x7f375406d1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f376400bee0 tx=0x7f3764013000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:10.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.457+0000 7f376aa00700 1 -- 172.21.15.82:0/832638100 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f37600537f0 con 0x7f37740b3a30 2024-05-10T04:51:10.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.662+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37740b4870 con 0x7f37740b3a30 2024-05-10T04:51:10.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.662+0000 7f376aa00700 1 -- 172.21.15.82:0/832638100 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37600170a0 con 0x7f37740b3a30 2024-05-10T04:51:10.663 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f375406acc0 msgr2=0x7f375406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f375406acc0 0x7f375406d1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f376400bee0 tx=0x7f3764013000 comp rx=0 tx=0).stop 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37740b3a30 msgr2=0x7f3774151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37740b3a30 0x7f3774151000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f376000c420 tx=0x7f376000c730 comp rx=0 tx=0).stop 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 shutdown_connections 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f375406acc0 0x7f375406d1d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f377415ae70 0x7f3774151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3774071f10 0x7f377414e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 --2- 172.21.15.82:0/832638100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37740b3a30 0x7f3774151000 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 >> 172.21.15.82:0/832638100 conn(0x7f37740cf770 msgr2=0x7f377415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 shutdown_connections 2024-05-10T04:51:10.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.665+0000 7f3778a00700 1 -- 172.21.15.82:0/832638100 wait complete. 2024-05-10T04:51:10.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:51:10.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.957+0000 7f1e19600700 1 Processor -- start 2024-05-10T04:51:10.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.957+0000 7f1e19600700 1 -- start start 2024-05-10T04:51:10.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.959+0000 7f1e19600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140b3090 0x7f1e140ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.959+0000 7f1e19600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140b5bb0 con 0x7f1e140d0990 2024-05-10T04:51:10.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.959+0000 7f1e19600700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140cf110 con 0x7f1e14161d40 2024-05-10T04:51:10.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.959+0000 7f1e19600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140cf6d0 con 0x7f1e140b3090 2024-05-10T04:51:10.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.959+0000 7f1e18c00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1e140d0990 0x7f1e140d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55416/0 (socket says 172.21.15.82:55416) 2024-05-10T04:51:10.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.959+0000 7f1e18c00700 1 -- 172.21.15.82:0/2251007502 learned_addr learned my addr 172.21.15.82:0/2251007502 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:10.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e13400700 1 --2- 172.21.15.82:0/2251007502 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140b3090 0x7f1e140ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e12a00700 1 -- 172.21.15.82:0/2251007502 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391515133 0 0) 0x7f1e140b5bb0 con 0x7f1e140d0990 2024-05-10T04:51:10.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e12a00700 1 -- 172.21.15.82:0/2251007502 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df80035b0 con 0x7f1e140d0990 2024-05-10T04:51:10.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e12a00700 1 -- 172.21.15.82:0/2251007502 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941357286 0 0) 0x7f1e140cf110 con 0x7f1e14161d40 2024-05-10T04:51:10.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e12a00700 1 -- 172.21.15.82:0/2251007502 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e140b5bb0 con 0x7f1e14161d40 2024-05-10T04:51:10.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e13400700 1 -- 172.21.15.82:0/2251007502 >> v1:172.21.15.129:6789/0 conn(0x7f1e14161d40 legacy=0x7f1e140b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e13400700 1 -- 172.21.15.82:0/2251007502 >> v1:172.21.15.82:6789/0 conn(0x7f1e140d0990 legacy=0x7f1e140d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e13400700 1 -- 172.21.15.82:0/2251007502 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140cf3f0 con 0x7f1e140b3090 2024-05-10T04:51:10.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.960+0000 7f1e13400700 1 --2- 172.21.15.82:0/2251007502 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140b3090 0x7f1e140ce7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009870 tx=0x7f1e00009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5052c1ad91091da4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:10.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.961+0000 7f1e12a00700 1 -- 172.21.15.82:0/2251007502 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00011830 con 0x7f1e140b3090 2024-05-10T04:51:10.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.961+0000 7f1e12a00700 1 -- 172.21.15.82:0/2251007502 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e00011990 con 0x7f1e140b3090 2024-05-10T04:51:10.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.961+0000 7f1e12a00700 1 -- 172.21.15.82:0/2251007502 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00011d20 con 0x7f1e140b3090 2024-05-10T04:51:10.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.961+0000 7f1e19600700 1 -- 172.21.15.82:0/2251007502 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140b3090 msgr2=0x7f1e140ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.961+0000 7f1e19600700 1 --2- 172.21.15.82:0/2251007502 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140b3090 0x7f1e140ce7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009870 tx=0x7f1e00009b80 comp rx=0 tx=0).stop 2024-05-10T04:51:10.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.962+0000 7f1e19600700 1 -- 172.21.15.82:0/2251007502 shutdown_connections 2024-05-10T04:51:10.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.962+0000 7f1e19600700 1 --2- 172.21.15.82:0/2251007502 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140b3090 0x7f1e140ce7a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.962+0000 7f1e19600700 1 -- 172.21.15.82:0/2251007502 >> 172.21.15.82:0/2251007502 conn(0x7f1e1406c580 msgr2=0x7f1e1406c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:10.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.962+0000 7f1e19600700 1 -- 172.21.15.82:0/2251007502 shutdown_connections 2024-05-10T04:51:10.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.962+0000 7f1e19600700 1 -- 172.21.15.82:0/2251007502 wait complete. 2024-05-10T04:51:10.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.964+0000 7f1e19600700 1 Processor -- start 2024-05-10T04:51:10.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.964+0000 7f1e19600700 1 -- start start 2024-05-10T04:51:10.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.965+0000 7f1e19600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e140b3090 0x7f1e1415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.965+0000 7f1e19600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140d0990 0x7f1e14158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.965+0000 7f1e19600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e14161d40 0x7f1e140b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.965+0000 7f1e19600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14156720 con 0x7f1e140b3090 2024-05-10T04:51:10.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.965+0000 7f1e19600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415b640 con 0x7f1e14161d40 2024-05-10T04:51:10.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.965+0000 7f1e19600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14157e80 con 0x7f1e140d0990 2024-05-10T04:51:10.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e140b3090 0x7f1e1415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e140b3090 0x7f1e1415b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43406/0 (socket says 172.21.15.82:43406) 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 -- 172.21.15.82:0/3222274216 learned_addr learned my addr 172.21.15.82:0/3222274216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e18c00700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e14161d40 0x7f1e140b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13400700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140d0990 0x7f1e14158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 -- 172.21.15.82:0/3222274216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140d0990 msgr2=0x7f1e14158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140d0990 0x7f1e14158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 -- 172.21.15.82:0/3222274216 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e14161d40 msgr2=0x7f1e140b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e14161d40 0x7f1e140b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 -- 172.21.15.82:0/3222274216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000094a0 con 0x7f1e140b3090 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e13e00700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e140b3090 0x7f1e1415b100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c500 tx=0x7f1e0400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.966+0000 7f1e0be00700 1 -- 172.21.15.82:0/3222274216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e040052d0 con 0x7f1e140b3090 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.967+0000 7f1e0be00700 1 -- 172.21.15.82:0/3222274216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04005450 con 0x7f1e140b3090 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.967+0000 7f1e0be00700 1 -- 172.21.15.82:0/3222274216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e040038c0 con 0x7f1e140b3090 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.967+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e14158ca0 con 0x7f1e140b3090 2024-05-10T04:51:10.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.967+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e14156060 con 0x7f1e140b3090 2024-05-10T04:51:10.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.968+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e140ce2b0 con 0x7f1e140b3090 2024-05-10T04:51:10.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.969+0000 7f1e0be00700 1 -- 172.21.15.82:0/3222274216 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e04003a20 con 0x7f1e140b3090 2024-05-10T04:51:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.970+0000 7f1e0be00700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1df406acc0 0x7f1df406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.970+0000 7f1e0be00700 1 -- 172.21.15.82:0/3222274216 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1e040888e0 con 0x7f1e140b3090 2024-05-10T04:51:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.970+0000 7f1e13400700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1df406acc0 0x7f1df406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:10.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.970+0000 7f1e13400700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1df406acc0 0x7f1df406d1d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e000097c0 tx=0x7f1e0001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:10.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:10.974+0000 7f1e0be00700 1 -- 172.21.15.82:0/3222274216 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e04053990 con 0x7f1e140b3090 2024-05-10T04:51:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.190+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1e14074af0 con 0x7f1e140b3090 2024-05-10T04:51:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.191+0000 7f1e0be00700 1 -- 172.21.15.82:0/3222274216 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1e04017080 con 0x7f1e140b3090 2024-05-10T04:51:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1df406acc0 msgr2=0x7f1df406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1df406acc0 0x7f1df406d1d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e000097c0 tx=0x7f1e0001c040 comp rx=0 tx=0).stop 2024-05-10T04:51:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e140b3090 msgr2=0x7f1e1415b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e140b3090 0x7f1e1415b100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c500 tx=0x7f1e0400c8c0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 shutdown_connections 2024-05-10T04:51:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1df406acc0 0x7f1df406d1d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e14161d40 0x7f1e140b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e140b3090 0x7f1e1415b100 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 --2- 172.21.15.82:0/3222274216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e140d0990 0x7f1e14158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.193+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 >> 172.21.15.82:0/3222274216 conn(0x7f1e1406c580 msgr2=0x7f1e140b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:11.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.194+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 shutdown_connections 2024-05-10T04:51:11.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.194+0000 7f1e19600700 1 -- 172.21.15.82:0/3222274216 wait complete. 2024-05-10T04:51:11.199 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-05-10T04:51:11.219 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-10T04:51:11.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:11.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-10T04:51:11.289 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:51:11.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:11.289 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-10T04:51:11.334 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:51:11.334 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:11.384 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:51:11.384 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:11.431 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:51:11.431 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:11.518 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:11.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.782+0000 7f45e8200700 1 Processor -- start 2024-05-10T04:51:11.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.782+0000 7f45e8200700 1 -- start start 2024-05-10T04:51:11.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.783+0000 7f45e8200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e015e6e0 0x7f45e006c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:11.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.783+0000 7f45e8200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f45e00b8450 0x7f45e006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:11.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e8200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00d34c0 con 0x7f45e00b2b90 2024-05-10T04:51:11.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e8200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e006d340 con 0x7f45e00b8450 2024-05-10T04:51:11.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e8200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00d2b90 con 0x7f45e015e6e0 2024-05-10T04:51:11.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e6200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f45e00b8450 0x7f45e006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e4e00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f45e00b2b90 0x7f45e00d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:54258/0 (socket says 172.21.15.82:54258) 2024-05-10T04:51:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e4e00700 1 -- 172.21.15.82:0/2989232897 learned_addr learned my addr 172.21.15.82:0/2989232897 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e5800700 1 --2- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e015e6e0 0x7f45e006c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e6200700 1 -- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e015e6e0 msgr2=0x7f45e006c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e6200700 1 --2- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e015e6e0 0x7f45e006c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e6200700 1 -- 172.21.15.82:0/2989232897 >> v1:172.21.15.129:6789/0 conn(0x7f45e00b2b90 legacy=0x7f45e00d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.784+0000 7f45e6200700 1 -- 172.21.15.82:0/2989232897 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00d2e70 con 0x7f45e00b8450 2024-05-10T04:51:11.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.785+0000 7f45e5800700 1 --2- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e015e6e0 0x7f45e006c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.785+0000 7f45e6200700 1 --2- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e00b8450 0x7f45e006c730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009d90 tx=0x7f45d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2afaca32c1f6f97b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.785+0000 7f45dfe00700 1 -- 172.21.15.82:0/2989232897 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800e070 con 0x7f45e00b8450 2024-05-10T04:51:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.785+0000 7f45dfe00700 1 -- 172.21.15.82:0/2989232897 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d800bb20 con 0x7f45e00b8450 2024-05-10T04:51:11.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.785+0000 7f45dfe00700 1 -- 172.21.15.82:0/2989232897 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8012430 con 0x7f45e00b8450 2024-05-10T04:51:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.786+0000 7f45e8200700 1 -- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e00b8450 msgr2=0x7f45e006c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.786+0000 7f45e8200700 1 --2- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e00b8450 0x7f45e006c730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009d90 tx=0x7f45d800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.786+0000 7f45e8200700 1 -- 172.21.15.82:0/2989232897 shutdown_connections 2024-05-10T04:51:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.786+0000 7f45e8200700 1 --2- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e00b8450 0x7f45e006c730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.786+0000 7f45e8200700 1 --2- 172.21.15.82:0/2989232897 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e015e6e0 0x7f45e006c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.786+0000 7f45e8200700 1 -- 172.21.15.82:0/2989232897 >> 172.21.15.82:0/2989232897 conn(0x7f45e00b5db0 msgr2=0x7f45e00b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:11.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.786+0000 7f45e8200700 1 -- 172.21.15.82:0/2989232897 shutdown_connections 2024-05-10T04:51:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.786+0000 7f45e8200700 1 -- 172.21.15.82:0/2989232897 wait complete. 2024-05-10T04:51:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.788+0000 7f45e8200700 1 Processor -- start 2024-05-10T04:51:11.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.788+0000 7f45e8200700 1 -- start start 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e8200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e00b2b90 0x7f45e015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e8200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e00b8450 0x7f45e015cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e8200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e015e6e0 0x7f45e015d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e8200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00cc270 con 0x7f45e00b2b90 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e8200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0160410 con 0x7f45e015e6e0 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e8200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0160660 con 0x7f45e00b8450 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e5800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e00b2b90 0x7f45e015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e5800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e00b2b90 0x7f45e015fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43410/0 (socket says 172.21.15.82:43410) 2024-05-10T04:51:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.790+0000 7f45e5800700 1 -- 172.21.15.82:0/3741919242 learned_addr learned my addr 172.21.15.82:0/3741919242 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e6200700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e015e6e0 0x7f45e015d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e4e00700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e00b8450 0x7f45e015cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e5800700 1 -- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e00b8450 msgr2=0x7f45e015cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e5800700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e00b8450 0x7f45e015cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e5800700 1 -- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e015e6e0 msgr2=0x7f45e015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e5800700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e015e6e0 0x7f45e015d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e5800700 1 -- 172.21.15.82:0/3741919242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d40094a0 con 0x7f45e00b2b90 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e4e00700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e00b8450 0x7f45e015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e6200700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e015e6e0 0x7f45e015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e5800700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e00b2b90 0x7f45e015fe10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f45d400ebe0 tx=0x7f45d4009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45dd600700 1 -- 172.21.15.82:0/3741919242 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d400c8b0 con 0x7f45e00b2b90 2024-05-10T04:51:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45dd600700 1 -- 172.21.15.82:0/3741919242 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d400ca10 con 0x7f45e00b2b90 2024-05-10T04:51:11.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d8009a70 con 0x7f45e00b2b90 2024-05-10T04:51:11.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45dd600700 1 -- 172.21.15.82:0/3741919242 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d400cda0 con 0x7f45e00b2b90 2024-05-10T04:51:11.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.791+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e0160c20 con 0x7f45e00b2b90 2024-05-10T04:51:11.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.792+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e00732b0 con 0x7f45e00b2b90 2024-05-10T04:51:11.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.793+0000 7f45dd600700 1 -- 172.21.15.82:0/3741919242 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f45d4013470 con 0x7f45e00b2b90 2024-05-10T04:51:11.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.795+0000 7f45dd600700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f45c006ac90 0x7f45c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:11.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.795+0000 7f45dd600700 1 -- 172.21.15.82:0/3741919242 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f45d40895f0 con 0x7f45e00b2b90 2024-05-10T04:51:11.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.795+0000 7f45e4e00700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f45c006ac90 0x7f45c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:11.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.796+0000 7f45e4e00700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f45c006ac90 0x7f45c006d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45cc000f60 tx=0x7f45cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:11.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:11.800+0000 7f45dd600700 1 -- 172.21.15.82:0/3741919242 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f45d40546a0 con 0x7f45e00b2b90 2024-05-10T04:51:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.005+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45e00cc0b0 con 0x7f45e00b2b90 2024-05-10T04:51:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.006+0000 7f45dd600700 1 -- 172.21.15.82:0/3741919242 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16333 (secure 0 0 0) 0x7f45e00cc0b0 con 0x7f45e00b2b90 2024-05-10T04:51:12.008 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:12.008 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:58.666687+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.008+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f45c006ac90 msgr2=0x7f45c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.008+0000 7f45e8200700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f45c006ac90 0x7f45c006d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45cc000f60 tx=0x7f45cc009040 comp rx=0 tx=0).stop 2024-05-10T04:51:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.008+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e00b2b90 msgr2=0x7f45e015fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.008+0000 7f45e8200700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e00b2b90 0x7f45e015fe10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f45d400ebe0 tx=0x7f45d4009e20 comp rx=0 tx=0).stop 2024-05-10T04:51:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.009+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 shutdown_connections 2024-05-10T04:51:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.009+0000 7f45e8200700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f45c006ac90 0x7f45c006d1a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.009+0000 7f45e8200700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f45e015e6e0 0x7f45e015d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.009+0000 7f45e8200700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e00b2b90 0x7f45e015fe10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.009+0000 7f45e8200700 1 --2- 172.21.15.82:0/3741919242 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f45e00b8450 0x7f45e015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.009+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 >> 172.21.15.82:0/3741919242 conn(0x7f45e00b5db0 msgr2=0x7f45e00b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.009+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 shutdown_connections 2024-05-10T04:51:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.009+0000 7f45e8200700 1 -- 172.21.15.82:0/3741919242 wait complete. 2024-05-10T04:51:12.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:51:12.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:51:12.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.302+0000 7f400b200700 1 Processor -- start 2024-05-10T04:51:12.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.302+0000 7f400b200700 1 -- start start 2024-05-10T04:51:12.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.304+0000 7f400b200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f400c15e290 0x7f400c0d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.304+0000 7f400b200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c0d1020 0x7f400c0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.304+0000 7f400b200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400c0d2140 con 0x7f400c0cee80 2024-05-10T04:51:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.304+0000 7f400b200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0d1430 con 0x7f400c15e290 2024-05-10T04:51:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.304+0000 7f400b200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0cf290 con 0x7f400c0d1020 2024-05-10T04:51:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f400a800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f400c0cee80 0x7f400c0d2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55432/0 (socket says 172.21.15.82:55432) 2024-05-10T04:51:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f400a800700 1 -- 172.21.15.82:0/936933887 learned_addr learned my addr 172.21.15.82:0/936933887 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4009e00700 1 --2- 172.21.15.82:0/936933887 >> v2:172.21.15.129:3300/0 conn(0x7f400c15e290 0x7f400c0d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4003e00700 1 --2- 172.21.15.82:0/936933887 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c0d1020 0x7f400c0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4009400700 1 -- 172.21.15.82:0/936933887 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442942049 0 0) 0x7f4004001490 con 0x7f400c0cee80 2024-05-10T04:51:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4009400700 1 -- 172.21.15.82:0/936933887 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff00035b0 con 0x7f400c0cee80 2024-05-10T04:51:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4003e00700 1 -- 172.21.15.82:0/936933887 >> v2:172.21.15.129:3300/0 conn(0x7f400c15e290 msgr2=0x7f400c0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4003e00700 1 --2- 172.21.15.82:0/936933887 >> v2:172.21.15.129:3300/0 conn(0x7f400c15e290 0x7f400c0d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4003e00700 1 -- 172.21.15.82:0/936933887 >> v1:172.21.15.82:6789/0 conn(0x7f400c0cee80 legacy=0x7f400c0d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4003e00700 1 -- 172.21.15.82:0/936933887 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0cf550 con 0x7f400c0d1020 2024-05-10T04:51:12.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.305+0000 7f4009e00700 1 --2- 172.21.15.82:0/936933887 >> v2:172.21.15.129:3300/0 conn(0x7f400c15e290 0x7f400c0d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:12.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.306+0000 7f4003e00700 1 --2- 172.21.15.82:0/936933887 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c0d1020 0x7f400c0ce940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009840 tx=0x7f3ff4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ef6df7ac7b9f290 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.306+0000 7f4009400700 1 -- 172.21.15.82:0/936933887 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4011830 con 0x7f400c0d1020 2024-05-10T04:51:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.306+0000 7f4009400700 1 -- 172.21.15.82:0/936933887 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff4011990 con 0x7f400c0d1020 2024-05-10T04:51:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.306+0000 7f4009400700 1 -- 172.21.15.82:0/936933887 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4011d20 con 0x7f400c0d1020 2024-05-10T04:51:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.307+0000 7f400b200700 1 -- 172.21.15.82:0/936933887 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c0d1020 msgr2=0x7f400c0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.307+0000 7f400b200700 1 --2- 172.21.15.82:0/936933887 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c0d1020 0x7f400c0ce940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009840 tx=0x7f3ff4009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.307+0000 7f400b200700 1 -- 172.21.15.82:0/936933887 shutdown_connections 2024-05-10T04:51:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.307+0000 7f400b200700 1 --2- 172.21.15.82:0/936933887 >> v2:172.21.15.129:3300/0 conn(0x7f400c15e290 0x7f400c0d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.307+0000 7f400b200700 1 --2- 172.21.15.82:0/936933887 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c0d1020 0x7f400c0ce940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.307+0000 7f400b200700 1 -- 172.21.15.82:0/936933887 >> 172.21.15.82:0/936933887 conn(0x7f400c06c720 msgr2=0x7f400c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.307+0000 7f400b200700 1 -- 172.21.15.82:0/936933887 shutdown_connections 2024-05-10T04:51:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.307+0000 7f400b200700 1 -- 172.21.15.82:0/936933887 wait complete. 2024-05-10T04:51:12.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.310+0000 7f400b200700 1 Processor -- start 2024-05-10T04:51:12.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.310+0000 7f400b200700 1 -- start start 2024-05-10T04:51:12.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f400b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c0cee80 0x7f400c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f400b200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f400c0d1020 0x7f400c158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f400b200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c15e290 0x7f400c15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f400b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c1588c0 con 0x7f400c0cee80 2024-05-10T04:51:12.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f400b200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c159530 con 0x7f400c0d1020 2024-05-10T04:51:12.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f400b200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c1fa420 con 0x7f400c15e290 2024-05-10T04:51:12.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4009e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c0cee80 0x7f400c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4009e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c0cee80 0x7f400c14d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43424/0 (socket says 172.21.15.82:43424) 2024-05-10T04:51:12.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4009e00700 1 -- 172.21.15.82:0/109240808 learned_addr learned my addr 172.21.15.82:0/109240808 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:12.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f400a800700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c15e290 0x7f400c15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4003e00700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f400c0d1020 0x7f400c158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4009e00700 1 -- 172.21.15.82:0/109240808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c15e290 msgr2=0x7f400c15fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4009e00700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c15e290 0x7f400c15fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4009e00700 1 -- 172.21.15.82:0/109240808 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f400c0d1020 msgr2=0x7f400c158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4009e00700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f400c0d1020 0x7f400c158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.312+0000 7f4009e00700 1 -- 172.21.15.82:0/109240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0094a0 con 0x7f400c0cee80 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.313+0000 7f4009e00700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c0cee80 0x7f400c14d5b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00ebe0 tx=0x7f3ffc009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.313+0000 7f4002000700 1 -- 172.21.15.82:0/109240808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00c7f0 con 0x7f400c0cee80 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.313+0000 7f4002000700 1 -- 172.21.15.82:0/109240808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc00c950 con 0x7f400c0cee80 2024-05-10T04:51:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.313+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff40094a0 con 0x7f400c0cee80 2024-05-10T04:51:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.313+0000 7f4002000700 1 -- 172.21.15.82:0/109240808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00ccc0 con 0x7f400c0cee80 2024-05-10T04:51:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.313+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c161520 con 0x7f400c0cee80 2024-05-10T04:51:12.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.314+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c074af0 con 0x7f400c0cee80 2024-05-10T04:51:12.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.315+0000 7f4002000700 1 -- 172.21.15.82:0/109240808 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ffc013470 con 0x7f400c0cee80 2024-05-10T04:51:12.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.316+0000 7f4002000700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3fe806acc0 0x7f3fe806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.316+0000 7f4002000700 1 -- 172.21.15.82:0/109240808 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3ffc089930 con 0x7f400c0cee80 2024-05-10T04:51:12.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.316+0000 7f4003e00700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3fe806acc0 0x7f3fe806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.317+0000 7f4003e00700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3fe806acc0 0x7f3fe806d1d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009840 tx=0x7f3ff4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.321+0000 7f4002000700 1 -- 172.21.15.82:0/109240808 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3ffc054950 con 0x7f400c0cee80 2024-05-10T04:51:12.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.521+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f400c0d4730 con 0x7f400c0cee80 2024-05-10T04:51:12.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.522+0000 7f4002000700 1 -- 172.21.15.82:0/109240808 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ffc0210a0 con 0x7f400c0cee80 2024-05-10T04:51:12.523 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:51:12.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.524+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3fe806acc0 msgr2=0x7f3fe806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.524+0000 7f400b200700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3fe806acc0 0x7f3fe806d1d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009840 tx=0x7f3ff4008030 comp rx=0 tx=0).stop 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.524+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c0cee80 msgr2=0x7f400c14d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.524+0000 7f400b200700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c0cee80 0x7f400c14d5b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00ebe0 tx=0x7f3ffc009e00 comp rx=0 tx=0).stop 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.524+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 shutdown_connections 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.525+0000 7f400b200700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3fe806acc0 0x7f3fe806d1d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.525+0000 7f400b200700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f400c15e290 0x7f400c15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.525+0000 7f400b200700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f400c0cee80 0x7f400c14d5b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.525+0000 7f400b200700 1 --2- 172.21.15.82:0/109240808 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f400c0d1020 0x7f400c158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.525+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 >> 172.21.15.82:0/109240808 conn(0x7f400c06c720 msgr2=0x7f400c0d3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.525+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 shutdown_connections 2024-05-10T04:51:12.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.525+0000 7f400b200700 1 -- 172.21.15.82:0/109240808 wait complete. 2024-05-10T04:51:12.550 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:51:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.816+0000 7f78e9e00700 1 Processor -- start 2024-05-10T04:51:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.816+0000 7f78e9e00700 1 -- start start 2024-05-10T04:51:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.818+0000 7f78e9e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78e4162150 0x7f78e415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.818+0000 7f78e9e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f78e40cf4d0 0x7f78e40b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.818+0000 7f78e9e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e40b7910 0x7f78e406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.818+0000 7f78e9e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e40d2c00 con 0x7f78e4162150 2024-05-10T04:51:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.818+0000 7f78e9e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e4162630 con 0x7f78e40cf4d0 2024-05-10T04:51:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.818+0000 7f78e9e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4162910 con 0x7f78e40b7910 2024-05-10T04:51:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.818+0000 7f78e2a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78e4162150 0x7f78e415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78e4162150 0x7f78e415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43436/0 (socket says 172.21.15.82:43436) 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2a00700 1 -- 172.21.15.82:0/753507820 learned_addr learned my addr 172.21.15.82:0/753507820 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e3400700 1 --2- 172.21.15.82:0/753507820 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e40b7910 0x7f78e406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2a00700 1 -- 172.21.15.82:0/753507820 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e40b7910 msgr2=0x7f78e406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2a00700 1 --2- 172.21.15.82:0/753507820 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e40b7910 0x7f78e406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2a00700 1 -- 172.21.15.82:0/753507820 >> v2:172.21.15.129:3300/0 conn(0x7f78e40cf4d0 msgr2=0x7f78e40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2a00700 1 --2- 172.21.15.82:0/753507820 >> v2:172.21.15.129:3300/0 conn(0x7f78e40cf4d0 0x7f78e40b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2a00700 1 -- 172.21.15.82:0/753507820 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e4162bf0 con 0x7f78e4162150 2024-05-10T04:51:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2a00700 1 --2- 172.21.15.82:0/753507820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e4162150 0x7f78e415e610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f78d40098f0 tx=0x7f78d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95de22967deb6846 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.819+0000 7f78e2000700 1 -- 172.21.15.82:0/753507820 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d400b860 con 0x7f78e4162150 2024-05-10T04:51:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e2000700 1 -- 172.21.15.82:0/753507820 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d400b9c0 con 0x7f78e4162150 2024-05-10T04:51:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e2000700 1 -- 172.21.15.82:0/753507820 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d400bd50 con 0x7f78e4162150 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 -- 172.21.15.82:0/753507820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e4162150 msgr2=0x7f78e415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 --2- 172.21.15.82:0/753507820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e4162150 0x7f78e415e610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f78d40098f0 tx=0x7f78d4009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 -- 172.21.15.82:0/753507820 shutdown_connections 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 --2- 172.21.15.82:0/753507820 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e40b7910 0x7f78e406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 --2- 172.21.15.82:0/753507820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e4162150 0x7f78e415e610 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 --2- 172.21.15.82:0/753507820 >> v2:172.21.15.129:3300/0 conn(0x7f78e40cf4d0 0x7f78e40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 -- 172.21.15.82:0/753507820 >> 172.21.15.82:0/753507820 conn(0x7f78e40d3e10 msgr2=0x7f78e40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 -- 172.21.15.82:0/753507820 shutdown_connections 2024-05-10T04:51:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.820+0000 7f78e9e00700 1 -- 172.21.15.82:0/753507820 wait complete. 2024-05-10T04:51:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.823+0000 7f78e9e00700 1 Processor -- start 2024-05-10T04:51:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.823+0000 7f78e9e00700 1 -- start start 2024-05-10T04:51:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.824+0000 7f78e9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40b7910 0x7f78e40c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.824+0000 7f78e9e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78e40cf4d0 0x7f78e40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.824+0000 7f78e9e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e4162150 0x7f78e41f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.824+0000 7f78e9e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e41e7fc0 con 0x7f78e40b7910 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.824+0000 7f78e9e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e41e9720 con 0x7f78e40cf4d0 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.824+0000 7f78e9e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e40c7fb0 con 0x7f78e4162150 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40b7910 0x7f78e40c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40b7910 0x7f78e40c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43438/0 (socket says 172.21.15.82:43438) 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 -- 172.21.15.82:0/707704292 learned_addr learned my addr 172.21.15.82:0/707704292 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78dbe00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78e40cf4d0 0x7f78e40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e3400700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e4162150 0x7f78e41f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 -- 172.21.15.82:0/707704292 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e4162150 msgr2=0x7f78e41f7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e4162150 0x7f78e41f7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 -- 172.21.15.82:0/707704292 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78e40cf4d0 msgr2=0x7f78e40c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78e40cf4d0 0x7f78e40c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 -- 172.21.15.82:0/707704292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d4009550 con 0x7f78e40b7910 2024-05-10T04:51:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.825+0000 7f78e2a00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40b7910 0x7f78e40c69c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f78d4014040 tx=0x7f78d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.826+0000 7f78db400700 1 -- 172.21.15.82:0/707704292 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d40044d0 con 0x7f78e40b7910 2024-05-10T04:51:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.826+0000 7f78db400700 1 -- 172.21.15.82:0/707704292 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d401e070 con 0x7f78e40b7910 2024-05-10T04:51:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.826+0000 7f78db400700 1 -- 172.21.15.82:0/707704292 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d40038e0 con 0x7f78e40b7910 2024-05-10T04:51:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.826+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e40c8200 con 0x7f78e40b7910 2024-05-10T04:51:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.826+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e40c87c0 con 0x7f78e40b7910 2024-05-10T04:51:12.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.827+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e4074af0 con 0x7f78e40b7910 2024-05-10T04:51:12.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.828+0000 7f78db400700 1 -- 172.21.15.82:0/707704292 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f78d4003a40 con 0x7f78e40b7910 2024-05-10T04:51:12.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.829+0000 7f78db400700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78c006ac90 0x7f78c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:12.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.829+0000 7f78db400700 1 -- 172.21.15.82:0/707704292 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f78d4020070 con 0x7f78e40b7910 2024-05-10T04:51:12.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.829+0000 7f78dbe00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78c006ac90 0x7f78c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.830+0000 7f78dbe00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78c006ac90 0x7f78c006d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f78cc006fd0 tx=0x7f78cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:12.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:12.834+0000 7f78db400700 1 -- 172.21.15.82:0/707704292 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f78d4055a60 con 0x7f78e40b7910 2024-05-10T04:51:13.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.036+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78e4161ec0 con 0x7f78e40b7910 2024-05-10T04:51:13.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.036+0000 7f78db400700 1 -- 172.21.15.82:0/707704292 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78d4015020 con 0x7f78e40b7910 2024-05-10T04:51:13.037 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:51:13.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78c006ac90 msgr2=0x7f78c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78c006ac90 0x7f78c006d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f78cc006fd0 tx=0x7f78cc008040 comp rx=0 tx=0).stop 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40b7910 msgr2=0x7f78e40c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40b7910 0x7f78e40c69c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f78d4014040 tx=0x7f78d4004750 comp rx=0 tx=0).stop 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 shutdown_connections 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78c006ac90 0x7f78c006d1a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78e4162150 0x7f78e41f7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78e40b7910 0x7f78e40c69c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 --2- 172.21.15.82:0/707704292 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78e40cf4d0 0x7f78e40c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 >> 172.21.15.82:0/707704292 conn(0x7f78e40d3e10 msgr2=0x7f78e40b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 shutdown_connections 2024-05-10T04:51:13.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.039+0000 7f78e9e00700 1 -- 172.21.15.82:0/707704292 wait complete. 2024-05-10T04:51:13.063 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:51:13.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.334+0000 7fb85b200700 1 Processor -- start 2024-05-10T04:51:13.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.335+0000 7fb85b200700 1 -- start start 2024-05-10T04:51:13.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.336+0000 7fb85b200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb854162150 0x7fb85415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.336+0000 7fb85b200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8540d2c00 con 0x7fb8540cf4d0 2024-05-10T04:51:13.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.336+0000 7fb85b200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb854162630 con 0x7fb85406c160 2024-05-10T04:51:13.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.336+0000 7fb85b200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb854162910 con 0x7fb854162150 2024-05-10T04:51:13.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb853400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb8540cf4d0 0x7fb8540b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55440/0 (socket says 172.21.15.82:55440) 2024-05-10T04:51:13.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb853400700 1 -- 172.21.15.82:0/4293745486 learned_addr learned my addr 172.21.15.82:0/4293745486 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:13.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb853e00700 1 --2- 172.21.15.82:0/4293745486 >> v2:172.21.15.129:3300/0 conn(0x7fb854162150 0x7fb85415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb852a00700 1 -- 172.21.15.82:0/4293745486 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307294047 0 0) 0x7fb8540d2c00 con 0x7fb8540cf4d0 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb852a00700 1 -- 172.21.15.82:0/4293745486 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8380035b0 con 0x7fb8540cf4d0 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb852a00700 1 -- 172.21.15.82:0/4293745486 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1439462425 0 0) 0x7fb8380035b0 con 0x7fb8540cf4d0 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb853e00700 1 -- 172.21.15.82:0/4293745486 >> v1:172.21.15.129:6789/0 conn(0x7fb85406c160 legacy=0x7fb85406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb853e00700 1 -- 172.21.15.82:0/4293745486 >> v1:172.21.15.82:6789/0 conn(0x7fb8540cf4d0 legacy=0x7fb8540b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.337+0000 7fb853e00700 1 -- 172.21.15.82:0/4293745486 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854162bf0 con 0x7fb854162150 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.338+0000 7fb853e00700 1 --2- 172.21.15.82:0/4293745486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 0x7fb85415e610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb844009870 tx=0x7fb844009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921a6015bad0bf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.338+0000 7fb852a00700 1 -- 172.21.15.82:0/4293745486 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840001670 con 0x7fb854162150 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.338+0000 7fb852a00700 1 -- 172.21.15.82:0/4293745486 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb844004030 con 0x7fb854162150 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.338+0000 7fb852a00700 1 -- 172.21.15.82:0/4293745486 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440043c0 con 0x7fb854162150 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.339+0000 7fb85b200700 1 -- 172.21.15.82:0/4293745486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 msgr2=0x7fb85415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.339+0000 7fb85b200700 1 --2- 172.21.15.82:0/4293745486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 0x7fb85415e610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb844009870 tx=0x7fb844009b80 comp rx=0 tx=0).stop 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.339+0000 7fb85b200700 1 -- 172.21.15.82:0/4293745486 shutdown_connections 2024-05-10T04:51:13.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.339+0000 7fb85b200700 1 --2- 172.21.15.82:0/4293745486 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 0x7fb85415e610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.339+0000 7fb85b200700 1 -- 172.21.15.82:0/4293745486 >> 172.21.15.82:0/4293745486 conn(0x7fb8540d3e10 msgr2=0x7fb8540d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:13.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.339+0000 7fb85b200700 1 -- 172.21.15.82:0/4293745486 shutdown_connections 2024-05-10T04:51:13.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.339+0000 7fb85b200700 1 -- 172.21.15.82:0/4293745486 wait complete. 2024-05-10T04:51:13.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.342+0000 7fb85b200700 1 Processor -- start 2024-05-10T04:51:13.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.342+0000 7fb85b200700 1 -- start start 2024-05-10T04:51:13.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb85b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb85406c160 0x7fb8541f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb85b200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8540cf4d0 0x7fb85414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb85b200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 0x7fb854160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb85b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85415f0b0 con 0x7fb85406c160 2024-05-10T04:51:13.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb85b200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541f5070 con 0x7fb854162150 2024-05-10T04:51:13.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb85b200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541501e0 con 0x7fb8540cf4d0 2024-05-10T04:51:13.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb853e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb85406c160 0x7fb8541f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb853e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb85406c160 0x7fb8541f4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43450/0 (socket says 172.21.15.82:43450) 2024-05-10T04:51:13.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.343+0000 7fb853e00700 1 -- 172.21.15.82:0/655488603 learned_addr learned my addr 172.21.15.82:0/655488603 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:13.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb853400700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8540cf4d0 0x7fb85414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb859200700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 0x7fb854160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb853e00700 1 -- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8540cf4d0 msgr2=0x7fb85414f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb853e00700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8540cf4d0 0x7fb85414f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb853e00700 1 -- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 msgr2=0x7fb854160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb853e00700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 0x7fb854160f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb853e00700 1 -- 172.21.15.82:0/655488603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440094a0 con 0x7fb85406c160 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb859200700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 0x7fb854160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb853e00700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb85406c160 0x7fb8541f4a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb844000c00 tx=0x7fb8440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb84be00700 1 -- 172.21.15.82:0/655488603 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844011830 con 0x7fb85406c160 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb84be00700 1 -- 172.21.15.82:0/655488603 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8440119b0 con 0x7fb85406c160 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85414f810 con 0x7fb85406c160 2024-05-10T04:51:13.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.344+0000 7fb84be00700 1 -- 172.21.15.82:0/655488603 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844011d60 con 0x7fb85406c160 2024-05-10T04:51:13.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.345+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85414fee0 con 0x7fb85406c160 2024-05-10T04:51:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.346+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb854074af0 con 0x7fb85406c160 2024-05-10T04:51:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.347+0000 7fb84be00700 1 -- 172.21.15.82:0/655488603 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb84401b440 con 0x7fb85406c160 2024-05-10T04:51:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.347+0000 7fb84be00700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb83406ac90 0x7fb83406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.348+0000 7fb84be00700 1 -- 172.21.15.82:0/655488603 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb84408aa90 con 0x7fb85406c160 2024-05-10T04:51:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.348+0000 7fb853400700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb83406ac90 0x7fb83406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.348+0000 7fb853400700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb83406ac90 0x7fb83406d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8541590a0 tx=0x7fb840001be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:13.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.352+0000 7fb84be00700 1 -- 172.21.15.82:0/655488603 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb844055bd0 con 0x7fb85406c160 2024-05-10T04:51:13.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.554+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb854151780 con 0x7fb85406c160 2024-05-10T04:51:13.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.554+0000 7fb84be00700 1 -- 172.21.15.82:0/655488603 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8440591f0 con 0x7fb85406c160 2024-05-10T04:51:13.555 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:51:13.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.556+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb83406ac90 msgr2=0x7fb83406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.556+0000 7fb85b200700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb83406ac90 0x7fb83406d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8541590a0 tx=0x7fb840001be0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.556+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb85406c160 msgr2=0x7fb8541f4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.556+0000 7fb85b200700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb85406c160 0x7fb8541f4a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb844000c00 tx=0x7fb8440047c0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.557+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 shutdown_connections 2024-05-10T04:51:13.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.557+0000 7fb85b200700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb83406ac90 0x7fb83406d1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.557+0000 7fb85b200700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb854162150 0x7fb854160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.557+0000 7fb85b200700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb85406c160 0x7fb8541f4a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.557+0000 7fb85b200700 1 --2- 172.21.15.82:0/655488603 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8540cf4d0 0x7fb85414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.557+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 >> 172.21.15.82:0/655488603 conn(0x7fb8540d3e10 msgr2=0x7fb8540b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:13.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.557+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 shutdown_connections 2024-05-10T04:51:13.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.557+0000 7fb85b200700 1 -- 172.21.15.82:0/655488603 wait complete. 2024-05-10T04:51:13.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:51:13.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.851+0000 7f9b3d800700 1 Processor -- start 2024-05-10T04:51:13.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.851+0000 7f9b3d800700 1 -- start start 2024-05-10T04:51:13.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.853+0000 7f9b3d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380b2f50 0x7f9b38161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.853+0000 7f9b3d800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b380d28c0 con 0x7f9b380d0d40 2024-05-10T04:51:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.853+0000 7f9b3d800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b380d2ba0 con 0x7f9b380d3030 2024-05-10T04:51:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.853+0000 7f9b3d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380b3360 con 0x7f9b380b2f50 2024-05-10T04:51:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.853+0000 7f9b37400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9b380d0d40 0x7f9b380b7320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55444/0 (socket says 172.21.15.82:55444) 2024-05-10T04:51:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.853+0000 7f9b37400700 1 -- 172.21.15.82:0/4135170871 learned_addr learned my addr 172.21.15.82:0/4135170871 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.854+0000 7f9b36a00700 1 --2- 172.21.15.82:0/4135170871 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380b2f50 0x7f9b38161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.854+0000 7f9b36000700 1 -- 172.21.15.82:0/4135170871 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390506034 0 0) 0x7f9b380d28c0 con 0x7f9b380d0d40 2024-05-10T04:51:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.854+0000 7f9b36000700 1 -- 172.21.15.82:0/4135170871 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b1c0035b0 con 0x7f9b380d0d40 2024-05-10T04:51:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.854+0000 7f9b36000700 1 -- 172.21.15.82:0/4135170871 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930459458 0 0) 0x7f9b380d2ba0 con 0x7f9b380d3030 2024-05-10T04:51:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.854+0000 7f9b36000700 1 -- 172.21.15.82:0/4135170871 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b380d28c0 con 0x7f9b380d3030 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.854+0000 7f9b36a00700 1 -- 172.21.15.82:0/4135170871 >> v1:172.21.15.129:6789/0 conn(0x7f9b380d3030 legacy=0x7f9b380d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.854+0000 7f9b36a00700 1 -- 172.21.15.82:0/4135170871 >> v1:172.21.15.82:6789/0 conn(0x7f9b380d0d40 legacy=0x7f9b380b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.854+0000 7f9b36a00700 1 -- 172.21.15.82:0/4135170871 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b380cf970 con 0x7f9b380b2f50 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.855+0000 7f9b36a00700 1 --2- 172.21.15.82:0/4135170871 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380b2f50 0x7f9b38161fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009870 tx=0x7f9b28009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adec7da4caaa804a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.855+0000 7f9b36000700 1 -- 172.21.15.82:0/4135170871 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28011830 con 0x7f9b380b2f50 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.855+0000 7f9b36000700 1 -- 172.21.15.82:0/4135170871 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b28011990 con 0x7f9b380b2f50 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.855+0000 7f9b36000700 1 -- 172.21.15.82:0/4135170871 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28011d00 con 0x7f9b380b2f50 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.855+0000 7f9b3d800700 1 -- 172.21.15.82:0/4135170871 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380b2f50 msgr2=0x7f9b38161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.855+0000 7f9b3d800700 1 --2- 172.21.15.82:0/4135170871 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380b2f50 0x7f9b38161fa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009870 tx=0x7f9b28009b80 comp rx=0 tx=0).stop 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.856+0000 7f9b3d800700 1 -- 172.21.15.82:0/4135170871 shutdown_connections 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.856+0000 7f9b3d800700 1 --2- 172.21.15.82:0/4135170871 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380b2f50 0x7f9b38161fa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.856+0000 7f9b3d800700 1 -- 172.21.15.82:0/4135170871 >> 172.21.15.82:0/4135170871 conn(0x7f9b3806c3f0 msgr2=0x7f9b3806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:13.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.856+0000 7f9b3d800700 1 -- 172.21.15.82:0/4135170871 shutdown_connections 2024-05-10T04:51:13.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.856+0000 7f9b3d800700 1 -- 172.21.15.82:0/4135170871 wait complete. 2024-05-10T04:51:13.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.858+0000 7f9b3d800700 1 Processor -- start 2024-05-10T04:51:13.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.858+0000 7f9b3d800700 1 -- start start 2024-05-10T04:51:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.859+0000 7f9b3d800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b380b2f50 0x7f9b3814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b3d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380d0d40 0x7f9b380cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b3d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b380d3030 0x7f9b380b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b3d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3814d740 con 0x7f9b380d3030 2024-05-10T04:51:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b3d800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380ce100 con 0x7f9b380b2f50 2024-05-10T04:51:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b3d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b381617d0 con 0x7f9b380d0d40 2024-05-10T04:51:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b37400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b380d3030 0x7f9b380b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b37400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b380d3030 0x7f9b380b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43454/0 (socket says 172.21.15.82:43454) 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b37400700 1 -- 172.21.15.82:0/2530669940 learned_addr learned my addr 172.21.15.82:0/2530669940 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b2fe00700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380d0d40 0x7f9b380cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b36a00700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b380b2f50 0x7f9b3814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b37400700 1 -- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380d0d40 msgr2=0x7f9b380cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b37400700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380d0d40 0x7f9b380cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b37400700 1 -- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b380b2f50 msgr2=0x7f9b3814d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b37400700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b380b2f50 0x7f9b3814d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b37400700 1 -- 172.21.15.82:0/2530669940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b280094a0 con 0x7f9b380d3030 2024-05-10T04:51:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b2fe00700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380d0d40 0x7f9b380cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.860+0000 7f9b36a00700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b380b2f50 0x7f9b3814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.861+0000 7f9b37400700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b380d3030 0x7f9b380b3dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000caf0 tx=0x7f9b3000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.861+0000 7f9b2ea00700 1 -- 172.21.15.82:0/2530669940 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000aa90 con 0x7f9b380d3030 2024-05-10T04:51:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.861+0000 7f9b2ea00700 1 -- 172.21.15.82:0/2530669940 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3000abf0 con 0x7f9b380d3030 2024-05-10T04:51:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.861+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b380cb540 con 0x7f9b380d3030 2024-05-10T04:51:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.861+0000 7f9b2ea00700 1 -- 172.21.15.82:0/2530669940 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30012400 con 0x7f9b380d3030 2024-05-10T04:51:13.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.861+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3815f760 con 0x7f9b380d3030 2024-05-10T04:51:13.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.862+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b38074af0 con 0x7f9b380d3030 2024-05-10T04:51:13.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.863+0000 7f9b2ea00700 1 -- 172.21.15.82:0/2530669940 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9b3001b3b0 con 0x7f9b380d3030 2024-05-10T04:51:13.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.864+0000 7f9b2ea00700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9b1406acc0 0x7f9b1406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:13.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.864+0000 7f9b2ea00700 1 -- 172.21.15.82:0/2530669940 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9b30089140 con 0x7f9b380d3030 2024-05-10T04:51:13.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.864+0000 7f9b36a00700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9b1406acc0 0x7f9b1406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:13.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.865+0000 7f9b36a00700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9b1406acc0 0x7f9b1406d1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009870 tx=0x7f9b28008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:13.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:13.868+0000 7f9b2ea00700 1 -- 172.21.15.82:0/2530669940 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9b300541f0 con 0x7f9b380d3030 2024-05-10T04:51:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.088+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9b380b34a0 con 0x7f9b380d3030 2024-05-10T04:51:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.089+0000 7f9b2ea00700 1 -- 172.21.15.82:0/2530669940 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9b30057810 con 0x7f9b380d3030 2024-05-10T04:51:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9b1406acc0 msgr2=0x7f9b1406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9b1406acc0 0x7f9b1406d1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009870 tx=0x7f9b28008030 comp rx=0 tx=0).stop 2024-05-10T04:51:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b380d3030 msgr2=0x7f9b380b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b380d3030 0x7f9b380b3dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000caf0 tx=0x7f9b3000ceb0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 shutdown_connections 2024-05-10T04:51:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9b1406acc0 0x7f9b1406d1d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b380d3030 0x7f9b380b3dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9b380b2f50 0x7f9b3814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 --2- 172.21.15.82:0/2530669940 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9b380d0d40 0x7f9b380cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 >> 172.21.15.82:0/2530669940 conn(0x7f9b3806c3f0 msgr2=0x7f9b380d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.091+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 shutdown_connections 2024-05-10T04:51:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.092+0000 7f9b3d800700 1 -- 172.21.15.82:0/2530669940 wait complete. 2024-05-10T04:51:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2024-05-10T04:51:14.119 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-10T04:51:14.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:14.119 DEBUG:teuthology.orchestra.run.smithi129:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-10T04:51:14.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:51:14.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:14.198 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-10T04:51:14.246 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-10T04:51:14.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.508+0000 7fbea7e00700 1 Processor -- start 2024-05-10T04:51:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.508+0000 7fbea7e00700 1 -- start start 2024-05-10T04:51:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea7e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fbea015f4f0 0x7fbea00b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea7e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea00b5dd0 0x7fbea00b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea7e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea015f900 con 0x7fbea015bfe0 2024-05-10T04:51:14.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea7e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea015c3f0 con 0x7fbea015f4f0 2024-05-10T04:51:14.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea7e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00b61e0 con 0x7fbea00b5dd0 2024-05-10T04:51:14.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea5400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbea015bfe0 0x7fbea0161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55446/0 (socket says 172.21.15.82:55446) 2024-05-10T04:51:14.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea5400700 1 -- 172.21.15.82:0/1856599022 learned_addr learned my addr 172.21.15.82:0/1856599022 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:14.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea4a00700 1 --2- 172.21.15.82:0/1856599022 >> v2:172.21.15.129:3300/0 conn(0x7fbea015f4f0 0x7fbea00b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:14.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.510+0000 7fbea5e00700 1 --2- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea00b5dd0 0x7fbea00b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:14.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbe9fe00700 1 -- 172.21.15.82:0/1856599022 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306221375 0 0) 0x7fbe94001110 con 0x7fbea015bfe0 2024-05-10T04:51:14.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbe9fe00700 1 -- 172.21.15.82:0/1856599022 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe880035b0 con 0x7fbea015bfe0 2024-05-10T04:51:14.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbe9fe00700 1 -- 172.21.15.82:0/1856599022 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4001786200 0 0) 0x7fbe880035b0 con 0x7fbea015bfe0 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbea4a00700 1 -- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea00b5dd0 msgr2=0x7fbea00b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbea4a00700 1 --2- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea00b5dd0 0x7fbea00b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbea4a00700 1 -- 172.21.15.82:0/1856599022 >> v1:172.21.15.82:6789/0 conn(0x7fbea015bfe0 legacy=0x7fbea0161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbea4a00700 1 -- 172.21.15.82:0/1856599022 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea0162a70 con 0x7fbea015f4f0 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbea5e00700 1 --2- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea00b5dd0 0x7fbea00b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.511+0000 7fbea4a00700 1 --2- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 0x7fbea00b5890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009840 tx=0x7fbe8c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c77a66a94c051ca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.512+0000 7fbe9fe00700 1 -- 172.21.15.82:0/1856599022 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94001800 con 0x7fbea015f4f0 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.512+0000 7fbe9fe00700 1 -- 172.21.15.82:0/1856599022 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c004030 con 0x7fbea015f4f0 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.512+0000 7fbe9fe00700 1 -- 172.21.15.82:0/1856599022 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0043a0 con 0x7fbea015f4f0 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.512+0000 7fbea7e00700 1 -- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 msgr2=0x7fbea00b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.512+0000 7fbea7e00700 1 --2- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 0x7fbea00b5890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009840 tx=0x7fbe8c009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.512+0000 7fbea7e00700 1 -- 172.21.15.82:0/1856599022 shutdown_connections 2024-05-10T04:51:14.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.512+0000 7fbea7e00700 1 --2- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea00b5dd0 0x7fbea00b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.513+0000 7fbea7e00700 1 --2- 172.21.15.82:0/1856599022 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 0x7fbea00b5890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.513+0000 7fbea7e00700 1 -- 172.21.15.82:0/1856599022 >> 172.21.15.82:0/1856599022 conn(0x7fbea00d0a70 msgr2=0x7fbea00d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.513+0000 7fbea7e00700 1 -- 172.21.15.82:0/1856599022 shutdown_connections 2024-05-10T04:51:14.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.513+0000 7fbea7e00700 1 -- 172.21.15.82:0/1856599022 wait complete. 2024-05-10T04:51:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.515+0000 7fbea7e00700 1 Processor -- start 2024-05-10T04:51:14.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.515+0000 7fbea7e00700 1 -- start start 2024-05-10T04:51:14.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00b5dd0 0x7fbea014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:14.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea7e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea015bfe0 0x7fbea014e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:14.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea7e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 0x7fbea00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:14.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea7e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea014f5a0 con 0x7fbea00b5dd0 2024-05-10T04:51:14.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea7e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00cb9a0 con 0x7fbea015f4f0 2024-05-10T04:51:14.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea7e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00cccb0 con 0x7fbea015bfe0 2024-05-10T04:51:14.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00b5dd0 0x7fbea014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:14.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00b5dd0 0x7fbea014eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43468/0 (socket says 172.21.15.82:43468) 2024-05-10T04:51:14.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5400700 1 -- 172.21.15.82:0/3113181835 learned_addr learned my addr 172.21.15.82:0/3113181835 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:14.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea4a00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea015bfe0 0x7fbea014e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:14.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5e00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 0x7fbea00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:14.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5400700 1 -- 172.21.15.82:0/3113181835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea015bfe0 msgr2=0x7fbea014e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:14.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5400700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea015bfe0 0x7fbea014e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5400700 1 -- 172.21.15.82:0/3113181835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 msgr2=0x7fbea00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:14.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5400700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 0x7fbea00caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.517+0000 7fbea5400700 1 -- 172.21.15.82:0/3113181835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009a70 con 0x7fbea00b5dd0 2024-05-10T04:51:14.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.518+0000 7fbea5400700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00b5dd0 0x7fbea014eca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400c520 tx=0x7fbe9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:14.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.518+0000 7fbe9d600700 1 -- 172.21.15.82:0/3113181835 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94004c80 con 0x7fbea00b5dd0 2024-05-10T04:51:14.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.518+0000 7fbe9d600700 1 -- 172.21.15.82:0/3113181835 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe94004e00 con 0x7fbea00b5dd0 2024-05-10T04:51:14.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.518+0000 7fbe9d600700 1 -- 172.21.15.82:0/3113181835 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94007310 con 0x7fbea00b5dd0 2024-05-10T04:51:14.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.518+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c0094a0 con 0x7fbea00b5dd0 2024-05-10T04:51:14.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.518+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea00cbed0 con 0x7fbea00b5dd0 2024-05-10T04:51:14.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.519+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea0074af0 con 0x7fbea00b5dd0 2024-05-10T04:51:14.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.520+0000 7fbe9d600700 1 -- 172.21.15.82:0/3113181835 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe94007470 con 0x7fbea00b5dd0 2024-05-10T04:51:14.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.521+0000 7fbe9d600700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbe8006ac90 0x7fbe8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:14.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.522+0000 7fbe9d600700 1 -- 172.21.15.82:0/3113181835 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fbe94088ff0 con 0x7fbea00b5dd0 2024-05-10T04:51:14.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.522+0000 7fbea4a00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbe8006ac90 0x7fbe8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:14.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.522+0000 7fbea4a00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbe8006ac90 0x7fbe8006d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0090b0 tx=0x7fbe8c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:14.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.527+0000 7fbe9d600700 1 -- 172.21.15.82:0/3113181835 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbe94054100 con 0x7fbea00b5dd0 2024-05-10T04:51:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.776+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbea015f900 con 0x7fbea00b5dd0 2024-05-10T04:51:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.777+0000 7fbe9d600700 1 -- 172.21.15.82:0/3113181835 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7fbea015f900 con 0x7fbea00b5dd0 2024-05-10T04:51:14.777 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:14.778 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:50:16.068598+0000","modified":"2024-05-10T04:50:19.501679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:51:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.779+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbe8006ac90 msgr2=0x7fbe8006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.779+0000 7fbea7e00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbe8006ac90 0x7fbe8006d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0090b0 tx=0x7fbe8c008030 comp rx=0 tx=0).stop 2024-05-10T04:51:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.779+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00b5dd0 msgr2=0x7fbea014eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.779+0000 7fbea7e00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00b5dd0 0x7fbea014eca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400c520 tx=0x7fbe9400c830 comp rx=0 tx=0).stop 2024-05-10T04:51:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.780+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 shutdown_connections 2024-05-10T04:51:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.780+0000 7fbea7e00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbe8006ac90 0x7fbe8006d1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.780+0000 7fbea7e00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbea015f4f0 0x7fbea00caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.780+0000 7fbea7e00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea00b5dd0 0x7fbea014eca0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.780+0000 7fbea7e00700 1 --2- 172.21.15.82:0/3113181835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbea015bfe0 0x7fbea014e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.780+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 >> 172.21.15.82:0/3113181835 conn(0x7fbea00d0a70 msgr2=0x7fbea00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.780+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 shutdown_connections 2024-05-10T04:51:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:14.780+0000 7fbea7e00700 1 -- 172.21.15.82:0/3113181835 wait complete. 2024-05-10T04:51:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-10T04:51:14.808 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:15.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.071+0000 7f3b9fa00700 1 Processor -- start 2024-05-10T04:51:15.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.072+0000 7f3b9fa00700 1 -- start start 2024-05-10T04:51:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.073+0000 7f3b9fa00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b9815f9f0 0x7f3b9806f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.073+0000 7f3b9fa00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3b980cb9e0 0x7f3b9815c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.073+0000 7f3b9fa00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980cbdf0 con 0x7f3b980ce760 2024-05-10T04:51:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.073+0000 7f3b9fa00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9806da60 con 0x7f3b980cb9e0 2024-05-10T04:51:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.073+0000 7f3b9fa00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9815f5d0 con 0x7f3b9815f9f0 2024-05-10T04:51:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b97e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3b980cb9e0 0x7f3b9815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b97e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3b980cb9e0 0x7f3b9815c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43484/0 (socket says 172.21.15.82:43484) 2024-05-10T04:51:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b97e00700 1 -- 172.21.15.82:0/156481052 learned_addr learned my addr 172.21.15.82:0/156481052 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b9d000700 1 --2- 172.21.15.82:0/156481052 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b9815f9f0 0x7f3b9806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b97e00700 1 -- 172.21.15.82:0/156481052 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b9815f9f0 msgr2=0x7f3b9806f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b97e00700 1 --2- 172.21.15.82:0/156481052 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b9815f9f0 0x7f3b9806f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b97e00700 1 -- 172.21.15.82:0/156481052 >> v1:172.21.15.129:6789/0 conn(0x7f3b980ce760 legacy=0x7f3b980ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b97e00700 1 -- 172.21.15.82:0/156481052 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9815ecc0 con 0x7f3b980cb9e0 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.074+0000 7f3b97e00700 1 --2- 172.21.15.82:0/156481052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9815c150 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b840098f0 tx=0x7f3b84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b28480416b7742 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b97400700 1 -- 172.21.15.82:0/156481052 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400b8a0 con 0x7f3b980cb9e0 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b97400700 1 -- 172.21.15.82:0/156481052 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8400ba00 con 0x7f3b980cb9e0 2024-05-10T04:51:15.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b97400700 1 -- 172.21.15.82:0/156481052 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400bd90 con 0x7f3b980cb9e0 2024-05-10T04:51:15.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b9fa00700 1 -- 172.21.15.82:0/156481052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 msgr2=0x7f3b9815c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/156481052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9815c150 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b840098f0 tx=0x7f3b84009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:15.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b9fa00700 1 -- 172.21.15.82:0/156481052 shutdown_connections 2024-05-10T04:51:15.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/156481052 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b9815f9f0 0x7f3b9806f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/156481052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9815c150 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.075+0000 7f3b9fa00700 1 -- 172.21.15.82:0/156481052 >> 172.21.15.82:0/156481052 conn(0x7f3b980cfa80 msgr2=0x7f3b980cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:15.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.076+0000 7f3b9fa00700 1 -- 172.21.15.82:0/156481052 shutdown_connections 2024-05-10T04:51:15.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.076+0000 7f3b9fa00700 1 -- 172.21.15.82:0/156481052 wait complete. 2024-05-10T04:51:15.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.078+0000 7f3b9fa00700 1 Processor -- start 2024-05-10T04:51:15.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.079+0000 7f3b9fa00700 1 -- start start 2024-05-10T04:51:15.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.080+0000 7f3b9fa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.080+0000 7f3b9fa00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b980ce760 0x7f3b98142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.080+0000 7f3b9fa00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b9814b080 0x7f3b98153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.080+0000 7f3b9fa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98154890 con 0x7f3b980cb9e0 2024-05-10T04:51:15.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.080+0000 7f3b9fa00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9814e620 con 0x7f3b9814b080 2024-05-10T04:51:15.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.080+0000 7f3b9fa00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9814eb50 con 0x7f3b980ce760 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.080+0000 7f3b9d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9814d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43486/0 (socket says 172.21.15.82:43486) 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9d000700 1 -- 172.21.15.82:0/2438259889 learned_addr learned my addr 172.21.15.82:0/2438259889 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b97e00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b980ce760 0x7f3b98142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9da00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b9814b080 0x7f3b98153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9d000700 1 -- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b980ce760 msgr2=0x7f3b98142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9d000700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b980ce760 0x7f3b98142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9d000700 1 -- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b9814b080 msgr2=0x7f3b98153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9d000700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b9814b080 0x7f3b98153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9d000700 1 -- 172.21.15.82:0/2438259889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84009550 con 0x7f3b980cb9e0 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9da00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b9814b080 0x7f3b98153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b9d000700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9814d630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00d800 tx=0x7f3b8c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.081+0000 7f3b94c00700 1 -- 172.21.15.82:0/2438259889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0125f0 con 0x7f3b980cb9e0 2024-05-10T04:51:15.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.082+0000 7f3b94c00700 1 -- 172.21.15.82:0/2438259889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c012750 con 0x7f3b980cb9e0 2024-05-10T04:51:15.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.082+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9814e870 con 0x7f3b980cb9e0 2024-05-10T04:51:15.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.082+0000 7f3b94c00700 1 -- 172.21.15.82:0/2438259889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c012b00 con 0x7f3b980cb9e0 2024-05-10T04:51:15.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.082+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9814ce30 con 0x7f3b980cb9e0 2024-05-10T04:51:15.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.083+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9814c9b0 con 0x7f3b980cb9e0 2024-05-10T04:51:15.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.084+0000 7f3b94c00700 1 -- 172.21.15.82:0/2438259889 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b8c012c60 con 0x7f3b980cb9e0 2024-05-10T04:51:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.085+0000 7f3b94c00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3b7806ac90 0x7f3b7806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.085+0000 7f3b94c00700 1 -- 172.21.15.82:0/2438259889 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3b8c089890 con 0x7f3b980cb9e0 2024-05-10T04:51:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.085+0000 7f3b97e00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3b7806ac90 0x7f3b7806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.086+0000 7f3b97e00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3b7806ac90 0x7f3b7806d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b9804f730 tx=0x7f3b84008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:15.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.090+0000 7f3b94c00700 1 -- 172.21.15.82:0/2438259889 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3b9814c9b0 con 0x7f3b980cb9e0 2024-05-10T04:51:15.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.294+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b9814c9b0 con 0x7f3b980cb9e0 2024-05-10T04:51:15.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.295+0000 7f3b94c00700 1 -- 172.21.15.82:0/2438259889 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16333 (secure 0 0 0) 0x7f3b9814c9b0 con 0x7f3b980cb9e0 2024-05-10T04:51:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:15.296 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:58.666687+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3b7806ac90 msgr2=0x7f3b7806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3b7806ac90 0x7f3b7806d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b9804f730 tx=0x7f3b84008030 comp rx=0 tx=0).stop 2024-05-10T04:51:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 msgr2=0x7f3b9814d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9814d630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00d800 tx=0x7f3b8c00dbc0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 shutdown_connections 2024-05-10T04:51:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f3b7806ac90 0x7f3b7806d1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3b9814b080 0x7f3b98153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b980cb9e0 0x7f3b9814d630 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 --2- 172.21.15.82:0/2438259889 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f3b980ce760 0x7f3b98142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 >> 172.21.15.82:0/2438259889 conn(0x7f3b980cfa80 msgr2=0x7f3b980d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 shutdown_connections 2024-05-10T04:51:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.298+0000 7f3b9fa00700 1 -- 172.21.15.82:0/2438259889 wait complete. 2024-05-10T04:51:15.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:50:13.920579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:50:15.048532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:51:15.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:51:15.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.593+0000 7f7c27e00700 1 Processor -- start 2024-05-10T04:51:15.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.594+0000 7f7c27e00700 1 -- start start 2024-05-10T04:51:15.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.595+0000 7f7c27e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c2815beb0 0x7f7c2815f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.595+0000 7f7c27e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815e790 0x7f7c2815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.595+0000 7f7c27e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c280d2590 con 0x7f7c2806c1a0 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.595+0000 7f7c27e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280cec30 con 0x7f7c2815beb0 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.595+0000 7f7c27e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815fe90 con 0x7f7c2815e790 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c26a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c2815beb0 0x7f7c2815f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c26a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c2815beb0 0x7f7c2815f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43488/0 (socket says 172.21.15.82:43488) 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c26a00700 1 -- 172.21.15.82:0/1705423596 learned_addr learned my addr 172.21.15.82:0/1705423596 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c27400700 1 --2- 172.21.15.82:0/1705423596 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815e790 0x7f7c2815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c26a00700 1 -- 172.21.15.82:0/1705423596 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815e790 msgr2=0x7f7c2815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c26a00700 1 --2- 172.21.15.82:0/1705423596 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815e790 0x7f7c2815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c26a00700 1 -- 172.21.15.82:0/1705423596 >> v1:172.21.15.129:6789/0 conn(0x7f7c2806c1a0 legacy=0x7f7c2806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:15.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c26a00700 1 -- 172.21.15.82:0/1705423596 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2815f730 con 0x7f7c2815beb0 2024-05-10T04:51:15.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.596+0000 7f7c26a00700 1 --2- 172.21.15.82:0/1705423596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815beb0 0x7f7c2815f950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7c180098f0 tx=0x7f7c18009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea8c7115aa832b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:15.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c26000700 1 -- 172.21.15.82:0/1705423596 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800b8a0 con 0x7f7c2815beb0 2024-05-10T04:51:15.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c26000700 1 -- 172.21.15.82:0/1705423596 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1800ba00 con 0x7f7c2815beb0 2024-05-10T04:51:15.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c26000700 1 -- 172.21.15.82:0/1705423596 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800bd90 con 0x7f7c2815beb0 2024-05-10T04:51:15.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c27e00700 1 -- 172.21.15.82:0/1705423596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815beb0 msgr2=0x7f7c2815f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c27e00700 1 --2- 172.21.15.82:0/1705423596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815beb0 0x7f7c2815f950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7c180098f0 tx=0x7f7c18009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:15.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c27e00700 1 -- 172.21.15.82:0/1705423596 shutdown_connections 2024-05-10T04:51:15.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c27e00700 1 --2- 172.21.15.82:0/1705423596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815beb0 0x7f7c2815f950 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c27e00700 1 --2- 172.21.15.82:0/1705423596 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815e790 0x7f7c2815eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c27e00700 1 -- 172.21.15.82:0/1705423596 >> 172.21.15.82:0/1705423596 conn(0x7f7c280d3be0 msgr2=0x7f7c280d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:15.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.597+0000 7f7c27e00700 1 -- 172.21.15.82:0/1705423596 shutdown_connections 2024-05-10T04:51:15.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.598+0000 7f7c27e00700 1 -- 172.21.15.82:0/1705423596 wait complete. 2024-05-10T04:51:15.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.600+0000 7f7c27e00700 1 Processor -- start 2024-05-10T04:51:15.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.600+0000 7f7c27e00700 1 -- start start 2024-05-10T04:51:15.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.601+0000 7f7c27e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c2806c1a0 0x7f7c281f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.601+0000 7f7c27e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815beb0 0x7f7c280cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.601+0000 7f7c27e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815e790 0x7f7c280ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.601+0000 7f7c27e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281f5f50 con 0x7f7c2815e790 2024-05-10T04:51:15.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.601+0000 7f7c27e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280c7a10 con 0x7f7c2806c1a0 2024-05-10T04:51:15.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.601+0000 7f7c27e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280c8870 con 0x7f7c2815beb0 2024-05-10T04:51:15.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.601+0000 7f7c27400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815e790 0x7f7c280ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c27400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815e790 0x7f7c280ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43494/0 (socket says 172.21.15.82:43494) 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c27400700 1 -- 172.21.15.82:0/3055726723 learned_addr learned my addr 172.21.15.82:0/3055726723 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c26a00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c2806c1a0 0x7f7c281f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c27400700 1 -- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815beb0 msgr2=0x7f7c280cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c1fe00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815beb0 0x7f7c280cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c27400700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815beb0 0x7f7c280cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c27400700 1 -- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c2806c1a0 msgr2=0x7f7c281f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c27400700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c2806c1a0 0x7f7c281f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c27400700 1 -- 172.21.15.82:0/3055726723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009550 con 0x7f7c2815e790 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c1fe00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815beb0 0x7f7c280cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c26a00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c2806c1a0 0x7f7c281f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.602+0000 7f7c27400700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815e790 0x7f7c280ccf20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c20007e90 tx=0x7f7c2000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.603+0000 7f7c1ea00700 1 -- 172.21.15.82:0/3055726723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000ede0 con 0x7f7c2815e790 2024-05-10T04:51:15.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.603+0000 7f7c1ea00700 1 -- 172.21.15.82:0/3055726723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c20014420 con 0x7f7c2815e790 2024-05-10T04:51:15.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.603+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c281f4800 con 0x7f7c2815e790 2024-05-10T04:51:15.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.603+0000 7f7c1ea00700 1 -- 172.21.15.82:0/3055726723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c200147d0 con 0x7f7c2815e790 2024-05-10T04:51:15.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.603+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c280c7f40 con 0x7f7c2815e790 2024-05-10T04:51:15.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.604+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c28074af0 con 0x7f7c2815e790 2024-05-10T04:51:15.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.605+0000 7f7c1ea00700 1 -- 172.21.15.82:0/3055726723 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c20014930 con 0x7f7c2815e790 2024-05-10T04:51:15.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.606+0000 7f7c1ea00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c0406ac90 0x7f7c0406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:15.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.606+0000 7f7c1ea00700 1 -- 172.21.15.82:0/3055726723 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7c20089b20 con 0x7f7c2815e790 2024-05-10T04:51:15.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.606+0000 7f7c26a00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c0406ac90 0x7f7c0406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:15.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.607+0000 7f7c26a00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c0406ac90 0x7f7c0406d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7c180098f0 tx=0x7f7c18008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:15.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.610+0000 7f7c1ea00700 1 -- 172.21.15.82:0/3055726723 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7c20054c70 con 0x7f7c2815e790 2024-05-10T04:51:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.813+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c280d1710 con 0x7f7c2815e790 2024-05-10T04:51:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.814+0000 7f7c1ea00700 1 -- 172.21.15.82:0/3055726723 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c20058290 con 0x7f7c2815e790 2024-05-10T04:51:15.814 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:51:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c0406ac90 msgr2=0x7f7c0406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c0406ac90 0x7f7c0406d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7c180098f0 tx=0x7f7c18008030 comp rx=0 tx=0).stop 2024-05-10T04:51:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815e790 msgr2=0x7f7c280ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815e790 0x7f7c280ccf20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c20007e90 tx=0x7f7c2000e3c0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 shutdown_connections 2024-05-10T04:51:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c0406ac90 0x7f7c0406d1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2815e790 0x7f7c280ccf20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c2806c1a0 0x7f7c281f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 --2- 172.21.15.82:0/3055726723 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c2815beb0 0x7f7c280cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.816+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 >> 172.21.15.82:0/3055726723 conn(0x7f7c280d3be0 msgr2=0x7f7c2815c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.817+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 shutdown_connections 2024-05-10T04:51:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:15.817+0000 7f7c27e00700 1 -- 172.21.15.82:0/3055726723 wait complete. 2024-05-10T04:51:15.842 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:51:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.106+0000 7fe9b7800700 1 Processor -- start 2024-05-10T04:51:16.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.106+0000 7fe9b7800700 1 -- start start 2024-05-10T04:51:16.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.108+0000 7fe9b7800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe9b015e610 0x7fe9b00b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.108+0000 7fe9b7800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b00d2c00 con 0x7fe9b00b7910 2024-05-10T04:51:16.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.108+0000 7fe9b7800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b015ea20 con 0x7fe9b0162150 2024-05-10T04:51:16.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.108+0000 7fe9b7800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b0162630 con 0x7fe9b015e610 2024-05-10T04:51:16.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.108+0000 7fe9b5800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe9b00b7910 0x7fe9b006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35510/0 (socket says 172.21.15.82:35510) 2024-05-10T04:51:16.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.108+0000 7fe9b5800700 1 -- 172.21.15.82:0/1210450902 learned_addr learned my addr 172.21.15.82:0/1210450902 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.108+0000 7fe9afe00700 1 --2- 172.21.15.82:0/1210450902 >> v2:172.21.15.129:3300/0 conn(0x7fe9b015e610 0x7fe9b00b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.109+0000 7fe9af400700 1 -- 172.21.15.82:0/1210450902 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663364315 0 0) 0x7fe9b00d2c00 con 0x7fe9b00b7910 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.109+0000 7fe9af400700 1 -- 172.21.15.82:0/1210450902 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9980035b0 con 0x7fe9b00b7910 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.109+0000 7fe9afe00700 1 -- 172.21.15.82:0/1210450902 >> v1:172.21.15.129:6789/0 conn(0x7fe9b0162150 legacy=0x7fe9b00cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.109+0000 7fe9afe00700 1 -- 172.21.15.82:0/1210450902 >> v1:172.21.15.82:6789/0 conn(0x7fe9b00b7910 legacy=0x7fe9b006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.109+0000 7fe9afe00700 1 -- 172.21.15.82:0/1210450902 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b0162910 con 0x7fe9b015e610 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.109+0000 7fe9afe00700 1 --2- 172.21.15.82:0/1210450902 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b015e610 0x7fe9b00b73d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009840 tx=0x7fe99c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32e29bfeab8167c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.110+0000 7fe9af400700 1 -- 172.21.15.82:0/1210450902 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c011830 con 0x7fe9b015e610 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.110+0000 7fe9af400700 1 -- 172.21.15.82:0/1210450902 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c011990 con 0x7fe9b015e610 2024-05-10T04:51:16.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.110+0000 7fe9af400700 1 -- 172.21.15.82:0/1210450902 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c011d00 con 0x7fe9b015e610 2024-05-10T04:51:16.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.110+0000 7fe9b7800700 1 -- 172.21.15.82:0/1210450902 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b015e610 msgr2=0x7fe9b00b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.110+0000 7fe9b7800700 1 --2- 172.21.15.82:0/1210450902 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b015e610 0x7fe9b00b73d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009840 tx=0x7fe99c009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:16.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.110+0000 7fe9b7800700 1 -- 172.21.15.82:0/1210450902 shutdown_connections 2024-05-10T04:51:16.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.110+0000 7fe9b7800700 1 --2- 172.21.15.82:0/1210450902 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b015e610 0x7fe9b00b73d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.110+0000 7fe9b7800700 1 -- 172.21.15.82:0/1210450902 >> 172.21.15.82:0/1210450902 conn(0x7fe9b00d3e10 msgr2=0x7fe9b00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:16.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.111+0000 7fe9b7800700 1 -- 172.21.15.82:0/1210450902 shutdown_connections 2024-05-10T04:51:16.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.111+0000 7fe9b7800700 1 -- 172.21.15.82:0/1210450902 wait complete. 2024-05-10T04:51:16.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.113+0000 7fe9b7800700 1 Processor -- start 2024-05-10T04:51:16.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.113+0000 7fe9b7800700 1 -- start start 2024-05-10T04:51:16.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.114+0000 7fe9b7800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b00b7910 0x7fe9b0153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.114+0000 7fe9b7800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9b015e610 0x7fe9b014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.114+0000 7fe9b7800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b0162150 0x7fe9b01e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.114+0000 7fe9b7800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b0160400 con 0x7fe9b0162150 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.114+0000 7fe9b7800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b0153a90 con 0x7fe9b00b7910 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.114+0000 7fe9b7800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b01ea720 con 0x7fe9b015e610 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b0162150 0x7fe9b01e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b0162150 0x7fe9b01e7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51086/0 (socket says 172.21.15.82:51086) 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 -- 172.21.15.82:0/1015542354 learned_addr learned my addr 172.21.15.82:0/1015542354 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b4e00700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b00b7910 0x7fe9b0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9afe00700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9b015e610 0x7fe9b014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 -- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9b015e610 msgr2=0x7fe9b014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9b015e610 0x7fe9b014fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 -- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b00b7910 msgr2=0x7fe9b0153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b00b7910 0x7fe9b0153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 -- 172.21.15.82:0/1015542354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0094a0 con 0x7fe9b0162150 2024-05-10T04:51:16.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b4e00700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b00b7910 0x7fe9b0153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9b5800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b0162150 0x7fe9b01e7f50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800cad0 tx=0x7fe9a800ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.115+0000 7fe9acc00700 1 -- 172.21.15.82:0/1015542354 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a800aac0 con 0x7fe9b0162150 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.116+0000 7fe9acc00700 1 -- 172.21.15.82:0/1015542354 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a800ac20 con 0x7fe9b0162150 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.116+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b01611d0 con 0x7fe9b0162150 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.116+0000 7fe9acc00700 1 -- 172.21.15.82:0/1015542354 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8012400 con 0x7fe9b0162150 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.116+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b0153fc0 con 0x7fe9b0162150 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.117+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b0074af0 con 0x7fe9b0162150 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.118+0000 7fe9acc00700 1 -- 172.21.15.82:0/1015542354 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe9a801b3b0 con 0x7fe9b0162150 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.118+0000 7fe9acc00700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe99006ac90 0x7fe99006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.119+0000 7fe9acc00700 1 -- 172.21.15.82:0/1015542354 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe9a8089240 con 0x7fe9b0162150 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.119+0000 7fe9b4e00700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe99006ac90 0x7fe99006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.119+0000 7fe9b4e00700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe99006ac90 0x7fe99006d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4000f60 tx=0x7fe9a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:16.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.124+0000 7fe9acc00700 1 -- 172.21.15.82:0/1015542354 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe9a8054260 con 0x7fe9b0162150 2024-05-10T04:51:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.324+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9b0161ec0 con 0x7fe9b0162150 2024-05-10T04:51:16.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.325+0000 7fe9acc00700 1 -- 172.21.15.82:0/1015542354 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9a8057880 con 0x7fe9b0162150 2024-05-10T04:51:16.326 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:51:16.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.327+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe99006ac90 msgr2=0x7fe99006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.327+0000 7fe9b7800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe99006ac90 0x7fe99006d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4000f60 tx=0x7fe9a4009040 comp rx=0 tx=0).stop 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.327+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b0162150 msgr2=0x7fe9b01e7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.327+0000 7fe9b7800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b0162150 0x7fe9b01e7f50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800cad0 tx=0x7fe9a800ce90 comp rx=0 tx=0).stop 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.328+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 shutdown_connections 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.328+0000 7fe9b7800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe99006ac90 0x7fe99006d1a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.328+0000 7fe9b7800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b0162150 0x7fe9b01e7f50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.328+0000 7fe9b7800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe9b00b7910 0x7fe9b0153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.328+0000 7fe9b7800700 1 --2- 172.21.15.82:0/1015542354 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe9b015e610 0x7fe9b014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.328+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 >> 172.21.15.82:0/1015542354 conn(0x7fe9b00d3e10 msgr2=0x7fe9b015a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:16.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.328+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 shutdown_connections 2024-05-10T04:51:16.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.328+0000 7fe9b7800700 1 -- 172.21.15.82:0/1015542354 wait complete. 2024-05-10T04:51:16.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:51:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.619+0000 7f5087800700 1 Processor -- start 2024-05-10T04:51:16.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.619+0000 7f5087800700 1 -- start start 2024-05-10T04:51:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5087800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50800b13a0 0x7f50800b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5087800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 0x7f50800cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5087800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50800cb9d0 con 0x7f50800b1fe0 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5087800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508015ec70 con 0x7f50800b13a0 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5087800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50800b17b0 con 0x7f50800d05b0 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5084e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50800b13a0 0x7f50800b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5084e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50800b13a0 0x7f50800b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51088/0 (socket says 172.21.15.82:51088) 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5084e00700 1 -- 172.21.15.82:0/2818329341 learned_addr learned my addr 172.21.15.82:0/2818329341 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5085800700 1 --2- 172.21.15.82:0/2818329341 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 0x7f50800cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5084e00700 1 -- 172.21.15.82:0/2818329341 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 msgr2=0x7f50800cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5084e00700 1 --2- 172.21.15.82:0/2818329341 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 0x7f50800cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5084e00700 1 -- 172.21.15.82:0/2818329341 >> v1:172.21.15.129:6789/0 conn(0x7f50800b1fe0 legacy=0x7f50800cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.621+0000 7f5084e00700 1 -- 172.21.15.82:0/2818329341 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50800ce240 con 0x7f50800b13a0 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.622+0000 7f5084e00700 1 --2- 172.21.15.82:0/2818329341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b13a0 0x7f50800b39e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f50740098f0 tx=0x7f5074009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d2feac69534c1b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.622+0000 7f507f400700 1 -- 172.21.15.82:0/2818329341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400b8a0 con 0x7f50800b13a0 2024-05-10T04:51:16.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.622+0000 7f507f400700 1 -- 172.21.15.82:0/2818329341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507400ba00 con 0x7f50800b13a0 2024-05-10T04:51:16.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.622+0000 7f507f400700 1 -- 172.21.15.82:0/2818329341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400bd90 con 0x7f50800b13a0 2024-05-10T04:51:16.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.623+0000 7f5087800700 1 -- 172.21.15.82:0/2818329341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b13a0 msgr2=0x7f50800b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.623+0000 7f5087800700 1 --2- 172.21.15.82:0/2818329341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b13a0 0x7f50800b39e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f50740098f0 tx=0x7f5074009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.623+0000 7f5087800700 1 -- 172.21.15.82:0/2818329341 shutdown_connections 2024-05-10T04:51:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.623+0000 7f5087800700 1 --2- 172.21.15.82:0/2818329341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b13a0 0x7f50800b39e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.623+0000 7f5087800700 1 --2- 172.21.15.82:0/2818329341 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 0x7f50800cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.623+0000 7f5087800700 1 -- 172.21.15.82:0/2818329341 >> 172.21.15.82:0/2818329341 conn(0x7f50800b26a0 msgr2=0x7f50800b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.623+0000 7f5087800700 1 -- 172.21.15.82:0/2818329341 shutdown_connections 2024-05-10T04:51:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.623+0000 7f5087800700 1 -- 172.21.15.82:0/2818329341 wait complete. 2024-05-10T04:51:16.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.625+0000 7f5087800700 1 Processor -- start 2024-05-10T04:51:16.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.625+0000 7f5087800700 1 -- start start 2024-05-10T04:51:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f5087800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50800b13a0 0x7f50801f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f5087800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b1fe0 0x7f5080153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f5087800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 0x7f50800b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f5087800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50800c5c10 con 0x7f50800b1fe0 2024-05-10T04:51:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f5087800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50800c65e0 con 0x7f50800b13a0 2024-05-10T04:51:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f5087800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50801543e0 con 0x7f50800d05b0 2024-05-10T04:51:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f507fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b1fe0 0x7f5080153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f507fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b1fe0 0x7f5080153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51104/0 (socket says 172.21.15.82:51104) 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f507fe00700 1 -- 172.21.15.82:0/3727171294 learned_addr learned my addr 172.21.15.82:0/3727171294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f5084e00700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50800b13a0 0x7f50801f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f5085800700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 0x7f50800b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f507fe00700 1 -- 172.21.15.82:0/3727171294 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 msgr2=0x7f50800b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f507fe00700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 0x7f50800b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f507fe00700 1 -- 172.21.15.82:0/3727171294 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50800b13a0 msgr2=0x7f50801f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f507fe00700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50800b13a0 0x7f50801f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.627+0000 7f507fe00700 1 -- 172.21.15.82:0/3727171294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074009550 con 0x7f50800b1fe0 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.628+0000 7f507fe00700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b1fe0 0x7f5080153ea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f506c00c420 tx=0x7f506c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.628+0000 7f507cc00700 1 -- 172.21.15.82:0/3727171294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0052d0 con 0x7f50800b1fe0 2024-05-10T04:51:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.628+0000 7f507cc00700 1 -- 172.21.15.82:0/3727171294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c005430 con 0x7f50800b1fe0 2024-05-10T04:51:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.628+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50800c9f20 con 0x7f50800b1fe0 2024-05-10T04:51:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.628+0000 7f507cc00700 1 -- 172.21.15.82:0/3727171294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0038c0 con 0x7f50800b1fe0 2024-05-10T04:51:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.628+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50800c68e0 con 0x7f50800b1fe0 2024-05-10T04:51:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.629+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5080074af0 con 0x7f50800b1fe0 2024-05-10T04:51:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.630+0000 7f507cc00700 1 -- 172.21.15.82:0/3727171294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f506c003a20 con 0x7f50800b1fe0 2024-05-10T04:51:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.631+0000 7f507cc00700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f506006acc0 0x7f506006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.631+0000 7f507cc00700 1 -- 172.21.15.82:0/3727171294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f506c088910 con 0x7f50800b1fe0 2024-05-10T04:51:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.631+0000 7f5084e00700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f506006acc0 0x7f506006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.632+0000 7f5084e00700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f506006acc0 0x7f506006d1d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5074014040 tx=0x7f5074008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:16.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.636+0000 7f507cc00700 1 -- 172.21.15.82:0/3727171294 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f506c053930 con 0x7f50800b1fe0 2024-05-10T04:51:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.838+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50800b66c0 con 0x7f50800b1fe0 2024-05-10T04:51:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.839+0000 7f507cc00700 1 -- 172.21.15.82:0/3727171294 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f506c017020 con 0x7f50800b1fe0 2024-05-10T04:51:16.840 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:51:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f506006acc0 msgr2=0x7f506006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f506006acc0 0x7f506006d1d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5074014040 tx=0x7f5074008030 comp rx=0 tx=0).stop 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b1fe0 msgr2=0x7f5080153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b1fe0 0x7f5080153ea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f506c00c420 tx=0x7f506c00c7e0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 shutdown_connections 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f506006acc0 0x7f506006d1d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50800d05b0 0x7f50800b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50800b13a0 0x7f50801f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 --2- 172.21.15.82:0/3727171294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50800b1fe0 0x7f5080153ea0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.841+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 >> 172.21.15.82:0/3727171294 conn(0x7f50800b26a0 msgr2=0x7f50800742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.842+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 shutdown_connections 2024-05-10T04:51:16.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:16.842+0000 7f5087800700 1 -- 172.21.15.82:0/3727171294 wait complete. 2024-05-10T04:51:16.872 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:17.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.137+0000 7f946a400700 1 Processor -- start 2024-05-10T04:51:17.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.137+0000 7f946a400700 1 -- start start 2024-05-10T04:51:17.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.138+0000 7f946a400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f946415e6e0 0x7f946406c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.138+0000 7f946a400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f94640b2b90 0x7f946406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.138+0000 7f946a400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94640d34c0 con 0x7f94640b3050 2024-05-10T04:51:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.138+0000 7f946a400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946406d340 con 0x7f946415e6e0 2024-05-10T04:51:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.138+0000 7f946a400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94640d2b90 con 0x7f94640b2b90 2024-05-10T04:51:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9463400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f946415e6e0 0x7f946406c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9463e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f94640b3050 0x7f94640d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35512/0 (socket says 172.21.15.82:35512) 2024-05-10T04:51:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9463e00700 1 -- 172.21.15.82:0/331575114 learned_addr learned my addr 172.21.15.82:0/331575114 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9462a00700 1 --2- 172.21.15.82:0/331575114 >> v2:172.21.15.129:3300/0 conn(0x7f94640b2b90 0x7f946406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9462000700 1 -- 172.21.15.82:0/331575114 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913917475 0 0) 0x7f94640d34c0 con 0x7f94640b3050 2024-05-10T04:51:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9462000700 1 -- 172.21.15.82:0/331575114 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94480035b0 con 0x7f94640b3050 2024-05-10T04:51:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9463400700 1 -- 172.21.15.82:0/331575114 >> v2:172.21.15.129:3300/0 conn(0x7f94640b2b90 msgr2=0x7f946406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9463400700 1 --2- 172.21.15.82:0/331575114 >> v2:172.21.15.129:3300/0 conn(0x7f94640b2b90 0x7f946406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9463400700 1 -- 172.21.15.82:0/331575114 >> v1:172.21.15.82:6789/0 conn(0x7f94640b3050 legacy=0x7f94640d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9463400700 1 -- 172.21.15.82:0/331575114 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640d2e70 con 0x7f946415e6e0 2024-05-10T04:51:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.139+0000 7f9462a00700 1 --2- 172.21.15.82:0/331575114 >> v2:172.21.15.129:3300/0 conn(0x7f94640b2b90 0x7f946406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.140+0000 7f9463400700 1 --2- 172.21.15.82:0/331575114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f946415e6e0 0x7f946406c1f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f946406be80 tx=0x7f9454009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fd103a3275b976 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.140+0000 7f9462000700 1 -- 172.21.15.82:0/331575114 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454011830 con 0x7f946415e6e0 2024-05-10T04:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.140+0000 7f9462000700 1 -- 172.21.15.82:0/331575114 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454011990 con 0x7f946415e6e0 2024-05-10T04:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.140+0000 7f9462000700 1 -- 172.21.15.82:0/331575114 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454011d20 con 0x7f946415e6e0 2024-05-10T04:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.140+0000 7f946a400700 1 -- 172.21.15.82:0/331575114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f946415e6e0 msgr2=0x7f946406c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.140+0000 7f946a400700 1 --2- 172.21.15.82:0/331575114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f946415e6e0 0x7f946406c1f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f946406be80 tx=0x7f9454009b20 comp rx=0 tx=0).stop 2024-05-10T04:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.141+0000 7f946a400700 1 -- 172.21.15.82:0/331575114 shutdown_connections 2024-05-10T04:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.141+0000 7f946a400700 1 --2- 172.21.15.82:0/331575114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f946415e6e0 0x7f946406c1f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.141+0000 7f946a400700 1 --2- 172.21.15.82:0/331575114 >> v2:172.21.15.129:3300/0 conn(0x7f94640b2b90 0x7f946406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.141+0000 7f946a400700 1 -- 172.21.15.82:0/331575114 >> 172.21.15.82:0/331575114 conn(0x7f94640b5db0 msgr2=0x7f94640b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.141+0000 7f946a400700 1 -- 172.21.15.82:0/331575114 shutdown_connections 2024-05-10T04:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.141+0000 7f946a400700 1 -- 172.21.15.82:0/331575114 wait complete. 2024-05-10T04:51:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.143+0000 7f946a400700 1 Processor -- start 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.143+0000 7f946a400700 1 -- start start 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f946a400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94640b2b90 0x7f94640c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f946a400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94640b3050 0x7f946415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f946a400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f946415e6e0 0x7f946414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f946a400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640c6a30 con 0x7f94640b3050 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f946a400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946415d1d0 con 0x7f946415e6e0 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f946a400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9464160be0 con 0x7f94640b2b90 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9462a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94640b3050 0x7f946415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9462a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94640b3050 0x7f946415ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51118/0 (socket says 172.21.15.82:51118) 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9462a00700 1 -- 172.21.15.82:0/3342746456 learned_addr learned my addr 172.21.15.82:0/3342746456 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9463400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94640b2b90 0x7f94640c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9463e00700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f946415e6e0 0x7f946414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9462a00700 1 -- 172.21.15.82:0/3342746456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94640b2b90 msgr2=0x7f94640c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9462a00700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94640b2b90 0x7f94640c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9462a00700 1 -- 172.21.15.82:0/3342746456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f946415e6e0 msgr2=0x7f946414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9462a00700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f946415e6e0 0x7f946414f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.145+0000 7f9462a00700 1 -- 172.21.15.82:0/3342746456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94540094a0 con 0x7f94640b3050 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.146+0000 7f9462a00700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94640b3050 0x7f946415ecb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f945000e840 tx=0x7f945000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.146+0000 7f945b400700 1 -- 172.21.15.82:0/3342746456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945000c020 con 0x7f94640b3050 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.146+0000 7f945b400700 1 -- 172.21.15.82:0/3342746456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450004230 con 0x7f94640b3050 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.146+0000 7f945b400700 1 -- 172.21.15.82:0/3342746456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94500036a0 con 0x7f94640b3050 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.146+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9464161ab0 con 0x7f94640b3050 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.146+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9464161110 con 0x7f94640b3050 2024-05-10T04:51:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.147+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94640732b0 con 0x7f94640b3050 2024-05-10T04:51:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.148+0000 7f945b400700 1 -- 172.21.15.82:0/3342746456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9450003800 con 0x7f94640b3050 2024-05-10T04:51:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.149+0000 7f945b400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f944406ac90 0x7f944406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.149+0000 7f945b400700 1 -- 172.21.15.82:0/3342746456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f94500890e0 con 0x7f94640b3050 2024-05-10T04:51:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.149+0000 7f9463400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f944406ac90 0x7f944406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.150+0000 7f9463400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f944406ac90 0x7f944406d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f94540090b0 tx=0x7f945401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.153+0000 7f945b400700 1 -- 172.21.15.82:0/3342746456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9450054190 con 0x7f94640b3050 2024-05-10T04:51:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.399+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f946415bbb0 con 0x7f94640b3050 2024-05-10T04:51:17.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.399+0000 7f945b400700 1 -- 172.21.15.82:0/3342746456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f946415bbb0 con 0x7f94640b3050 2024-05-10T04:51:17.400 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:17.400 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:50:16.068598+0000","modified":"2024-05-10T04:50:19.501679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f944406ac90 msgr2=0x7f944406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f944406ac90 0x7f944406d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f94540090b0 tx=0x7f945401c040 comp rx=0 tx=0).stop 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94640b3050 msgr2=0x7f946415ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94640b3050 0x7f946415ecb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f945000e840 tx=0x7f945000eb50 comp rx=0 tx=0).stop 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 shutdown_connections 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f944406ac90 0x7f944406d1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f946415e6e0 0x7f946414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f94640b2b90 0x7f94640c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 --2- 172.21.15.82:0/3342746456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94640b3050 0x7f946415ecb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 >> 172.21.15.82:0/3342746456 conn(0x7f94640b5db0 msgr2=0x7f9464151150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:17.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 shutdown_connections 2024-05-10T04:51:17.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.402+0000 7f946a400700 1 -- 172.21.15.82:0/3342746456 wait complete. 2024-05-10T04:51:17.404 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-10T04:51:17.428 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:17.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.689+0000 7f98e8800700 1 Processor -- start 2024-05-10T04:51:17.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.689+0000 7f98e8800700 1 -- start start 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.691+0000 7f98e8800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e00cf450 0x7f98e00ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.691+0000 7f98e8800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f98e015a850 0x7f98e0071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.691+0000 7f98e8800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e0072870 con 0x7f98e0072460 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.691+0000 7f98e8800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e00ce600 con 0x7f98e015a850 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.691+0000 7f98e8800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00cd9f0 con 0x7f98e00cf450 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.691+0000 7f98e6800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f98e0072460 0x7f98e006ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35514/0 (socket says 172.21.15.82:35514) 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.691+0000 7f98e6800700 1 -- 172.21.15.82:0/2985051282 learned_addr learned my addr 172.21.15.82:0/2985051282 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e5e00700 1 --2- 172.21.15.82:0/2985051282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e00cf450 0x7f98e00ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e5400700 1 --2- 172.21.15.82:0/2985051282 >> v2:172.21.15.129:3300/0 conn(0x7f98e015a850 0x7f98e0071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e4a00700 1 -- 172.21.15.82:0/2985051282 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053124448 0 0) 0x7f98e0072870 con 0x7f98e0072460 2024-05-10T04:51:17.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e4a00700 1 -- 172.21.15.82:0/2985051282 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c80035b0 con 0x7f98e0072460 2024-05-10T04:51:17.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e5e00700 1 -- 172.21.15.82:0/2985051282 >> v2:172.21.15.129:3300/0 conn(0x7f98e015a850 msgr2=0x7f98e0071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:17.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e5e00700 1 --2- 172.21.15.82:0/2985051282 >> v2:172.21.15.129:3300/0 conn(0x7f98e015a850 0x7f98e0071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e5e00700 1 -- 172.21.15.82:0/2985051282 >> v1:172.21.15.82:6789/0 conn(0x7f98e0072460 legacy=0x7f98e006ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e5e00700 1 -- 172.21.15.82:0/2985051282 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00cdcd0 con 0x7f98e00cf450 2024-05-10T04:51:17.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e5400700 1 --2- 172.21.15.82:0/2985051282 >> v2:172.21.15.129:3300/0 conn(0x7f98e015a850 0x7f98e0071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:17.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.692+0000 7f98e5e00700 1 --2- 172.21.15.82:0/2985051282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e00cf450 0x7f98e00ca0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98d400bae0 tx=0x7f98d400bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69fa5d6fc030c5ae server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:17.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.693+0000 7f98e4a00700 1 -- 172.21.15.82:0/2985051282 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d400dc70 con 0x7f98e00cf450 2024-05-10T04:51:17.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.693+0000 7f98e4a00700 1 -- 172.21.15.82:0/2985051282 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d400ddd0 con 0x7f98e00cf450 2024-05-10T04:51:17.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.693+0000 7f98e4a00700 1 -- 172.21.15.82:0/2985051282 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4010670 con 0x7f98e00cf450 2024-05-10T04:51:17.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.693+0000 7f98e8800700 1 -- 172.21.15.82:0/2985051282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e00cf450 msgr2=0x7f98e00ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.693+0000 7f98e8800700 1 --2- 172.21.15.82:0/2985051282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e00cf450 0x7f98e00ca0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98d400bae0 tx=0x7f98d400bdf0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.694+0000 7f98e8800700 1 -- 172.21.15.82:0/2985051282 shutdown_connections 2024-05-10T04:51:17.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.694+0000 7f98e8800700 1 --2- 172.21.15.82:0/2985051282 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e00cf450 0x7f98e00ca0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.694+0000 7f98e8800700 1 --2- 172.21.15.82:0/2985051282 >> v2:172.21.15.129:3300/0 conn(0x7f98e015a850 0x7f98e0071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.694+0000 7f98e8800700 1 -- 172.21.15.82:0/2985051282 >> 172.21.15.82:0/2985051282 conn(0x7f98e00cfa80 msgr2=0x7f98e00cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:17.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.694+0000 7f98e8800700 1 -- 172.21.15.82:0/2985051282 shutdown_connections 2024-05-10T04:51:17.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.694+0000 7f98e8800700 1 -- 172.21.15.82:0/2985051282 wait complete. 2024-05-10T04:51:17.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.696+0000 7f98e8800700 1 Processor -- start 2024-05-10T04:51:17.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.696+0000 7f98e8800700 1 -- start start 2024-05-10T04:51:17.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e8800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e0072460 0x7f98e01569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e8800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98e00cf450 0x7f98e01f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e8800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e015a850 0x7f98e0158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e8800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0157270 con 0x7f98e0072460 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e8800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e01f5400 con 0x7f98e00cf450 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e8800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e01f4b60 con 0x7f98e015a850 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e0072460 0x7f98e01569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e0072460 0x7f98e01569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51124/0 (socket says 172.21.15.82:51124) 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5e00700 1 -- 172.21.15.82:0/318372553 learned_addr learned my addr 172.21.15.82:0/318372553 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e6800700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e015a850 0x7f98e0158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5400700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98e00cf450 0x7f98e01f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5e00700 1 -- 172.21.15.82:0/318372553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e015a850 msgr2=0x7f98e0158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5e00700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e015a850 0x7f98e0158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5e00700 1 -- 172.21.15.82:0/318372553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98e00cf450 msgr2=0x7f98e01f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5e00700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98e00cf450 0x7f98e01f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.698+0000 7f98e5e00700 1 -- 172.21.15.82:0/318372553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00094a0 con 0x7f98e0072460 2024-05-10T04:51:17.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.699+0000 7f98e5e00700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e0072460 0x7f98e01569e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98d400be30 tx=0x7f98d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:17.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.699+0000 7f98da000700 1 -- 172.21.15.82:0/318372553 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d401d070 con 0x7f98e0072460 2024-05-10T04:51:17.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.699+0000 7f98da000700 1 -- 172.21.15.82:0/318372553 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4010820 con 0x7f98e0072460 2024-05-10T04:51:17.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.699+0000 7f98da000700 1 -- 172.21.15.82:0/318372553 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4010bb0 con 0x7f98e0072460 2024-05-10T04:51:17.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.699+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d400b740 con 0x7f98e0072460 2024-05-10T04:51:17.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.699+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e01f5120 con 0x7f98e0072460 2024-05-10T04:51:17.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.700+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e00cd630 con 0x7f98e0072460 2024-05-10T04:51:17.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.701+0000 7f98da000700 1 -- 172.21.15.82:0/318372553 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f98d40036a0 con 0x7f98e0072460 2024-05-10T04:51:17.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.702+0000 7f98da000700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98c406ac90 0x7f98c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:17.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.702+0000 7f98da000700 1 -- 172.21.15.82:0/318372553 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f98d408a450 con 0x7f98e0072460 2024-05-10T04:51:17.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.702+0000 7f98e5400700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98c406ac90 0x7f98c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:17.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.703+0000 7f98e5400700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98c406ac90 0x7f98c406d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98e00cb220 tx=0x7f98d0009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.706+0000 7f98da000700 1 -- 172.21.15.82:0/318372553 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f98e00cd630 con 0x7f98e0072460 2024-05-10T04:51:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.913+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e00cd630 con 0x7f98e0072460 2024-05-10T04:51:17.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.914+0000 7f98da000700 1 -- 172.21.15.82:0/318372553 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16333 (secure 0 0 0) 0x7f98e00cd630 con 0x7f98e0072460 2024-05-10T04:51:17.915 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:17.915 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:58.666687+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98c406ac90 msgr2=0x7f98c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98c406ac90 0x7f98c406d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98e00cb220 tx=0x7f98d0009210 comp rx=0 tx=0).stop 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e0072460 msgr2=0x7f98e01569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e0072460 0x7f98e01569e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98d400be30 tx=0x7f98d4004750 comp rx=0 tx=0).stop 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 shutdown_connections 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f98c406ac90 0x7f98c406d1a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f98e015a850 0x7f98e0158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e0072460 0x7f98e01569e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 --2- 172.21.15.82:0/318372553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98e00cf450 0x7f98e01f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:17.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 >> 172.21.15.82:0/318372553 conn(0x7f98e00cfa80 msgr2=0x7f98e0159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:17.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 shutdown_connections 2024-05-10T04:51:17.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:17.917+0000 7f98e8800700 1 -- 172.21.15.82:0/318372553 wait complete. 2024-05-10T04:51:17.946 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T04:51:17.946 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.206+0000 7fa4c0400700 1 Processor -- start 2024-05-10T04:51:18.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.206+0000 7fa4c0400700 1 -- start start 2024-05-10T04:51:18.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.208+0000 7fa4c0400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa4b815f9f0 0x7fa4b806f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.208+0000 7fa4c0400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4b80cb9e0 0x7fa4b815c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.208+0000 7fa4c0400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b80cbdf0 con 0x7fa4b80ce760 2024-05-10T04:51:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.208+0000 7fa4c0400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b806da60 con 0x7fa4b815f9f0 2024-05-10T04:51:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.208+0000 7fa4c0400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b815f5d0 con 0x7fa4b80cb9e0 2024-05-10T04:51:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.208+0000 7fa4be400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa4b80ce760 0x7fa4b80ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35516/0 (socket says 172.21.15.82:35516) 2024-05-10T04:51:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.208+0000 7fa4be400700 1 -- 172.21.15.82:0/1398289131 learned_addr learned my addr 172.21.15.82:0/1398289131 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4bd000700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4b80cb9e0 0x7fa4b815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4bda00700 1 --2- 172.21.15.82:0/1398289131 >> v2:172.21.15.129:3300/0 conn(0x7fa4b815f9f0 0x7fa4b806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625152672 0 0) 0x7fa4b80cbdf0 con 0x7fa4b80ce760 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a00035b0 con 0x7fa4b80ce760 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 436643103 0 0) 0x7fa4a00035b0 con 0x7fa4b80ce760 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4b80cb9e0 msgr2=0x7fa4b815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4b80cb9e0 0x7fa4b815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 >> v2:172.21.15.129:3300/0 conn(0x7fa4b815f9f0 msgr2=0x7fa4b806f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 --2- 172.21.15.82:0/1398289131 >> v2:172.21.15.129:3300/0 conn(0x7fa4b815f9f0 0x7fa4b806f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b815ecc0 con 0x7fa4b80ce760 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fa4b00019f0 con 0x7fa4b80ce760 2024-05-10T04:51:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 >> v1:172.21.15.82:6789/0 conn(0x7fa4b80ce760 legacy=0x7fa4b80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4a0003a00 0x7fa4a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0004850 0x7fa4a0004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4b80cb9e0 0x7fa4a00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b806da60 con 0x7fa4a0004850 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b815f5d0 con 0x7fa4a0003a00 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.209+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a000ba40 con 0x7fa4b80cb9e0 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4bd000700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0004850 0x7fa4a0004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4bda00700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4a0003a00 0x7fa4a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4be400700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4b80cb9e0 0x7fa4a00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4bd000700 1 -- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4b80cb9e0 msgr2=0x7fa4a00051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4bd000700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4b80cb9e0 0x7fa4a00051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4bd000700 1 -- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4a0003a00 msgr2=0x7fa4a0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4bd000700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4a0003a00 0x7fa4a0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4bd000700 1 -- 172.21.15.82:0/1398289131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00035b0 con 0x7fa4a0004850 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4bd000700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0004850 0x7fa4a0004c60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009b30 tx=0x7fa4a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b168ba85dfe02d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400e6c0 con 0x7fa4a0004850 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a400e820 con 0x7fa4a0004850 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.210+0000 7fa4b7e00700 1 -- 172.21.15.82:0/1398289131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400eb90 con 0x7fa4a0004850 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.211+0000 7fa4c0400700 1 -- 172.21.15.82:0/1398289131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0004850 msgr2=0x7fa4a0004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.211+0000 7fa4c0400700 1 --2- 172.21.15.82:0/1398289131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4a0004850 0x7fa4a0004c60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009b30 tx=0x7fa4a0005880 comp rx=0 tx=0).stop 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.211+0000 7fa4be400700 1 -- 172.21.15.82:0/1398289131 reap_dead start 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.211+0000 7fa4c0400700 1 -- 172.21.15.82:0/1398289131 shutdown_connections 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.211+0000 7fa4c0400700 1 -- 172.21.15.82:0/1398289131 >> 172.21.15.82:0/1398289131 conn(0x7fa4b80cfa80 msgr2=0x7fa4b80cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.211+0000 7fa4c0400700 1 -- 172.21.15.82:0/1398289131 shutdown_connections 2024-05-10T04:51:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.211+0000 7fa4c0400700 1 -- 172.21.15.82:0/1398289131 wait complete. 2024-05-10T04:51:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.214+0000 7fa4c0400700 1 Processor -- start 2024-05-10T04:51:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.214+0000 7fa4c0400700 1 -- start start 2024-05-10T04:51:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4c0400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4a0004850 0x7fa4b80c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4c0400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b81f3d70 0x7fa4b80c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4c0400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4b81f4180 0x7fa4b80c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4c0400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8152a90 con 0x7fa4b81f3d70 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4c0400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c5dd0 con 0x7fa4b81f4180 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4c0400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81541f0 con 0x7fa4a0004850 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4bd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b81f3d70 0x7fa4b80c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4bd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b81f3d70 0x7fa4b80c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51134/0 (socket says 172.21.15.82:51134) 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.215+0000 7fa4bd000700 1 -- 172.21.15.82:0/1134298367 learned_addr learned my addr 172.21.15.82:0/1134298367 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4bda00700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4a0004850 0x7fa4b80c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4be400700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4b81f4180 0x7fa4b80c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4bd000700 1 -- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4a0004850 msgr2=0x7fa4b80c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4bd000700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4a0004850 0x7fa4b80c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4bd000700 1 -- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4b81f4180 msgr2=0x7fa4b80c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4bd000700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4b81f4180 0x7fa4b80c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4bd000700 1 -- 172.21.15.82:0/1134298367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b80c52e0 con 0x7fa4b81f3d70 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4be400700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4b81f4180 0x7fa4b80c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4bd000700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b81f3d70 0x7fa4b80c63e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00057e0 tx=0x7fa4a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4b5600700 1 -- 172.21.15.82:0/1134298367 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400e6c0 con 0x7fa4b81f3d70 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4b5600700 1 -- 172.21.15.82:0/1134298367 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4003ab0 con 0x7fa4b81f3d70 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80c5530 con 0x7fa4b81f3d70 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.216+0000 7fa4b5600700 1 -- 172.21.15.82:0/1134298367 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4003e60 con 0x7fa4b81f3d70 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.217+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b80c5af0 con 0x7fa4b81f3d70 2024-05-10T04:51:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.217+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b8152d00 con 0x7fa4b81f3d70 2024-05-10T04:51:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.218+0000 7fa4b5600700 1 -- 172.21.15.82:0/1134298367 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa4a4013470 con 0x7fa4b81f3d70 2024-05-10T04:51:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.219+0000 7fa4b5600700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa49806ac90 0x7fa49806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.219+0000 7fa4b5600700 1 -- 172.21.15.82:0/1134298367 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa4a408ada0 con 0x7fa4b81f3d70 2024-05-10T04:51:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.219+0000 7fa4bda00700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa49806ac90 0x7fa49806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.220+0000 7fa4bda00700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa49806ac90 0x7fa49806d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009c60 tx=0x7fa4ac009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.224+0000 7fa4b5600700 1 -- 172.21.15.82:0/1134298367 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa4a4056000 con 0x7fa4b81f3d70 2024-05-10T04:51:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.470+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4b81527f0 con 0x7fa4b81f3d70 2024-05-10T04:51:18.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.470+0000 7fa4b5600700 1 -- 172.21.15.82:0/1134298367 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7fa4b81527f0 con 0x7fa4b81f3d70 2024-05-10T04:51:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:18.471 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:50:16.068598+0000","modified":"2024-05-10T04:50:19.501679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:51:18.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa49806ac90 msgr2=0x7fa49806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa49806ac90 0x7fa49806d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009c60 tx=0x7fa4ac009210 comp rx=0 tx=0).stop 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b81f3d70 msgr2=0x7fa4b80c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b81f3d70 0x7fa4b80c63e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00057e0 tx=0x7fa4a40047c0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 shutdown_connections 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa49806ac90 0x7fa49806d1a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa4b81f4180 0x7fa4b80c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa4a0004850 0x7fa4b80c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 --2- 172.21.15.82:0/1134298367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4b81f3d70 0x7fa4b80c63e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 >> 172.21.15.82:0/1134298367 conn(0x7fa4b80cfa80 msgr2=0x7fa4b80af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 shutdown_connections 2024-05-10T04:51:18.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.473+0000 7fa4c0400700 1 -- 172.21.15.82:0/1134298367 wait complete. 2024-05-10T04:51:18.475 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-10T04:51:18.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:18.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.760+0000 7ff21fe00700 1 Processor -- start 2024-05-10T04:51:18.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.760+0000 7ff21fe00700 1 -- start start 2024-05-10T04:51:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.762+0000 7ff21fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff2200b2410 0x7ff2200b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.762+0000 7ff21fe00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22009b260 con 0x7ff22006c450 2024-05-10T04:51:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.762+0000 7ff21fe00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2200d10c0 con 0x7ff2200b7340 2024-05-10T04:51:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.762+0000 7ff21fe00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22009ace0 con 0x7ff2200b2410 2024-05-10T04:51:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.762+0000 7ff217e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff22006c450 0x7ff2200cfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35532/0 (socket says 172.21.15.82:35532) 2024-05-10T04:51:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.762+0000 7ff217e00700 1 -- 172.21.15.82:0/2513483087 learned_addr learned my addr 172.21.15.82:0/2513483087 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.762+0000 7ff21f400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff2200b2410 0x7ff2200b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.763+0000 7ff21f400700 1 -- 172.21.15.82:0/2513483087 >> v1:172.21.15.129:6789/0 conn(0x7ff2200b7340 legacy=0x7ff22006bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.763+0000 7ff21f400700 1 -- 172.21.15.82:0/2513483087 >> v1:172.21.15.82:6789/0 conn(0x7ff22006c450 legacy=0x7ff2200cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.763+0000 7ff21f400700 1 -- 172.21.15.82:0/2513483087 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200d13a0 con 0x7ff2200b2410 2024-05-10T04:51:18.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.763+0000 7ff21f400700 1 --2- 172.21.15.82:0/2513483087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b2410 0x7ff2200b0d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff218009d90 tx=0x7ff21800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d28baaae5700ee server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:18.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.765+0000 7ff21e000700 1 -- 172.21.15.82:0/2513483087 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800e070 con 0x7ff2200b2410 2024-05-10T04:51:18.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.765+0000 7ff21e000700 1 -- 172.21.15.82:0/2513483087 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21800bbd0 con 0x7ff2200b2410 2024-05-10T04:51:18.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.765+0000 7ff21e000700 1 -- 172.21.15.82:0/2513483087 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218012430 con 0x7ff2200b2410 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.766+0000 7ff21fe00700 1 -- 172.21.15.82:0/2513483087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b2410 msgr2=0x7ff2200b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.766+0000 7ff21fe00700 1 --2- 172.21.15.82:0/2513483087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b2410 0x7ff2200b0d40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff218009d90 tx=0x7ff21800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.766+0000 7ff21fe00700 1 -- 172.21.15.82:0/2513483087 shutdown_connections 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.766+0000 7ff21fe00700 1 --2- 172.21.15.82:0/2513483087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b2410 0x7ff2200b0d40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.766+0000 7ff21fe00700 1 -- 172.21.15.82:0/2513483087 >> 172.21.15.82:0/2513483087 conn(0x7ff2200ce4b0 msgr2=0x7ff2200ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.766+0000 7ff21fe00700 1 -- 172.21.15.82:0/2513483087 shutdown_connections 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.766+0000 7ff21fe00700 1 -- 172.21.15.82:0/2513483087 wait complete. 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.769+0000 7ff21fe00700 1 Processor -- start 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.769+0000 7ff21fe00700 1 -- start start 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff21fe00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2200b2410 0x7ff2201e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff21fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b7340 0x7ff2201dfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff21fe00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff2201cf780 0x7ff2200cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff21fe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201cd780 con 0x7ff2200b7340 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff21fe00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201e04d0 con 0x7ff2200b2410 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff21fe00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201e0720 con 0x7ff2201cf780 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff217e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b7340 0x7ff2201dfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff217e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b7340 0x7ff2201dfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51142/0 (socket says 172.21.15.82:51142) 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.770+0000 7ff217e00700 1 -- 172.21.15.82:0/1063357630 learned_addr learned my addr 172.21.15.82:0/1063357630 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff21f400700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff2201cf780 0x7ff2200cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff21ea00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2200b2410 0x7ff2201e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff217e00700 1 -- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff2201cf780 msgr2=0x7ff2200cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff217e00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff2201cf780 0x7ff2200cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff217e00700 1 -- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2200b2410 msgr2=0x7ff2201e2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff217e00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2200b2410 0x7ff2201e2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff217e00700 1 -- 172.21.15.82:0/1063357630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218009a70 con 0x7ff2200b7340 2024-05-10T04:51:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff21f400700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff2201cf780 0x7ff2200cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff217e00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b7340 0x7ff2201dfdb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c420 tx=0x7ff20800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.771+0000 7ff216a00700 1 -- 172.21.15.82:0/1063357630 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208005d70 con 0x7ff2200b7340 2024-05-10T04:51:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.772+0000 7ff216a00700 1 -- 172.21.15.82:0/1063357630 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2080070d0 con 0x7ff2200b7340 2024-05-10T04:51:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.772+0000 7ff216a00700 1 -- 172.21.15.82:0/1063357630 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208007440 con 0x7ff2200b7340 2024-05-10T04:51:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.772+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2201e1e70 con 0x7ff2200b7340 2024-05-10T04:51:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.772+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2201e2430 con 0x7ff2200b7340 2024-05-10T04:51:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.773+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2200742d0 con 0x7ff2200b7340 2024-05-10T04:51:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.774+0000 7ff216a00700 1 -- 172.21.15.82:0/1063357630 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2080075a0 con 0x7ff2200b7340 2024-05-10T04:51:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.774+0000 7ff216a00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff1fc06ac90 0x7ff1fc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.775+0000 7ff216a00700 1 -- 172.21.15.82:0/1063357630 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff208088770 con 0x7ff2200b7340 2024-05-10T04:51:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.775+0000 7ff21ea00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff1fc06ac90 0x7ff1fc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.775+0000 7ff21ea00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff1fc06ac90 0x7ff1fc06d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff210000fb0 tx=0x7ff210009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:18.779+0000 7ff216a00700 1 -- 172.21.15.82:0/1063357630 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff2080538d0 con 0x7ff2200b7340 2024-05-10T04:51:19.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.024+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2201e6110 con 0x7ff2200b7340 2024-05-10T04:51:19.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.025+0000 7ff216a00700 1 -- 172.21.15.82:0/1063357630 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7ff208056ef0 con 0x7ff2200b7340 2024-05-10T04:51:19.026 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:19.026 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1485079335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1485079335},{"type":"v1","addr":"172.21.15.82:6837","nonce":1485079335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1019445303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1019445303},{"type":"v1","addr":"172.21.15.82:6835","nonce":1019445303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/1893619216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":1893619216},{"type":"v1","addr":"172.21.15.129:6834","nonce":1893619216}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:50:16.068598+0000","modified":"2024-05-10T04:50:19.501679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.129:6835/2167757977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":2167757977},{"type":"v1","addr":"172.21.15.129:6835","nonce":2167757977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:51:19.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff1fc06ac90 msgr2=0x7ff1fc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff1fc06ac90 0x7ff1fc06d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff210000fb0 tx=0x7ff210009040 comp rx=0 tx=0).stop 2024-05-10T04:51:19.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b7340 msgr2=0x7ff2201dfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b7340 0x7ff2201dfdb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c420 tx=0x7ff20800c7e0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 shutdown_connections 2024-05-10T04:51:19.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff1fc06ac90 0x7ff1fc06d1a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff2201cf780 0x7ff2200cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2200b2410 0x7ff2201e2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 --2- 172.21.15.82:0/1063357630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2200b7340 0x7ff2201dfdb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 >> 172.21.15.82:0/1063357630 conn(0x7ff2200ce4b0 msgr2=0x7ff2201df610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:19.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 shutdown_connections 2024-05-10T04:51:19.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.028+0000 7ff21fe00700 1 -- 172.21.15.82:0/1063357630 wait complete. 2024-05-10T04:51:19.030 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-05-10T04:51:19.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:19.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.315+0000 7fbbad000700 1 Processor -- start 2024-05-10T04:51:19.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.316+0000 7fbbad000700 1 -- start start 2024-05-10T04:51:19.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.317+0000 7fbbad000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fbba815f4f0 0x7fbba80b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.317+0000 7fbbad000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 0x7fbba80b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.317+0000 7fbbad000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba815f900 con 0x7fbba815bfe0 2024-05-10T04:51:19.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.317+0000 7fbbad000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba815c3f0 con 0x7fbba815f4f0 2024-05-10T04:51:19.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.317+0000 7fbbad000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80b61e0 con 0x7fbba80b5dd0 2024-05-10T04:51:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.317+0000 7fbba5e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbba815bfe0 0x7fbba8161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35546/0 (socket says 172.21.15.82:35546) 2024-05-10T04:51:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.317+0000 7fbba5e00700 1 -- 172.21.15.82:0/3563699642 learned_addr learned my addr 172.21.15.82:0/3563699642 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba6800700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 0x7fbba80b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbb9fe00700 1 --2- 172.21.15.82:0/3563699642 >> v2:172.21.15.129:3300/0 conn(0x7fbba815f4f0 0x7fbba80b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879569969 0 0) 0x7fbb98001110 con 0x7fbba815bfe0 2024-05-10T04:51:19.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb8c0035b0 con 0x7fbba815bfe0 2024-05-10T04:51:19.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3925347652 0 0) 0x7fbb8c0035b0 con 0x7fbba815bfe0 2024-05-10T04:51:19.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 msgr2=0x7fbba80b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:19.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 0x7fbba80b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 >> v2:172.21.15.129:3300/0 conn(0x7fbba815f4f0 msgr2=0x7fbba80b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 --2- 172.21.15.82:0/3563699642 >> v2:172.21.15.129:3300/0 conn(0x7fbba815f4f0 0x7fbba80b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8162a70 con 0x7fbba815bfe0 2024-05-10T04:51:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fbb98001800 con 0x7fbba815bfe0 2024-05-10T04:51:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 >> v1:172.21.15.82:6789/0 conn(0x7fbba815bfe0 legacy=0x7fbba8161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbb8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb8c004850 0x7fbb8c004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 0x7fbb8c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba815c3f0 con 0x7fbb8c003a00 2024-05-10T04:51:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80b61e0 con 0x7fbb8c004850 2024-05-10T04:51:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.318+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c00bac0 con 0x7fbba80b5dd0 2024-05-10T04:51:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5e00700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbb8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba6800700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 0x7fbb8c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbb9fe00700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb8c004850 0x7fbb8c004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5e00700 1 -- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 msgr2=0x7fbb8c0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:19.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5e00700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 0x7fbb8c0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5e00700 1 -- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb8c004850 msgr2=0x7fbb8c004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:19.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5e00700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb8c004850 0x7fbb8c004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5e00700 1 -- 172.21.15.82:0/3563699642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0035b0 con 0x7fbb8c003a00 2024-05-10T04:51:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba6800700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba80b5dd0 0x7fbb8c0051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbb9fe00700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb8c004850 0x7fbb8c004c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5e00700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbb8c003e70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c190 tx=0x7fbb8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8391579667d765db server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98007d00 con 0x7fbb8c003a00 2024-05-10T04:51:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.319+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800cc90 con 0x7fbb8c003a00 2024-05-10T04:51:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.320+0000 7fbba5400700 1 -- 172.21.15.82:0/3563699642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98005960 con 0x7fbb8c003a00 2024-05-10T04:51:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.320+0000 7fbbad000700 1 -- 172.21.15.82:0/3563699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 msgr2=0x7fbb8c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.320+0000 7fbbad000700 1 --2- 172.21.15.82:0/3563699642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbb8c003e70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c190 tx=0x7fbb8c005880 comp rx=0 tx=0).stop 2024-05-10T04:51:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.320+0000 7fbba6800700 1 -- 172.21.15.82:0/3563699642 reap_dead start 2024-05-10T04:51:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.320+0000 7fbbad000700 1 -- 172.21.15.82:0/3563699642 shutdown_connections 2024-05-10T04:51:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.320+0000 7fbbad000700 1 -- 172.21.15.82:0/3563699642 >> 172.21.15.82:0/3563699642 conn(0x7fbba80d0a70 msgr2=0x7fbba80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.320+0000 7fbbad000700 1 -- 172.21.15.82:0/3563699642 shutdown_connections 2024-05-10T04:51:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.320+0000 7fbbad000700 1 -- 172.21.15.82:0/3563699642 wait complete. 2024-05-10T04:51:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.323+0000 7fbbad000700 1 Processor -- start 2024-05-10T04:51:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.323+0000 7fbbad000700 1 -- start start 2024-05-10T04:51:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbbad000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbba815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbbad000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbba81f4770 0x7fbba80c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbbad000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba8160500 0x7fbba8160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbbad000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba81f4f50 con 0x7fbb8c003a00 2024-05-10T04:51:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbbad000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80ccc30 con 0x7fbba81f4770 2024-05-10T04:51:19.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbbad000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80c7c90 con 0x7fbba8160500 2024-05-10T04:51:19.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbba5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbba815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbba5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbba815afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51156/0 (socket says 172.21.15.82:51156) 2024-05-10T04:51:19.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.325+0000 7fbba5e00700 1 -- 172.21.15.82:0/1858979393 learned_addr learned my addr 172.21.15.82:0/1858979393 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:19.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbba6800700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba8160500 0x7fbba8160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbb9fe00700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbba81f4770 0x7fbba80c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbba5e00700 1 -- 172.21.15.82:0/1858979393 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba8160500 msgr2=0x7fbba8160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbba5e00700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba8160500 0x7fbba8160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbba5e00700 1 -- 172.21.15.82:0/1858979393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbba81f4770 msgr2=0x7fbba80c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbba5e00700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbba81f4770 0x7fbba80c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbba5e00700 1 -- 172.21.15.82:0/1858979393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8160e50 con 0x7fbb8c003a00 2024-05-10T04:51:19.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbba5e00700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbba815afd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c780 tx=0x7fbb98001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:19.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbb9e000700 1 -- 172.21.15.82:0/1858979393 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98004c80 con 0x7fbb8c003a00 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbb9e000700 1 -- 172.21.15.82:0/1858979393 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98004e00 con 0x7fbb8c003a00 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba80cce80 con 0x7fbb8c003a00 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.326+0000 7fbb9e000700 1 -- 172.21.15.82:0/1858979393 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98007310 con 0x7fbb8c003a00 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.327+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba80cd440 con 0x7fbb8c003a00 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.328+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba8074af0 con 0x7fbb8c003a00 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.329+0000 7fbb9e000700 1 -- 172.21.15.82:0/1858979393 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbb98019070 con 0x7fbb8c003a00 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.329+0000 7fbb9e000700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbb8406ac90 0x7fbb8406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.329+0000 7fbb9e000700 1 -- 172.21.15.82:0/1858979393 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fbb9808a2f0 con 0x7fbb8c003a00 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.330+0000 7fbb9fe00700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbb8406ac90 0x7fbb8406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.330+0000 7fbb9fe00700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbb8406ac90 0x7fbb8406d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbba80b6d30 tx=0x7fbb90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:19.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.334+0000 7fbb9e000700 1 -- 172.21.15.82:0/1858979393 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbb980554d0 con 0x7fbb8c003a00 2024-05-10T04:51:19.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.541+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbba815f900 con 0x7fbb8c003a00 2024-05-10T04:51:19.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.543+0000 7fbb9e000700 1 -- 172.21.15.82:0/1858979393 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16333 (secure 0 0 0) 0x7fbba815f900 con 0x7fbb8c003a00 2024-05-10T04:51:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:19.543 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:50:58.666687+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:50:13.920579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:50:15.048532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:19.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbb8406ac90 msgr2=0x7fbb8406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbb8406ac90 0x7fbb8406d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbba80b6d30 tx=0x7fbb90008040 comp rx=0 tx=0).stop 2024-05-10T04:51:19.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 msgr2=0x7fbba815afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbba815afd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c780 tx=0x7fbb98001ac0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 shutdown_connections 2024-05-10T04:51:19.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fbb8406ac90 0x7fbb8406d1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fbba8160500 0x7fbba8160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8c003a00 0x7fbba815afd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 --2- 172.21.15.82:0/1858979393 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbba81f4770 0x7fbba80c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 >> 172.21.15.82:0/1858979393 conn(0x7fbba80d0a70 msgr2=0x7fbba815faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:19.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 shutdown_connections 2024-05-10T04:51:19.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.545+0000 7fbbad000700 1 -- 172.21.15.82:0/1858979393 wait complete. 2024-05-10T04:51:19.571 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T04:51:19.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.838+0000 7fb1a1400700 1 Processor -- start 2024-05-10T04:51:19.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.838+0000 7fb1a1400700 1 -- start start 2024-05-10T04:51:19.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.839+0000 7fb1a1400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0b2f50 0x7fb19c161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.839+0000 7fb1a1400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb19c0d3030 0x7fb19c0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb1a1400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c0d28c0 con 0x7fb19c0d0630 2024-05-10T04:51:19.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb1a1400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c0b3360 con 0x7fb19c0d3030 2024-05-10T04:51:19.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb1a1400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1624e0 con 0x7fb19c0b2f50 2024-05-10T04:51:19.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb199e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb19c0d3030 0x7fb19c0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb199e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb19c0d3030 0x7fb19c0d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51170/0 (socket says 172.21.15.82:51170) 2024-05-10T04:51:19.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb199e00700 1 -- 172.21.15.82:0/1197640889 learned_addr learned my addr 172.21.15.82:0/1197640889 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:19.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb19a800700 1 --2- 172.21.15.82:0/1197640889 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0b2f50 0x7fb19c161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb199e00700 1 -- 172.21.15.82:0/1197640889 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0b2f50 msgr2=0x7fb19c161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:19.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb199e00700 1 --2- 172.21.15.82:0/1197640889 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0b2f50 0x7fb19c161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb199e00700 1 -- 172.21.15.82:0/1197640889 >> v1:172.21.15.129:6789/0 conn(0x7fb19c0d0630 legacy=0x7fb19c0d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.840+0000 7fb199e00700 1 -- 172.21.15.82:0/1197640889 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0d2ba0 con 0x7fb19c0d3030 2024-05-10T04:51:19.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.841+0000 7fb199e00700 1 --2- 172.21.15.82:0/1197640889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0d3030 0x7fb19c0d3440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb1880098f0 tx=0x7fb188009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443873d61b994a6f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.841+0000 7fb199400700 1 -- 172.21.15.82:0/1197640889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188011830 con 0x7fb19c0d3030 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.841+0000 7fb199400700 1 -- 172.21.15.82:0/1197640889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188011990 con 0x7fb19c0d3030 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.841+0000 7fb199400700 1 -- 172.21.15.82:0/1197640889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188011d20 con 0x7fb19c0d3030 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.842+0000 7fb1a1400700 1 -- 172.21.15.82:0/1197640889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0d3030 msgr2=0x7fb19c0d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.842+0000 7fb1a1400700 1 --2- 172.21.15.82:0/1197640889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0d3030 0x7fb19c0d3440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb1880098f0 tx=0x7fb188009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.842+0000 7fb1a1400700 1 -- 172.21.15.82:0/1197640889 shutdown_connections 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.842+0000 7fb1a1400700 1 --2- 172.21.15.82:0/1197640889 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0b2f50 0x7fb19c161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.842+0000 7fb1a1400700 1 --2- 172.21.15.82:0/1197640889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0d3030 0x7fb19c0d3440 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.842+0000 7fb1a1400700 1 -- 172.21.15.82:0/1197640889 >> 172.21.15.82:0/1197640889 conn(0x7fb19c06c3f0 msgr2=0x7fb19c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.842+0000 7fb1a1400700 1 -- 172.21.15.82:0/1197640889 shutdown_connections 2024-05-10T04:51:19.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.842+0000 7fb1a1400700 1 -- 172.21.15.82:0/1197640889 wait complete. 2024-05-10T04:51:19.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.845+0000 7fb1a1400700 1 Processor -- start 2024-05-10T04:51:19.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.845+0000 7fb1a1400700 1 -- start start 2024-05-10T04:51:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb1a1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0b2f50 0x7fb19c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb1a1400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0d0630 0x7fb19c15f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb1a1400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb19c0d3030 0x7fb19c0cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb1a1400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1f8050 con 0x7fb19c0b2f50 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb1a1400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1f82a0 con 0x7fb19c0d3030 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb1a1400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1f8580 con 0x7fb19c0d0630 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0b2f50 0x7fb19c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19a800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0b2f50 0x7fb19c0b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51176/0 (socket says 172.21.15.82:51176) 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19a800700 1 -- 172.21.15.82:0/2850046568 learned_addr learned my addr 172.21.15.82:0/2850046568 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb199e00700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0d0630 0x7fb19c15f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19b200700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb19c0d3030 0x7fb19c0cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19a800700 1 -- 172.21.15.82:0/2850046568 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0d0630 msgr2=0x7fb19c15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19a800700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0d0630 0x7fb19c15f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19a800700 1 -- 172.21.15.82:0/2850046568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb19c0d3030 msgr2=0x7fb19c0cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19a800700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb19c0d3030 0x7fb19c0cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.847+0000 7fb19a800700 1 -- 172.21.15.82:0/2850046568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb188009550 con 0x7fb19c0b2f50 2024-05-10T04:51:19.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.848+0000 7fb19a800700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0b2f50 0x7fb19c0b2200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e870 tx=0x7fb18c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:19.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.848+0000 7fb192a00700 1 -- 172.21.15.82:0/2850046568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00c640 con 0x7fb19c0b2f50 2024-05-10T04:51:19.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.848+0000 7fb192a00700 1 -- 172.21.15.82:0/2850046568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00c7a0 con 0x7fb19c0b2f50 2024-05-10T04:51:19.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.848+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c1f8860 con 0x7fb19c0b2f50 2024-05-10T04:51:19.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.848+0000 7fb192a00700 1 -- 172.21.15.82:0/2850046568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00cb10 con 0x7fb19c0b2f50 2024-05-10T04:51:19.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.848+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c0cc010 con 0x7fb19c0b2f50 2024-05-10T04:51:19.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.849+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c0cade0 con 0x7fb19c0b2f50 2024-05-10T04:51:19.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.850+0000 7fb192a00700 1 -- 172.21.15.82:0/2850046568 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb18c00cc70 con 0x7fb19c0b2f50 2024-05-10T04:51:19.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.851+0000 7fb192a00700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb17c06ac90 0x7fb17c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:19.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.851+0000 7fb192a00700 1 -- 172.21.15.82:0/2850046568 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb18c089340 con 0x7fb19c0b2f50 2024-05-10T04:51:19.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.851+0000 7fb199e00700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb17c06ac90 0x7fb17c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:19.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.852+0000 7fb199e00700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb17c06ac90 0x7fb17c06d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0b7110 tx=0x7fb188008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:19.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:19.856+0000 7fb192a00700 1 -- 172.21.15.82:0/2850046568 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb18c054470 con 0x7fb19c0b2f50 2024-05-10T04:51:20.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.109+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb19c1f8a50 con 0x7fb19c0b2f50 2024-05-10T04:51:20.110 INFO:tasks.ceph.mon.a.smithi082.stderr:2024-05-10T04:51:20.110+0000 7fcf99200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T04:51:20.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.119+0000 7fb192a00700 1 -- 172.21.15.82:0/2850046568 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb18c057a90 con 0x7fb19c0b2f50 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb17c06ac90 msgr2=0x7fb17c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb17c06ac90 0x7fb17c06d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0b7110 tx=0x7fb188008030 comp rx=0 tx=0).stop 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0b2f50 msgr2=0x7fb19c0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0b2f50 0x7fb19c0b2200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e870 tx=0x7fb18c00ec30 comp rx=0 tx=0).stop 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 shutdown_connections 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb17c06ac90 0x7fb17c06d1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb19c0d3030 0x7fb19c0cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb19c0b2f50 0x7fb19c0b2200 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 --2- 172.21.15.82:0/2850046568 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb19c0d0630 0x7fb19c15f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:20.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 >> 172.21.15.82:0/2850046568 conn(0x7fb19c06c3f0 msgr2=0x7fb19c160830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:20.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 shutdown_connections 2024-05-10T04:51:20.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.122+0000 7fb1a1400700 1 -- 172.21.15.82:0/2850046568 wait complete. 2024-05-10T04:51:20.124 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T04:51:20.132 INFO:tasks.ceph.mds.b.smithi129.stderr: -6469> 2024-05-10T04:50:21.470+0000 7f1274400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:51:20.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T04:51:20.263 INFO:tasks.ceph.mds.b.smithi129.stdout:starting mds.b at 2024-05-10T04:51:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.414+0000 7f49bb800700 1 Processor -- start 2024-05-10T04:51:20.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.414+0000 7f49bb800700 1 -- start start 2024-05-10T04:51:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49bb800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f49b40b39e0 0x7f49b40b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49bb800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40cb9d0 con 0x7f49b40b13a0 2024-05-10T04:51:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49bb800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b40b17b0 con 0x7f49b40d05b0 2024-05-10T04:51:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49bb800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b415ec70 con 0x7f49b40b39e0 2024-05-10T04:51:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b8e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f49b40b13a0 0x7f49b40cfea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35554/0 (socket says 172.21.15.82:35554) 2024-05-10T04:51:20.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b8e00700 1 -- 172.21.15.82:0/2295247344 learned_addr learned my addr 172.21.15.82:0/2295247344 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:20.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b9800700 1 --2- 172.21.15.82:0/2295247344 >> v2:172.21.15.82:3300/0 conn(0x7f49b40b39e0 0x7f49b40b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:20.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b3400700 1 -- 172.21.15.82:0/2295247344 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264282244 0 0) 0x7f49b40cb9d0 con 0x7f49b40b13a0 2024-05-10T04:51:20.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b3400700 1 -- 172.21.15.82:0/2295247344 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f499c0035b0 con 0x7f49b40b13a0 2024-05-10T04:51:20.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b3400700 1 -- 172.21.15.82:0/2295247344 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237438664 0 0) 0x7f49b40b17b0 con 0x7f49b40d05b0 2024-05-10T04:51:20.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b9800700 1 -- 172.21.15.82:0/2295247344 >> v1:172.21.15.129:6789/0 conn(0x7f49b40d05b0 legacy=0x7f49b40cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:20.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b9800700 1 -- 172.21.15.82:0/2295247344 >> v1:172.21.15.82:6789/0 conn(0x7f49b40b13a0 legacy=0x7f49b40cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:20.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.416+0000 7f49b9800700 1 -- 172.21.15.82:0/2295247344 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40ce240 con 0x7f49b40b39e0 2024-05-10T04:51:20.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.417+0000 7f49b9800700 1 --2- 172.21.15.82:0/2295247344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b39e0 0x7f49b40b1fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009d90 tx=0x7f49ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b0e1f3d6c285e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:20.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.417+0000 7f49b3400700 1 -- 172.21.15.82:0/2295247344 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00e070 con 0x7f49b40b39e0 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.417+0000 7f49b3400700 1 -- 172.21.15.82:0/2295247344 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac00bb20 con 0x7f49b40b39e0 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.417+0000 7f49b3400700 1 -- 172.21.15.82:0/2295247344 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00be90 con 0x7f49b40b39e0 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.418+0000 7f49bb800700 1 -- 172.21.15.82:0/2295247344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b39e0 msgr2=0x7f49b40b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.418+0000 7f49bb800700 1 --2- 172.21.15.82:0/2295247344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b39e0 0x7f49b40b1fe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009d90 tx=0x7f49ac00b330 comp rx=0 tx=0).stop 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.418+0000 7f49bb800700 1 -- 172.21.15.82:0/2295247344 shutdown_connections 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.418+0000 7f49bb800700 1 --2- 172.21.15.82:0/2295247344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b39e0 0x7f49b40b1fe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.418+0000 7f49bb800700 1 -- 172.21.15.82:0/2295247344 >> 172.21.15.82:0/2295247344 conn(0x7f49b40b26a0 msgr2=0x7f49b40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.418+0000 7f49bb800700 1 -- 172.21.15.82:0/2295247344 shutdown_connections 2024-05-10T04:51:20.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.418+0000 7f49bb800700 1 -- 172.21.15.82:0/2295247344 wait complete. 2024-05-10T04:51:20.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.420+0000 7f49bb800700 1 Processor -- start 2024-05-10T04:51:20.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.420+0000 7f49bb800700 1 -- start start 2024-05-10T04:51:20.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49bb800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b13a0 0x7f49b40afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:20.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49bb800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49b40b39e0 0x7f49b415b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49bb800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f49b40d05b0 0x7f49b415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49bb800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40b02f0 con 0x7f49b40b13a0 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49bb800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b40b5fc0 con 0x7f49b40b39e0 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49bb800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b415c280 con 0x7f49b40d05b0 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b8e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b13a0 0x7f49b40afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b8e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b13a0 0x7f49b40afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51198/0 (socket says 172.21.15.82:51198) 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b8e00700 1 -- 172.21.15.82:0/1173244264 learned_addr learned my addr 172.21.15.82:0/1173244264 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b3e00700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49b40b39e0 0x7f49b415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b9800700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f49b40d05b0 0x7f49b415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b8e00700 1 -- 172.21.15.82:0/1173244264 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f49b40d05b0 msgr2=0x7f49b415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b8e00700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f49b40d05b0 0x7f49b415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b8e00700 1 -- 172.21.15.82:0/1173244264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49b40b39e0 msgr2=0x7f49b415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:20.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b8e00700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49b40b39e0 0x7f49b415b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:20.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.422+0000 7f49b8e00700 1 -- 172.21.15.82:0/1173244264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac009a70 con 0x7f49b40b13a0 2024-05-10T04:51:20.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.423+0000 7f49b8e00700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b13a0 0x7f49b40afdb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f49a800c480 tx=0x7f49a800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:20.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.423+0000 7f49b0c00700 1 -- 172.21.15.82:0/1173244264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8005d70 con 0x7f49b40b13a0 2024-05-10T04:51:20.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.423+0000 7f49b0c00700 1 -- 172.21.15.82:0/1173244264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a800ce10 con 0x7f49b40b13a0 2024-05-10T04:51:20.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.423+0000 7f49b0c00700 1 -- 172.21.15.82:0/1173244264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a80072d0 con 0x7f49b40b13a0 2024-05-10T04:51:20.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.423+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b415c7b0 con 0x7f49b40b13a0 2024-05-10T04:51:20.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.423+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b40b47f0 con 0x7f49b40b13a0 2024-05-10T04:51:20.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.424+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b40b4ad0 con 0x7f49b40b13a0 2024-05-10T04:51:20.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.425+0000 7f49b0c00700 1 -- 172.21.15.82:0/1173244264 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f49a8007430 con 0x7f49b40b13a0 2024-05-10T04:51:20.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.426+0000 7f49b0c00700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f499406acc0 0x7f499406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:20.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.426+0000 7f49b0c00700 1 -- 172.21.15.82:0/1173244264 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f49a80886e0 con 0x7f49b40b13a0 2024-05-10T04:51:20.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.426+0000 7f49b3e00700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f499406acc0 0x7f499406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:20.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.427+0000 7f49b3e00700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f499406acc0 0x7f499406d1d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49b406ebb0 tx=0x7f49a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.431+0000 7f49b0c00700 1 -- 172.21.15.82:0/1173244264 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f49a8053750 con 0x7f49b40b13a0 2024-05-10T04:51:20.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:20.679+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f49b4074af0 con 0x7f49b40b13a0 2024-05-10T04:51:21.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.121+0000 7f49b0c00700 1 -- 172.21.15.82:0/1173244264 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f49a8056d70 con 0x7f49b40b13a0 2024-05-10T04:51:21.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f499406acc0 msgr2=0x7f499406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:21.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f499406acc0 0x7f499406d1d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49b406ebb0 tx=0x7f49a0009040 comp rx=0 tx=0).stop 2024-05-10T04:51:21.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b13a0 msgr2=0x7f49b40afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:21.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b13a0 0x7f49b40afdb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f49a800c480 tx=0x7f49a800c790 comp rx=0 tx=0).stop 2024-05-10T04:51:21.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 shutdown_connections 2024-05-10T04:51:21.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f499406acc0 0x7f499406d1d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f49b40d05b0 0x7f49b415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49b40b13a0 0x7f49b40afdb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 --2- 172.21.15.82:0/1173244264 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49b40b39e0 0x7f49b415b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.124+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 >> 172.21.15.82:0/1173244264 conn(0x7f49b40b26a0 msgr2=0x7f49b40cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:21.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.125+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 shutdown_connections 2024-05-10T04:51:21.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.125+0000 7f49bb800700 1 -- 172.21.15.82:0/1173244264 wait complete. 2024-05-10T04:51:21.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T04:51:21.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.418+0000 7f76bc400700 1 Processor -- start 2024-05-10T04:51:21.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.418+0000 7f76bc400700 1 -- start start 2024-05-10T04:51:21.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.420+0000 7f76bc400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 0x7f76b4161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:21.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.420+0000 7f76bc400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76b40b5c10 0x7f76b40b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:21.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.420+0000 7f76bc400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b40b6560 con 0x7f76b40cea50 2024-05-10T04:51:21.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.420+0000 7f76bc400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b40cada0 con 0x7f76b40b5c10 2024-05-10T04:51:21.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.420+0000 7f76bc400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b41624a0 con 0x7f76b415e5e0 2024-05-10T04:51:21.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.420+0000 7f76b9000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f76b40cea50 0x7f76b40b7340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35560/0 (socket says 172.21.15.82:35560) 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.420+0000 7f76b9000700 1 -- 172.21.15.82:0/2222695953 learned_addr learned my addr 172.21.15.82:0/2222695953 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.420+0000 7f76ba400700 1 --2- 172.21.15.82:0/2222695953 >> v2:172.21.15.82:3300/0 conn(0x7f76b40b5c10 0x7f76b40b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76b9a00700 1 --2- 172.21.15.82:0/2222695953 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 0x7f76b4161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76ba400700 1 -- 172.21.15.82:0/2222695953 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 msgr2=0x7f76b4161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76ba400700 1 --2- 172.21.15.82:0/2222695953 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 0x7f76b4161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76ba400700 1 -- 172.21.15.82:0/2222695953 >> v1:172.21.15.82:6789/0 conn(0x7f76b40cea50 legacy=0x7f76b40b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76ba400700 1 -- 172.21.15.82:0/2222695953 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b41626b0 con 0x7f76b40b5c10 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76ba400700 1 --2- 172.21.15.82:0/2222695953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40b5c10 0x7f76b40b6020 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009d90 tx=0x7f76ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8856fccdecfc14 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76b3e00700 1 -- 172.21.15.82:0/2222695953 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00e070 con 0x7f76b40b5c10 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76b3e00700 1 -- 172.21.15.82:0/2222695953 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac00bbd0 con 0x7f76b40b5c10 2024-05-10T04:51:21.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.421+0000 7f76b3e00700 1 -- 172.21.15.82:0/2222695953 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac012430 con 0x7f76b40b5c10 2024-05-10T04:51:21.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.422+0000 7f76bc400700 1 -- 172.21.15.82:0/2222695953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40b5c10 msgr2=0x7f76b40b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:21.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.422+0000 7f76bc400700 1 --2- 172.21.15.82:0/2222695953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40b5c10 0x7f76b40b6020 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f76ac009d90 tx=0x7f76ac00b330 comp rx=0 tx=0).stop 2024-05-10T04:51:21.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.422+0000 7f76bc400700 1 -- 172.21.15.82:0/2222695953 shutdown_connections 2024-05-10T04:51:21.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.422+0000 7f76bc400700 1 --2- 172.21.15.82:0/2222695953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40b5c10 0x7f76b40b6020 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.422+0000 7f76bc400700 1 --2- 172.21.15.82:0/2222695953 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 0x7f76b4161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.422+0000 7f76bc400700 1 -- 172.21.15.82:0/2222695953 >> 172.21.15.82:0/2222695953 conn(0x7f76b40d0cd0 msgr2=0x7f76b40d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:21.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.422+0000 7f76bc400700 1 -- 172.21.15.82:0/2222695953 shutdown_connections 2024-05-10T04:51:21.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.422+0000 7f76bc400700 1 -- 172.21.15.82:0/2222695953 wait complete. 2024-05-10T04:51:21.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.424+0000 7f76bc400700 1 Processor -- start 2024-05-10T04:51:21.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.425+0000 7f76bc400700 1 -- start start 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.426+0000 7f76bc400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76b40b5c10 0x7f76b4158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.426+0000 7f76bc400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40cea50 0x7f76b415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.426+0000 7f76bc400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 0x7f76b415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.426+0000 7f76bc400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b40cc550 con 0x7f76b40cea50 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.426+0000 7f76bc400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b41602f0 con 0x7f76b40b5c10 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.426+0000 7f76bc400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b415cab0 con 0x7f76b415e5e0 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.426+0000 7f76b9000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40cea50 0x7f76b415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b9000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40cea50 0x7f76b415f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51222/0 (socket says 172.21.15.82:51222) 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b9000700 1 -- 172.21.15.82:0/2998967127 learned_addr learned my addr 172.21.15.82:0/2998967127 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:21.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b9000700 1 -- 172.21.15.82:0/2998967127 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 msgr2=0x7f76b415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b9000700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 0x7f76b415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b9000700 1 -- 172.21.15.82:0/2998967127 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76b40b5c10 msgr2=0x7f76b4158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b9000700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76b40b5c10 0x7f76b4158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b9000700 1 -- 172.21.15.82:0/2998967127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac009a70 con 0x7f76b40cea50 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b9000700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40cea50 0x7f76b415f850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005910 tx=0x7f76a000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b1600700 1 -- 172.21.15.82:0/2998967127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0005d70 con 0x7f76b40cea50 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b1600700 1 -- 172.21.15.82:0/2998967127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a00070d0 con 0x7f76b40cea50 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b415bf30 con 0x7f76b40cea50 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.427+0000 7f76b1600700 1 -- 172.21.15.82:0/2998967127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0007460 con 0x7f76b40cea50 2024-05-10T04:51:21.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.428+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b415c4f0 con 0x7f76b40cea50 2024-05-10T04:51:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.428+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b4161de0 con 0x7f76b40cea50 2024-05-10T04:51:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.429+0000 7f76b1600700 1 -- 172.21.15.82:0/2998967127 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f76a00075c0 con 0x7f76b40cea50 2024-05-10T04:51:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.430+0000 7f76b1600700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f769406ac90 0x7f769406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.430+0000 7f76b1600700 1 -- 172.21.15.82:0/2998967127 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f76a0088770 con 0x7f76b40cea50 2024-05-10T04:51:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.431+0000 7f76b9a00700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f769406ac90 0x7f769406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.431+0000 7f76b9a00700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f769406ac90 0x7f769406d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76b40d4e60 tx=0x7f76a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:21.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.435+0000 7f76b1600700 1 -- 172.21.15.82:0/2998967127 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f76a00538d0 con 0x7f76b40cea50 2024-05-10T04:51:21.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:21.638+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f76b40b36e0 con 0x7f76b40cea50 2024-05-10T04:51:22.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.126+0000 7f76b1600700 1 -- 172.21.15.82:0/2998967127 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f76a0056ef0 con 0x7f76b40cea50 2024-05-10T04:51:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f769406ac90 msgr2=0x7f769406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f769406ac90 0x7f769406d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76b40d4e60 tx=0x7f76a8008040 comp rx=0 tx=0).stop 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40cea50 msgr2=0x7f76b415f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40cea50 0x7f76b415f850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005910 tx=0x7f76a000c7b0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 shutdown_connections 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f769406ac90 0x7f769406d1a0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76b40d4e60 tx=0x7f76a8008040 comp rx=0 tx=0).stop 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f76b415e5e0 0x7f76b415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f76b40b5c10 0x7f76b4158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 --2- 172.21.15.82:0/2998967127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76b40cea50 0x7f76b415f850 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.130+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 >> 172.21.15.82:0/2998967127 conn(0x7f76b40d0cd0 msgr2=0x7f76b40b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:22.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.131+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 shutdown_connections 2024-05-10T04:51:22.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.131+0000 7f76bc400700 1 -- 172.21.15.82:0/2998967127 wait complete. 2024-05-10T04:51:22.134 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-05-10T04:51:22.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T04:51:22.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.435+0000 7f78c9c00700 1 Processor -- start 2024-05-10T04:51:22.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.436+0000 7f78c9c00700 1 -- start start 2024-05-10T04:51:22.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.437+0000 7f78c9c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f78c40cf490 0x7f78c40d3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:22.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.437+0000 7f78c9c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c4161ea0 0x7f78c41622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:22.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.437+0000 7f78c9c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c40d2ca0 con 0x7f78c40d0bd0 2024-05-10T04:51:22.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.437+0000 7f78c9c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c40d2720 con 0x7f78c40cf490 2024-05-10T04:51:22.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.437+0000 7f78c9c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c40cf8a0 con 0x7f78c4161ea0 2024-05-10T04:51:22.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c4161ea0 0x7f78c41622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f78c40cf490 0x7f78c40d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c9200700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f78c40d0bd0 0x7f78c40d0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:38360/0 (socket says 172.21.15.82:38360) 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c4161ea0 0x7f78c41622b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:50428/0 (socket says 172.21.15.82:50428) 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3400700 1 -- 172.21.15.82:0/3711918632 learned_addr learned my addr 172.21.15.82:0/3711918632 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3400700 1 -- 172.21.15.82:0/3711918632 >> v2:172.21.15.129:3300/0 conn(0x7f78c40cf490 msgr2=0x7f78c40d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3400700 1 --2- 172.21.15.82:0/3711918632 >> v2:172.21.15.129:3300/0 conn(0x7f78c40cf490 0x7f78c40d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3400700 1 -- 172.21.15.82:0/3711918632 >> v1:172.21.15.129:6789/0 conn(0x7f78c40d0bd0 legacy=0x7f78c40d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3400700 1 -- 172.21.15.82:0/3711918632 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c40d3670 con 0x7f78c4161ea0 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.438+0000 7f78c3e00700 1 --2- 172.21.15.82:0/3711918632 >> v2:172.21.15.129:3300/0 conn(0x7f78c40cf490 0x7f78c40d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.439+0000 7f78c3400700 1 --2- 172.21.15.82:0/3711918632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c4161ea0 0x7f78c41622b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78b00098f0 tx=0x7f78b0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a032d38850f47c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.439+0000 7f78c2a00700 1 -- 172.21.15.82:0/3711918632 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0011830 con 0x7f78c4161ea0 2024-05-10T04:51:22.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.439+0000 7f78c2a00700 1 -- 172.21.15.82:0/3711918632 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0011990 con 0x7f78c4161ea0 2024-05-10T04:51:22.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.439+0000 7f78c2a00700 1 -- 172.21.15.82:0/3711918632 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0011d20 con 0x7f78c4161ea0 2024-05-10T04:51:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.440+0000 7f78c9c00700 1 -- 172.21.15.82:0/3711918632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c4161ea0 msgr2=0x7f78c41622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.440+0000 7f78c9c00700 1 --2- 172.21.15.82:0/3711918632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c4161ea0 0x7f78c41622b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78b00098f0 tx=0x7f78b0009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.440+0000 7f78c9c00700 1 -- 172.21.15.82:0/3711918632 shutdown_connections 2024-05-10T04:51:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.440+0000 7f78c9c00700 1 --2- 172.21.15.82:0/3711918632 >> v2:172.21.15.129:3300/0 conn(0x7f78c40cf490 0x7f78c40d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.440+0000 7f78c9c00700 1 --2- 172.21.15.82:0/3711918632 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c4161ea0 0x7f78c41622b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.440+0000 7f78c9c00700 1 -- 172.21.15.82:0/3711918632 >> 172.21.15.82:0/3711918632 conn(0x7f78c406c8c0 msgr2=0x7f78c406ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.440+0000 7f78c9c00700 1 -- 172.21.15.82:0/3711918632 shutdown_connections 2024-05-10T04:51:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.440+0000 7f78c9c00700 1 -- 172.21.15.82:0/3711918632 wait complete. 2024-05-10T04:51:22.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.442+0000 7f78c9c00700 1 Processor -- start 2024-05-10T04:51:22.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.442+0000 7f78c9c00700 1 -- start start 2024-05-10T04:51:22.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c9c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c40cf490 0x7f78c414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c40d0bd0 0x7f78c4160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c9c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78c4161ea0 0x7f78c40b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c9c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c414f820 con 0x7f78c40d0bd0 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c9c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c40abcf0 con 0x7f78c4161ea0 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c9c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c414e9c0 con 0x7f78c40cf490 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c40d0bd0 0x7f78c4160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c40d0bd0 0x7f78c4160f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51226/0 (socket says 172.21.15.82:51226) 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3400700 1 -- 172.21.15.82:0/4019414412 learned_addr learned my addr 172.21.15.82:0/4019414412 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c9200700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78c4161ea0 0x7f78c40b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3e00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c40cf490 0x7f78c414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3400700 1 -- 172.21.15.82:0/4019414412 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c40cf490 msgr2=0x7f78c414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3400700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c40cf490 0x7f78c414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3400700 1 -- 172.21.15.82:0/4019414412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78c4161ea0 msgr2=0x7f78c40b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:22.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3400700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78c4161ea0 0x7f78c40b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:22.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.444+0000 7f78c3400700 1 -- 172.21.15.82:0/4019414412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b40094a0 con 0x7f78c40d0bd0 2024-05-10T04:51:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.445+0000 7f78c3400700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c40d0bd0 0x7f78c4160f80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f78b0014040 tx=0x7f78b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.445+0000 7f78bbe00700 1 -- 172.21.15.82:0/4019414412 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b00036a0 con 0x7f78c40d0bd0 2024-05-10T04:51:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.445+0000 7f78bbe00700 1 -- 172.21.15.82:0/4019414412 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b001e070 con 0x7f78c40d0bd0 2024-05-10T04:51:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.445+0000 7f78bbe00700 1 -- 172.21.15.82:0/4019414412 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0003a60 con 0x7f78c40d0bd0 2024-05-10T04:51:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.445+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b0009550 con 0x7f78c40d0bd0 2024-05-10T04:51:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.445+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c414eef0 con 0x7f78c40d0bd0 2024-05-10T04:51:22.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.446+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c40b9b30 con 0x7f78c40d0bd0 2024-05-10T04:51:22.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.447+0000 7f78bbe00700 1 -- 172.21.15.82:0/4019414412 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f78b0003bc0 con 0x7f78c40d0bd0 2024-05-10T04:51:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.448+0000 7f78bbe00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78a406acc0 0x7f78a406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.448+0000 7f78bbe00700 1 -- 172.21.15.82:0/4019414412 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f78b008a260 con 0x7f78c40d0bd0 2024-05-10T04:51:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.448+0000 7f78c3e00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78a406acc0 0x7f78a406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:22.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.449+0000 7f78c3e00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78a406acc0 0x7f78a406d1d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009c60 tx=0x7f78b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:22.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.453+0000 7f78bbe00700 1 -- 172.21.15.82:0/4019414412 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f78b0055500 con 0x7f78c40d0bd0 2024-05-10T04:51:22.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:22.657+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f78c4074af0 con 0x7f78c40d0bd0 2024-05-10T04:51:23.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.135+0000 7f78bbe00700 1 -- 172.21.15.82:0/4019414412 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f78b0058b20 con 0x7f78c40d0bd0 2024-05-10T04:51:23.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78a406acc0 msgr2=0x7f78a406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78a406acc0 0x7f78a406d1d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009c60 tx=0x7f78b4008040 comp rx=0 tx=0).stop 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c40d0bd0 msgr2=0x7f78c4160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c40d0bd0 0x7f78c4160f80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f78b0014040 tx=0x7f78b0004750 comp rx=0 tx=0).stop 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 shutdown_connections 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f78a406acc0 0x7f78a406d1d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f78c4161ea0 0x7f78c40b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f78c40cf490 0x7f78c414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 --2- 172.21.15.82:0/4019414412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c40d0bd0 0x7f78c4160f80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.139+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 >> 172.21.15.82:0/4019414412 conn(0x7f78c406c8c0 msgr2=0x7f78c406ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:23.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.140+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 shutdown_connections 2024-05-10T04:51:23.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.140+0000 7f78c9c00700 1 -- 172.21.15.82:0/4019414412 wait complete. 2024-05-10T04:51:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-05-10T04:51:23.172 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T04:51:23.172 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-10T04:51:23.172 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T04:51:23.172 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:51:23.173 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T04:51:23.173 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-10T04:51:23.173 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T04:51:23.173 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:51:23.173 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T04:51:23.173 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-10T04:51:23.173 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T04:51:23.174 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:51:23.174 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T04:51:23.174 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-10T04:51:23.174 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T04:51:23.174 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:51:23.194 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T04:51:23.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T04:51:23.197 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T04:51:23.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T04:51:23.211 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T04:51:23.211 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T04:51:23.212 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T04:51:23.212 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T04:51:23.241 INFO:tasks.ceph.mds.a:Started 2024-05-10T04:51:23.241 DEBUG:teuthology.parallel:result is None 2024-05-10T04:51:23.244 INFO:tasks.ceph.mds.c:Started 2024-05-10T04:51:23.244 DEBUG:teuthology.parallel:result is None 2024-05-10T04:51:23.255 INFO:tasks.ceph.mds.d:Started 2024-05-10T04:51:23.255 DEBUG:teuthology.parallel:result is None 2024-05-10T04:51:23.257 INFO:tasks.ceph.mds.b:Started 2024-05-10T04:51:23.258 DEBUG:teuthology.parallel:result is None 2024-05-10T04:51:23.258 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-10T04:51:23.459 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2024-05-10T04:51:23.460 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2024-05-10T04:51:23.477 INFO:tasks.ceph.mds.b.smithi129.stdout:starting mds.b at 2024-05-10T04:51:23.478 INFO:tasks.ceph.mds.d.smithi129.stdout:starting mds.d at 2024-05-10T04:51:23.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.550+0000 7ff9b5c00700 1 Processor -- start 2024-05-10T04:51:23.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.550+0000 7ff9b5c00700 1 -- start start 2024-05-10T04:51:23.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.552+0000 7ff9b5c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b006b340 0x7ff9b00b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:23.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.552+0000 7ff9b5c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b00b20e0 con 0x7ff9b00b6270 2024-05-10T04:51:23.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.552+0000 7ff9b5c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b015e8b0 con 0x7ff9b00cb0e0 2024-05-10T04:51:23.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.552+0000 7ff9b5c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00b13c0 con 0x7ff9b006b340 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.552+0000 7ff9af400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff9b00b6270 0x7ff9b0161fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35570/0 (socket says 172.21.15.82:35570) 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.552+0000 7ff9af400700 1 -- 172.21.15.82:0/1211360896 learned_addr learned my addr 172.21.15.82:0/1211360896 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.552+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/1211360896 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b006b340 0x7ff9b00b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.553+0000 7ff9ae000700 1 -- 172.21.15.82:0/1211360896 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263627875 0 0) 0x7ff9b00b20e0 con 0x7ff9b00b6270 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.553+0000 7ff9ae000700 1 -- 172.21.15.82:0/1211360896 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9940035b0 con 0x7ff9b00b6270 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.553+0000 7ff9ae000700 1 -- 172.21.15.82:0/1211360896 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097934987 0 0) 0x7ff9b015e8b0 con 0x7ff9b00cb0e0 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.553+0000 7ff9ae000700 1 -- 172.21.15.82:0/1211360896 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b00b20e0 con 0x7ff9b00cb0e0 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.553+0000 7ff9a7e00700 1 -- 172.21.15.82:0/1211360896 >> v1:172.21.15.129:6789/0 conn(0x7ff9b00cb0e0 legacy=0x7ff9b006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.553+0000 7ff9a7e00700 1 -- 172.21.15.82:0/1211360896 >> v1:172.21.15.82:6789/0 conn(0x7ff9b00b6270 legacy=0x7ff9b0161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.553+0000 7ff9a7e00700 1 -- 172.21.15.82:0/1211360896 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b00d1970 con 0x7ff9b006b340 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.553+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/1211360896 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b006b340 0x7ff9b00b5cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff998009870 tx=0x7ff998009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bfb27e87c07ddd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:23.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.554+0000 7ff9ae000700 1 -- 172.21.15.82:0/1211360896 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998011830 con 0x7ff9b006b340 2024-05-10T04:51:23.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.554+0000 7ff9ae000700 1 -- 172.21.15.82:0/1211360896 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998011990 con 0x7ff9b006b340 2024-05-10T04:51:23.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.554+0000 7ff9ae000700 1 -- 172.21.15.82:0/1211360896 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998011d00 con 0x7ff9b006b340 2024-05-10T04:51:23.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.554+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1211360896 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b006b340 msgr2=0x7ff9b00b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:23.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.554+0000 7ff9b5c00700 1 --2- 172.21.15.82:0/1211360896 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b006b340 0x7ff9b00b5cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff998009870 tx=0x7ff998009b80 comp rx=0 tx=0).stop 2024-05-10T04:51:23.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.554+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1211360896 shutdown_connections 2024-05-10T04:51:23.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.554+0000 7ff9b5c00700 1 --2- 172.21.15.82:0/1211360896 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b006b340 0x7ff9b00b5cb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:23.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.554+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1211360896 >> 172.21.15.82:0/1211360896 conn(0x7ff9b00d0a90 msgr2=0x7ff9b00d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:23.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.555+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1211360896 shutdown_connections 2024-05-10T04:51:23.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.555+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1211360896 wait complete. 2024-05-10T04:51:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.557+0000 7ff9b5c00700 1 Processor -- start 2024-05-10T04:51:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.557+0000 7ff9b5c00700 1 -- start start 2024-05-10T04:51:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.558+0000 7ff9b5c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9b00b6270 0x7ff9b00ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.558+0000 7ff9b5c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b00cb0e0 0x7ff9b014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.558+0000 7ff9b5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b014c500 0x7ff9b014c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.558+0000 7ff9b5c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00c9bf0 con 0x7ff9b014c500 2024-05-10T04:51:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.558+0000 7ff9b5c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00ca550 con 0x7ff9b00b6270 2024-05-10T04:51:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.558+0000 7ff9b5c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b014d180 con 0x7ff9b00cb0e0 2024-05-10T04:51:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b014c500 0x7ff9b014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b014c500 0x7ff9b014c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51260/0 (socket says 172.21.15.82:51260) 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 -- 172.21.15.82:0/1203645077 learned_addr learned my addr 172.21.15.82:0/1203645077 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b00cb0e0 0x7ff9b014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9aea00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9b00b6270 0x7ff9b00ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 -- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b00cb0e0 msgr2=0x7ff9b014bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b00cb0e0 0x7ff9b014bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 -- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9b00b6270 msgr2=0x7ff9b00ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9b00b6270 0x7ff9b00ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 -- 172.21.15.82:0/1203645077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980094a0 con 0x7ff9b014c500 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9aea00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9b00b6270 0x7ff9b00ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.559+0000 7ff9af400700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b014c500 0x7ff9b014c910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800cae0 tx=0x7ff9a800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.560+0000 7ff9a6a00700 1 -- 172.21.15.82:0/1203645077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800aa20 con 0x7ff9b014c500 2024-05-10T04:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.560+0000 7ff9a6a00700 1 -- 172.21.15.82:0/1203645077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800ab80 con 0x7ff9b014c500 2024-05-10T04:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.560+0000 7ff9a6a00700 1 -- 172.21.15.82:0/1203645077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8012400 con 0x7ff9b014c500 2024-05-10T04:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.560+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b00c8d20 con 0x7ff9b014c500 2024-05-10T04:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.560+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b00c8f70 con 0x7ff9b014c500 2024-05-10T04:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.561+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b0074af0 con 0x7ff9b014c500 2024-05-10T04:51:23.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.563+0000 7ff9a6a00700 1 -- 172.21.15.82:0/1203645077 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff9a801b3b0 con 0x7ff9b014c500 2024-05-10T04:51:23.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.563+0000 7ff9a6a00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff98c06ad10 0x7ff98c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:23.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.564+0000 7ff9a6a00700 1 -- 172.21.15.82:0/1203645077 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff9a8088c10 con 0x7ff9b014c500 2024-05-10T04:51:23.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.564+0000 7ff9aea00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff98c06ad10 0x7ff98c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:23.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.564+0000 7ff9aea00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff98c06ad10 0x7ff98c06d220 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0007fd0 tx=0x7ff9a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:23.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.568+0000 7ff9a6a00700 1 -- 172.21.15.82:0/1203645077 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff9a8054150 con 0x7ff9b014c500 2024-05-10T04:51:23.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:23.787+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff9b0070ef0 con 0x7ff9b014c500 2024-05-10T04:51:24.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.512+0000 7ff9a6a00700 1 -- 172.21.15.82:0/1203645077 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff9a8057770 con 0x7ff9b014c500 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff98c06ad10 msgr2=0x7ff98c06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff98c06ad10 0x7ff98c06d220 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0007fd0 tx=0x7ff9a0009040 comp rx=0 tx=0).stop 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b014c500 msgr2=0x7ff9b014c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b014c500 0x7ff9b014c910 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800cae0 tx=0x7ff9a800cdf0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 shutdown_connections 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff98c06ad10 0x7ff98c06d220 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9b014c500 0x7ff9b014c910 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff9b00b6270 0x7ff9b00ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 --2- 172.21.15.82:0/1203645077 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff9b00cb0e0 0x7ff9b014bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 >> 172.21.15.82:0/1203645077 conn(0x7ff9b00d0a90 msgr2=0x7ff9b00cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:24.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 shutdown_connections 2024-05-10T04:51:24.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.515+0000 7ff9b5c00700 1 -- 172.21.15.82:0/1203645077 wait complete. 2024-05-10T04:51:24.518 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2024-05-10T04:51:24.542 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-10T04:51:24.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.804+0000 7fceda600700 1 Processor -- start 2024-05-10T04:51:24.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.804+0000 7fceda600700 1 -- start start 2024-05-10T04:51:24.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.806+0000 7fceda600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40b2ca0 0x7fced40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.806+0000 7fceda600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fced415e350 0x7fced40d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.806+0000 7fceda600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4161e40 con 0x7fced415df40 2024-05-10T04:51:24.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.806+0000 7fceda600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced4162120 con 0x7fced415e350 2024-05-10T04:51:24.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.806+0000 7fceda600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced4162400 con 0x7fced40b2ca0 2024-05-10T04:51:24.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.806+0000 7fced3e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fced415df40 0x7fced40d03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35572/0 (socket says 172.21.15.82:35572) 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.806+0000 7fced3e00700 1 -- 172.21.15.82:0/1384481181 learned_addr learned my addr 172.21.15.82:0/1384481181 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced9c00700 1 --2- 172.21.15.82:0/1384481181 >> v2:172.21.15.129:3300/0 conn(0x7fced415e350 0x7fced40d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255233397 0 0) 0x7fced4161e40 con 0x7fced415df40 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcebc0035b0 con 0x7fced415df40 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1401065852 0 0) 0x7fcebc0035b0 con 0x7fced415df40 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40b2ca0 msgr2=0x7fced40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40b2ca0 0x7fced40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 >> v2:172.21.15.129:3300/0 conn(0x7fced415e350 msgr2=0x7fced40d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 --2- 172.21.15.82:0/1384481181 >> v2:172.21.15.129:3300/0 conn(0x7fced415e350 0x7fced40d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced41626e0 con 0x7fced415df40 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fcec0001670 con 0x7fced415df40 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 >> v1:172.21.15.82:6789/0 conn(0x7fced415df40 legacy=0x7fced40d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fcebc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40b2ca0 0x7fcebc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcebc004d90 0x7fcebc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4162120 con 0x7fcebc003a00 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4162400 con 0x7fcebc004d90 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.807+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc00bc70 con 0x7fced40b2ca0 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.808+0000 7fced9200700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fcebc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.808+0000 7fced9c00700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcebc004d90 0x7fcebc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.808+0000 7fced9200700 1 -- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40b2ca0 msgr2=0x7fcebc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.808+0000 7fced9200700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40b2ca0 0x7fcebc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.808+0000 7fced9200700 1 -- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcebc004d90 msgr2=0x7fcebc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.808+0000 7fced9200700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcebc004d90 0x7fcebc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.808+0000 7fced9200700 1 -- 172.21.15.82:0/1384481181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc0035b0 con 0x7fcebc003a00 2024-05-10T04:51:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.808+0000 7fced9200700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fcebc003e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009910 tx=0x7fcebc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff020755c064759 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8011620 con 0x7fcebc003a00 2024-05-10T04:51:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec8011780 con 0x7fcebc003a00 2024-05-10T04:51:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fced3400700 1 -- 172.21.15.82:0/1384481181 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8011b10 con 0x7fcebc003a00 2024-05-10T04:51:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fceda600700 1 -- 172.21.15.82:0/1384481181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 msgr2=0x7fcebc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fceda600700 1 --2- 172.21.15.82:0/1384481181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fcebc003e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009910 tx=0x7fcebc005880 comp rx=0 tx=0).stop 2024-05-10T04:51:24.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fced9c00700 1 -- 172.21.15.82:0/1384481181 reap_dead start 2024-05-10T04:51:24.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fceda600700 1 -- 172.21.15.82:0/1384481181 shutdown_connections 2024-05-10T04:51:24.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fceda600700 1 -- 172.21.15.82:0/1384481181 >> 172.21.15.82:0/1384481181 conn(0x7fced4067600 msgr2=0x7fced406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:24.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.809+0000 7fceda600700 1 -- 172.21.15.82:0/1384481181 shutdown_connections 2024-05-10T04:51:24.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.810+0000 7fceda600700 1 -- 172.21.15.82:0/1384481181 wait complete. 2024-05-10T04:51:24.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.812+0000 7fceda600700 1 Processor -- start 2024-05-10T04:51:24.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.812+0000 7fceda600700 1 -- start start 2024-05-10T04:51:24.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.813+0000 7fceda600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fced40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.813+0000 7fceda600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced4151110 0x7fced40cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.813+0000 7fceda600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40cc460 0x7fced41f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.813+0000 7fceda600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced41f56b0 con 0x7fcebc003a00 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.813+0000 7fceda600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced40c8a70 con 0x7fced4151110 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.813+0000 7fceda600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced40cc870 con 0x7fced40cc460 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fced40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fced40c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51268/0 (socket says 172.21.15.82:51268) 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 -- 172.21.15.82:0/2810697865 learned_addr learned my addr 172.21.15.82:0/2810697865 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced3e00700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced4151110 0x7fced40cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9c00700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40cc460 0x7fced41f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 -- 172.21.15.82:0/2810697865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40cc460 msgr2=0x7fced41f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40cc460 0x7fced41f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 -- 172.21.15.82:0/2810697865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced4151110 msgr2=0x7fced40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced4151110 0x7fced40cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 -- 172.21.15.82:0/2810697865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40c9f60 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced9200700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fced40c9950 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcec80090b0 tx=0x7fcec8004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.814+0000 7fced0c00700 1 -- 172.21.15.82:0/2810697865 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8004450 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.815+0000 7fced0c00700 1 -- 172.21.15.82:0/2810697865 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec801f070 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.815+0000 7fced0c00700 1 -- 172.21.15.82:0/2810697865 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80038c0 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.815+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced40c8140 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.815+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced40c8700 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.816+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced4074af0 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.817+0000 7fced0c00700 1 -- 172.21.15.82:0/2810697865 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcec8003a20 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.817+0000 7fced0c00700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fceb406acc0 0x7fceb406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.818+0000 7fced0c00700 1 -- 172.21.15.82:0/2810697865 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcec8021070 con 0x7fcebc003a00 2024-05-10T04:51:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.818+0000 7fced3e00700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fceb406acc0 0x7fceb406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:24.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.818+0000 7fced3e00700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fceb406acc0 0x7fceb406d1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fced4161800 tx=0x7fcec00016a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:24.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:24.823+0000 7fced0c00700 1 -- 172.21.15.82:0/2810697865 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcec80557e0 con 0x7fcebc003a00 2024-05-10T04:51:25.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.109+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fced40c8c00 con 0x7fcebc003a00 2024-05-10T04:51:25.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.110+0000 7fced0c00700 1 -- 172.21.15.82:0/2810697865 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fcec8058e00 con 0x7fcebc003a00 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBGpz1mDRTWAxAACk0gFXIT14HYWwVgIplu2A==", 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBGpz1mCpYjIxAAKSMseAs/I2sx1XpIwyZXmQ==", 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBGpz1mg/92ExAA6oh5LV1Bg5Kr3sGXOElCxA==", 2024-05-10T04:51:25.113 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBGpz1mErySMhAADOhyIMzLzTdB1LENN7T71Q==", 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-05-10T04:51:25.114 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBKpz1mdgKKMRAATz0iNoHijuFfo9T6Q9rSaQ==", 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2024-05-10T04:51:25.115 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBOpz1mRwrrABAAeGW0y83zCm2u6qFV+1nnjQ==", 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBRpz1mXhtJDBAAqBpz0VzVWsgF68GXfvF61Q==", 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.116 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBUpz1mKPopFxAALRbiK8KaHX0cvDjG8KgqSg==", 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBapz1mgQN8HxAAzHwsLeeHnrIike0QK3cRwg==", 2024-05-10T04:51:25.117 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBdpz1maw8HKhAAcQqkEj01J93GH4ZvbalYHw==", 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-05-10T04:51:25.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBgpz1maxchNRAAOpaJPQt2+qadukNtZViVKg==", 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-05-10T04:51:25.119 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBkpz1myoqdAxAAMxlMaKOuaQ0XsA1USkFsFw==", 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2024-05-10T04:51:25.120 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBHpz1myssrBRAAH/ztxl/ZDNu0XXnOGRXu3g==", 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.121 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBHpz1m+DqPHBAA//s7HgavRK06cgzVvfQ+nA==", 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBHpz1mgTnGEBAA3N5mS1VUUJcTWYbRZmYJXA==", 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-05-10T04:51:25.122 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBHpz1mfKBQKBAAG3iThGRFufRl/Jw8O9pHjg==", 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBEpz1m8M3lIxAAgYZLAe+XzwFUrx1MTzNskw==", 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mds", 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBtpz1miGOCJhAAWfkV8HPyniwnm8oyRLDDhg==", 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mds" 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mgr", 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBtpz1m6m2CJhAAm1xBqvbJNu0mwG6tCECjaw==", 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-osd", 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBtpz1mbnaCJhAAlQpVPV64iJUZkL2gV2XNzg==", 2024-05-10T04:51:25.125 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-osd" 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd", 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBtpz1myn+CJhAAEFnGtXB5bReif0NAG8ntUA==", 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-10T04:51:25.126 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBtpz1mc4iCJhAAnWTmZpByqEdfGancfoLtFA==", 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rgw", 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBtpz1mNZGCJhAAR6RGfiIvT/KVPFJ6ldI7mw==", 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2024-05-10T04:51:25.127 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBFpz1mfHN2MxAAHjG3b/dqoc3+K/QwMVIdig==", 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBFpz1m3pgDFRAAbY3bzHLqc500AdfB5PzzIA==", 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:25.129 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-10T04:51:25.129 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:51:25.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.112+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fceb406acc0 msgr2=0x7fceb406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.112+0000 7fceda600700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fceb406acc0 0x7fceb406d1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fced4161800 tx=0x7fcec00016a0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.112+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 msgr2=0x7fced40c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.112+0000 7fceda600700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fced40c9950 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcec80090b0 tx=0x7fcec8004860 comp rx=0 tx=0).stop 2024-05-10T04:51:25.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.112+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 shutdown_connections 2024-05-10T04:51:25.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.112+0000 7fceda600700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fceb406acc0 0x7fceb406d1d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.113+0000 7fceda600700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fced40cc460 0x7fced41f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.113+0000 7fceda600700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcebc003a00 0x7fced40c9950 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.113+0000 7fceda600700 1 --2- 172.21.15.82:0/2810697865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fced4151110 0x7fced40cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.113+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 >> 172.21.15.82:0/2810697865 conn(0x7fced4067600 msgr2=0x7fced415b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.113+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 shutdown_connections 2024-05-10T04:51:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.113+0000 7fceda600700 1 -- 172.21.15.82:0/2810697865 wait complete. 2024-05-10T04:51:25.141 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-10T04:51:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.401+0000 7fad26400700 1 Processor -- start 2024-05-10T04:51:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.401+0000 7fad26400700 1 -- start start 2024-05-10T04:51:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.403+0000 7fad26400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200d0990 0x7fad200d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.403+0000 7fad26400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad200b5bb0 con 0x7fad200b3090 2024-05-10T04:51:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.403+0000 7fad26400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad200ceeb0 con 0x7fad20161d40 2024-05-10T04:51:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.403+0000 7fad26400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200cf6d0 con 0x7fad200d0990 2024-05-10T04:51:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.403+0000 7fad1fe00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fad200b3090 0x7fad200ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35588/0 (socket says 172.21.15.82:35588) 2024-05-10T04:51:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.403+0000 7fad1fe00700 1 -- 172.21.15.82:0/3306571459 learned_addr learned my addr 172.21.15.82:0/3306571459 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad25a00700 1 --2- 172.21.15.82:0/3306571459 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200d0990 0x7fad200d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad1f400700 1 -- 172.21.15.82:0/3306571459 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696095851 0 0) 0x7fad200b5bb0 con 0x7fad200b3090 2024-05-10T04:51:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad1f400700 1 -- 172.21.15.82:0/3306571459 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad080035b0 con 0x7fad200b3090 2024-05-10T04:51:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad1f400700 1 -- 172.21.15.82:0/3306571459 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060133258 0 0) 0x7fad200ceeb0 con 0x7fad20161d40 2024-05-10T04:51:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad1f400700 1 -- 172.21.15.82:0/3306571459 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad200b5bb0 con 0x7fad20161d40 2024-05-10T04:51:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad1f400700 1 -- 172.21.15.82:0/3306571459 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1284396111 0 0) 0x7fad080035b0 con 0x7fad200b3090 2024-05-10T04:51:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad25a00700 1 -- 172.21.15.82:0/3306571459 >> v1:172.21.15.129:6789/0 conn(0x7fad20161d40 legacy=0x7fad200b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad25a00700 1 -- 172.21.15.82:0/3306571459 >> v1:172.21.15.82:6789/0 conn(0x7fad200b3090 legacy=0x7fad200ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.404+0000 7fad25a00700 1 -- 172.21.15.82:0/3306571459 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200d12e0 con 0x7fad200d0990 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.405+0000 7fad25a00700 1 --2- 172.21.15.82:0/3306571459 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200d0990 0x7fad200d0da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad18009dc0 tx=0x7fad1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31dabac4d6cd8262 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.405+0000 7fad1f400700 1 -- 172.21.15.82:0/3306571459 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800e070 con 0x7fad200d0990 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.405+0000 7fad1f400700 1 -- 172.21.15.82:0/3306571459 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18003a20 con 0x7fad200d0990 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.405+0000 7fad1f400700 1 -- 172.21.15.82:0/3306571459 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c001670 con 0x7fad200d0990 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.406+0000 7fad26400700 1 -- 172.21.15.82:0/3306571459 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200d0990 msgr2=0x7fad200d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.406+0000 7fad26400700 1 --2- 172.21.15.82:0/3306571459 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200d0990 0x7fad200d0da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad18009dc0 tx=0x7fad1800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.406+0000 7fad26400700 1 -- 172.21.15.82:0/3306571459 shutdown_connections 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.406+0000 7fad26400700 1 --2- 172.21.15.82:0/3306571459 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200d0990 0x7fad200d0da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.406+0000 7fad26400700 1 -- 172.21.15.82:0/3306571459 >> 172.21.15.82:0/3306571459 conn(0x7fad2006c580 msgr2=0x7fad2006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.406+0000 7fad26400700 1 -- 172.21.15.82:0/3306571459 shutdown_connections 2024-05-10T04:51:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.406+0000 7fad26400700 1 -- 172.21.15.82:0/3306571459 wait complete. 2024-05-10T04:51:25.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.408+0000 7fad26400700 1 Processor -- start 2024-05-10T04:51:25.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.408+0000 7fad26400700 1 -- start start 2024-05-10T04:51:25.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad26400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200b3090 0x7fad200ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:25.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad26400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad200d0990 0x7fad20154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:25.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad26400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20161d40 0x7fad20160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:25.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad26400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad20155390 con 0x7fad20161d40 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad26400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200ca760 con 0x7fad200d0990 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad26400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200cbf90 con 0x7fad200b3090 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20161d40 0x7fad20160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20161d40 0x7fad20160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51282/0 (socket says 172.21.15.82:51282) 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25a00700 1 -- 172.21.15.82:0/1221401102 learned_addr learned my addr 172.21.15.82:0/1221401102 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad1fe00700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad200d0990 0x7fad20154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25000700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200b3090 0x7fad200ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25a00700 1 -- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200b3090 msgr2=0x7fad200ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25a00700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200b3090 0x7fad200ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25a00700 1 -- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad200d0990 msgr2=0x7fad20154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25a00700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad200d0990 0x7fad20154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25a00700 1 -- 172.21.15.82:0/1221401102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18009a70 con 0x7fad20161d40 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad1fe00700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad200d0990 0x7fad20154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.410+0000 7fad25000700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200b3090 0x7fad200ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.411+0000 7fad25a00700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20161d40 0x7fad20160840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fad18015040 tx=0x7fad18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.411+0000 7fad1cc00700 1 -- 172.21.15.82:0/1221401102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad180043c0 con 0x7fad20161d40 2024-05-10T04:51:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.411+0000 7fad1cc00700 1 -- 172.21.15.82:0/1221401102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad18004520 con 0x7fad20161d40 2024-05-10T04:51:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.411+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad200cc220 con 0x7fad20161d40 2024-05-10T04:51:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.411+0000 7fad1cc00700 1 -- 172.21.15.82:0/1221401102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18004890 con 0x7fad20161d40 2024-05-10T04:51:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.411+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad200cc7e0 con 0x7fad20161d40 2024-05-10T04:51:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.412+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2006c990 con 0x7fad20161d40 2024-05-10T04:51:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.413+0000 7fad1cc00700 1 -- 172.21.15.82:0/1221401102 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad1801c460 con 0x7fad20161d40 2024-05-10T04:51:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.414+0000 7fad1cc00700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad0006ac90 0x7fad0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.414+0000 7fad1cc00700 1 -- 172.21.15.82:0/1221401102 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad1808a7b0 con 0x7fad20161d40 2024-05-10T04:51:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.414+0000 7fad25000700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad0006ac90 0x7fad0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.415+0000 7fad25000700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad0006ac90 0x7fad0006d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad140011e0 tx=0x7fad14009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.419+0000 7fad1cc00700 1 -- 172.21.15.82:0/1221401102 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fad18055c70 con 0x7fad20161d40 2024-05-10T04:51:25.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.706+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fad20074af0 con 0x7fad20161d40 2024-05-10T04:51:25.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.711+0000 7fad1cc00700 1 -- 172.21.15.82:0/1221401102 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fad18059290 con 0x7fad20161d40 2024-05-10T04:51:25.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.713+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad0006ac90 msgr2=0x7fad0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.713+0000 7fad26400700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad0006ac90 0x7fad0006d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fad140011e0 tx=0x7fad14009040 comp rx=0 tx=0).stop 2024-05-10T04:51:25.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20161d40 msgr2=0x7fad20160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:25.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20161d40 0x7fad20160840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fad18015040 tx=0x7fad18004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 shutdown_connections 2024-05-10T04:51:25.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad0006ac90 0x7fad0006d1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad20161d40 0x7fad20160840 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fad200b3090 0x7fad200ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 --2- 172.21.15.82:0/1221401102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad200d0990 0x7fad20154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:25.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 >> 172.21.15.82:0/1221401102 conn(0x7fad2006c580 msgr2=0x7fad2015dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:25.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 shutdown_connections 2024-05-10T04:51:25.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:25.714+0000 7fad26400700 1 -- 172.21.15.82:0/1221401102 wait complete. 2024-05-10T04:51:25.743 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-10T04:51:26.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.004+0000 7ff057000700 1 Processor -- start 2024-05-10T04:51:26.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.004+0000 7ff057000700 1 -- start start 2024-05-10T04:51:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff057000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0500b2f50 0x7ff050161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff057000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 0x7ff0500d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff057000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500d28c0 con 0x7ff0500d3030 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff057000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500b3360 con 0x7ff0500b2f50 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff057000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501624e0 con 0x7ff0500d0d40 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff04fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0500b2f50 0x7ff050161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff04f400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff0500d3030 0x7ff0500d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38826/0 (socket says 172.21.15.82:38826) 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff04f400700 1 -- 172.21.15.82:0/2951058808 learned_addr learned my addr 172.21.15.82:0/2951058808 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.006+0000 7ff055000700 1 --2- 172.21.15.82:0/2951058808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 0x7ff0500d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04fe00700 1 -- 172.21.15.82:0/2951058808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 msgr2=0x7ff0500d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04fe00700 1 --2- 172.21.15.82:0/2951058808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 0x7ff0500d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04fe00700 1 -- 172.21.15.82:0/2951058808 >> v1:172.21.15.82:6789/0 conn(0x7ff0500d3030 legacy=0x7ff0500d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04fe00700 1 -- 172.21.15.82:0/2951058808 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500d2ba0 con 0x7ff0500b2f50 2024-05-10T04:51:26.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff055000700 1 --2- 172.21.15.82:0/2951058808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 0x7ff0500d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:26.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04ea00700 1 -- 172.21.15.82:0/2951058808 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874008712 0 0) 0x7ff0500d28c0 con 0x7ff0500d3030 2024-05-10T04:51:26.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04fe00700 1 --2- 172.21.15.82:0/2951058808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500b2f50 0x7ff050161fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff040009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7728d2cad5ac9227 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:26.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04ea00700 1 -- 172.21.15.82:0/2951058808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040011830 con 0x7ff0500b2f50 2024-05-10T04:51:26.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04ea00700 1 -- 172.21.15.82:0/2951058808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040011990 con 0x7ff0500b2f50 2024-05-10T04:51:26.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.007+0000 7ff04ea00700 1 -- 172.21.15.82:0/2951058808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040011d20 con 0x7ff0500b2f50 2024-05-10T04:51:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.008+0000 7ff057000700 1 -- 172.21.15.82:0/2951058808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500b2f50 msgr2=0x7ff050161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.008+0000 7ff057000700 1 --2- 172.21.15.82:0/2951058808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500b2f50 0x7ff050161fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff040009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.008+0000 7ff057000700 1 -- 172.21.15.82:0/2951058808 shutdown_connections 2024-05-10T04:51:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.008+0000 7ff057000700 1 --2- 172.21.15.82:0/2951058808 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 0x7ff0500d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.008+0000 7ff057000700 1 --2- 172.21.15.82:0/2951058808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500b2f50 0x7ff050161fa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.008+0000 7ff057000700 1 -- 172.21.15.82:0/2951058808 >> 172.21.15.82:0/2951058808 conn(0x7ff05006c3f0 msgr2=0x7ff05006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.008+0000 7ff057000700 1 -- 172.21.15.82:0/2951058808 shutdown_connections 2024-05-10T04:51:26.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.008+0000 7ff057000700 1 -- 172.21.15.82:0/2951058808 wait complete. 2024-05-10T04:51:26.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.010+0000 7ff057000700 1 Processor -- start 2024-05-10T04:51:26.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.010+0000 7ff057000700 1 -- start start 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff057000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0500b2f50 0x7ff0500c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff057000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 0x7ff0501500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff057000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500d3030 0x7ff0501e93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff057000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501f4600 con 0x7ff0500d3030 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff057000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c8710 con 0x7ff0500b2f50 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff057000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff050150600 con 0x7ff0500d0d40 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff055000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500d3030 0x7ff0501e93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff055000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500d3030 0x7ff0501e93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53736/0 (socket says 172.21.15.82:53736) 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.012+0000 7ff055000700 1 -- 172.21.15.82:0/265583943 learned_addr learned my addr 172.21.15.82:0/265583943 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff055000700 1 -- 172.21.15.82:0/265583943 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 msgr2=0x7ff0501500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff055000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 0x7ff0501500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff04fe00700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0500b2f50 0x7ff0500c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff055000700 1 -- 172.21.15.82:0/265583943 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0500b2f50 msgr2=0x7ff0500c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff055000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0500b2f50 0x7ff0500c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff055000700 1 -- 172.21.15.82:0/265583943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400094a0 con 0x7ff0500d3030 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff04fe00700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0500b2f50 0x7ff0500c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff055000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500d3030 0x7ff0501e93b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff048007df0 tx=0x7ff04800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff047e00700 1 -- 172.21.15.82:0/265583943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04800ddd0 con 0x7ff0500d3030 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff047e00700 1 -- 172.21.15.82:0/265583943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04800f040 con 0x7ff0500d3030 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0500cb9c0 con 0x7ff0500d3030 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff047e00700 1 -- 172.21.15.82:0/265583943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048003c60 con 0x7ff0500d3030 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.013+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0500cbf80 con 0x7ff0500d3030 2024-05-10T04:51:26.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.014+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050074af0 con 0x7ff0500d3030 2024-05-10T04:51:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.015+0000 7ff047e00700 1 -- 172.21.15.82:0/265583943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff048004030 con 0x7ff0500d3030 2024-05-10T04:51:26.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.016+0000 7ff047e00700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff03006acc0 0x7ff03006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.016+0000 7ff047e00700 1 -- 172.21.15.82:0/265583943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff048089270 con 0x7ff0500d3030 2024-05-10T04:51:26.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.016+0000 7ff04fe00700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff03006acc0 0x7ff03006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.017+0000 7ff04fe00700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff03006acc0 0x7ff03006d1d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff040008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:26.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.021+0000 7ff047e00700 1 -- 172.21.15.82:0/265583943 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff048054700 con 0x7ff0500d3030 2024-05-10T04:51:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.310+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff0500b34a0 con 0x7ff0500d3030 2024-05-10T04:51:26.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.315+0000 7ff047e00700 1 -- 172.21.15.82:0/265583943 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff048057d20 con 0x7ff0500d3030 2024-05-10T04:51:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff03006acc0 msgr2=0x7ff03006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff03006acc0 0x7ff03006d1d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff040008030 comp rx=0 tx=0).stop 2024-05-10T04:51:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500d3030 msgr2=0x7ff0501e93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500d3030 0x7ff0501e93b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff048007df0 tx=0x7ff04800d3b0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 shutdown_connections 2024-05-10T04:51:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff03006acc0 0x7ff03006d1d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0500d3030 0x7ff0501e93b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff0500b2f50 0x7ff0500c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 --2- 172.21.15.82:0/265583943 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff0500d0d40 0x7ff0501500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 >> 172.21.15.82:0/265583943 conn(0x7ff05006c3f0 msgr2=0x7ff0500d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 shutdown_connections 2024-05-10T04:51:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.318+0000 7ff057000700 1 -- 172.21.15.82:0/265583943 wait complete. 2024-05-10T04:51:26.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-10T04:51:26.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.608+0000 7f11a9e00700 1 Processor -- start 2024-05-10T04:51:26.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.608+0000 7f11a9e00700 1 -- start start 2024-05-10T04:51:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.610+0000 7f11a9e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f11a40b2f50 0x7f11a4161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.610+0000 7f11a9e00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a40d28c0 con 0x7f11a40d3030 2024-05-10T04:51:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.610+0000 7f11a9e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a40d2ba0 con 0x7f11a40d0d40 2024-05-10T04:51:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.610+0000 7f11a9e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a40b3360 con 0x7f11a40b2f50 2024-05-10T04:51:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.610+0000 7f119be00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f11a40d3030 0x7f11a40d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38836/0 (socket says 172.21.15.82:38836) 2024-05-10T04:51:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f119be00700 1 -- 172.21.15.82:0/279261982 learned_addr learned my addr 172.21.15.82:0/279261982 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f11a2a00700 1 --2- 172.21.15.82:0/279261982 >> v2:172.21.15.129:3300/0 conn(0x7f11a40b2f50 0x7f11a4161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f11a2000700 1 -- 172.21.15.82:0/279261982 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961523047 0 0) 0x7f11a40d28c0 con 0x7f11a40d3030 2024-05-10T04:51:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f11a2000700 1 -- 172.21.15.82:0/279261982 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11880035b0 con 0x7f11a40d3030 2024-05-10T04:51:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f11a2000700 1 -- 172.21.15.82:0/279261982 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708299789 0 0) 0x7f11a40d2ba0 con 0x7f11a40d0d40 2024-05-10T04:51:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f11a2000700 1 -- 172.21.15.82:0/279261982 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a40d28c0 con 0x7f11a40d0d40 2024-05-10T04:51:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f11a2a00700 1 -- 172.21.15.82:0/279261982 >> v1:172.21.15.129:6789/0 conn(0x7f11a40d0d40 legacy=0x7f11a40b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f11a2a00700 1 -- 172.21.15.82:0/279261982 >> v1:172.21.15.82:6789/0 conn(0x7f11a40d3030 legacy=0x7f11a40d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.611+0000 7f11a2a00700 1 -- 172.21.15.82:0/279261982 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40cf970 con 0x7f11a40b2f50 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.612+0000 7f11a2a00700 1 --2- 172.21.15.82:0/279261982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 0x7f11a4161fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1194009840 tx=0x7f1194009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a6d85a44f0d42d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.612+0000 7f11a2000700 1 -- 172.21.15.82:0/279261982 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194011830 con 0x7f11a40b2f50 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.612+0000 7f11a2000700 1 -- 172.21.15.82:0/279261982 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1194011990 con 0x7f11a40b2f50 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.612+0000 7f11a2000700 1 -- 172.21.15.82:0/279261982 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1194011d00 con 0x7f11a40b2f50 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.613+0000 7f11a9e00700 1 -- 172.21.15.82:0/279261982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 msgr2=0x7f11a4161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.613+0000 7f11a9e00700 1 --2- 172.21.15.82:0/279261982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 0x7f11a4161fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1194009840 tx=0x7f1194009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.613+0000 7f11a9e00700 1 -- 172.21.15.82:0/279261982 shutdown_connections 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.613+0000 7f11a9e00700 1 --2- 172.21.15.82:0/279261982 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 0x7f11a4161fa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.613+0000 7f11a9e00700 1 -- 172.21.15.82:0/279261982 >> 172.21.15.82:0/279261982 conn(0x7f11a406c3f0 msgr2=0x7f11a406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.613+0000 7f11a9e00700 1 -- 172.21.15.82:0/279261982 shutdown_connections 2024-05-10T04:51:26.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.613+0000 7f11a9e00700 1 -- 172.21.15.82:0/279261982 wait complete. 2024-05-10T04:51:26.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.615+0000 7f11a9e00700 1 Processor -- start 2024-05-10T04:51:26.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.615+0000 7f11a9e00700 1 -- start start 2024-05-10T04:51:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.616+0000 7f11a9e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 0x7f11a4151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a9e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f11a40d0d40 0x7f11a41520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a40d3030 0x7f11a414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a9e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a41f4890 con 0x7f11a40d3030 2024-05-10T04:51:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a9e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a414de70 con 0x7f11a40b2f50 2024-05-10T04:51:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a9e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40c85c0 con 0x7f11a40d0d40 2024-05-10T04:51:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a40d3030 0x7f11a414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a40d3030 0x7f11a414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53746/0 (socket says 172.21.15.82:53746) 2024-05-10T04:51:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a3400700 1 -- 172.21.15.82:0/1004557432 learned_addr learned my addr 172.21.15.82:0/1004557432 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a2a00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 0x7f11a4151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a3400700 1 -- 172.21.15.82:0/1004557432 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f11a40d0d40 msgr2=0x7f11a41520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a3400700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f11a40d0d40 0x7f11a41520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a3400700 1 -- 172.21.15.82:0/1004557432 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 msgr2=0x7f11a4151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a3400700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 0x7f11a4151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.617+0000 7f11a3400700 1 -- 172.21.15.82:0/1004557432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940094a0 con 0x7f11a40d3030 2024-05-10T04:51:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.618+0000 7f11a3400700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a40d3030 0x7f11a414b890 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f119c00cbc0 tx=0x7f119c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.618+0000 7f119b400700 1 -- 172.21.15.82:0/1004557432 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c003c00 con 0x7f11a40d3030 2024-05-10T04:51:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.618+0000 7f119b400700 1 -- 172.21.15.82:0/1004557432 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c003d60 con 0x7f11a40d3030 2024-05-10T04:51:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.618+0000 7f119b400700 1 -- 172.21.15.82:0/1004557432 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00ab00 con 0x7f11a40d3030 2024-05-10T04:51:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.618+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a414c6a0 con 0x7f11a40d3030 2024-05-10T04:51:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.618+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a40c8af0 con 0x7f11a40d3030 2024-05-10T04:51:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.619+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a4074af0 con 0x7f11a40d3030 2024-05-10T04:51:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.620+0000 7f119b400700 1 -- 172.21.15.82:0/1004557432 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f119c00ac60 con 0x7f11a40d3030 2024-05-10T04:51:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.621+0000 7f119b400700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f118006ac90 0x7f118006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.621+0000 7f119b400700 1 -- 172.21.15.82:0/1004557432 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f119c089070 con 0x7f11a40d3030 2024-05-10T04:51:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.621+0000 7f11a2a00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f118006ac90 0x7f118006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.622+0000 7f11a2a00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f118006ac90 0x7f118006d1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1194009840 tx=0x7f1194008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.626+0000 7f119b400700 1 -- 172.21.15.82:0/1004557432 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f119c0545d0 con 0x7f11a40d3030 2024-05-10T04:51:26.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.914+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f11a40b34a0 con 0x7f11a40d3030 2024-05-10T04:51:26.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.920+0000 7f119b400700 1 -- 172.21.15.82:0/1004557432 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f119c057bf0 con 0x7f11a40d3030 2024-05-10T04:51:26.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f118006ac90 msgr2=0x7f118006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f118006ac90 0x7f118006d1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1194009840 tx=0x7f1194008030 comp rx=0 tx=0).stop 2024-05-10T04:51:26.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a40d3030 msgr2=0x7f11a414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:26.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a40d3030 0x7f11a414b890 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f119c00cbc0 tx=0x7f119c00ced0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 shutdown_connections 2024-05-10T04:51:26.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f118006ac90 0x7f118006d1a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11a40d3030 0x7f11a414b890 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f11a40b2f50 0x7f11a4151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.922+0000 7f11a9e00700 1 --2- 172.21.15.82:0/1004557432 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f11a40d0d40 0x7f11a41520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.923+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 >> 172.21.15.82:0/1004557432 conn(0x7f11a406c3f0 msgr2=0x7f11a40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.923+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 shutdown_connections 2024-05-10T04:51:26.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:26.923+0000 7f11a9e00700 1 -- 172.21.15.82:0/1004557432 wait complete. 2024-05-10T04:51:26.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-10T04:51:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.209+0000 7fcb04000700 1 Processor -- start 2024-05-10T04:51:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.209+0000 7fcb04000700 1 -- start start 2024-05-10T04:51:27.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb04000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc0d3460 0x7fcafc0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb04000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcafc0b58b0 0x7fcafc0b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb04000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcafc0d2730 con 0x7fcafc1620e0 2024-05-10T04:51:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb04000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc0b3720 con 0x7fcafc0b58b0 2024-05-10T04:51:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb04000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc162c00 con 0x7fcafc0d3460 2024-05-10T04:51:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb00c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcafc0b58b0 0x7fcafc0b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb02000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcafc1620e0 0x7fcafc1624f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38848/0 (socket says 172.21.15.82:38848) 2024-05-10T04:51:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb02000700 1 -- 172.21.15.82:0/2073790201 learned_addr learned my addr 172.21.15.82:0/2073790201 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.211+0000 7fcb00c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcafc0b58b0 0x7fcafc0b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53748/0 (socket says 172.21.15.82:53748) 2024-05-10T04:51:27.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcb01600700 1 --2- 172.21.15.82:0/2073790201 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc0d3460 0x7fcafc0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcb00c00700 1 -- 172.21.15.82:0/2073790201 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc0d3460 msgr2=0x7fcafc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcb00c00700 1 --2- 172.21.15.82:0/2073790201 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc0d3460 0x7fcafc0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcb00c00700 1 -- 172.21.15.82:0/2073790201 >> v1:172.21.15.82:6789/0 conn(0x7fcafc1620e0 legacy=0x7fcafc1624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcb00c00700 1 -- 172.21.15.82:0/2073790201 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc0d2fd0 con 0x7fcafc0b58b0 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcafbe00700 1 -- 172.21.15.82:0/2073790201 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023885260 0 0) 0x7fcafc0d2730 con 0x7fcafc1620e0 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcb00c00700 1 --2- 172.21.15.82:0/2073790201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0b58b0 0x7fcafc0b5cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009840 tx=0x7fcae8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1192c84733d382 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcafbe00700 1 -- 172.21.15.82:0/2073790201 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8011830 con 0x7fcafc0b58b0 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcafbe00700 1 -- 172.21.15.82:0/2073790201 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae8011990 con 0x7fcafc0b58b0 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.212+0000 7fcafbe00700 1 -- 172.21.15.82:0/2073790201 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8011d20 con 0x7fcafc0b58b0 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.213+0000 7fcb04000700 1 -- 172.21.15.82:0/2073790201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0b58b0 msgr2=0x7fcafc0b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:27.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.213+0000 7fcb04000700 1 --2- 172.21.15.82:0/2073790201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0b58b0 0x7fcafc0b5cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009840 tx=0x7fcae8009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.213+0000 7fcb04000700 1 -- 172.21.15.82:0/2073790201 shutdown_connections 2024-05-10T04:51:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.213+0000 7fcb04000700 1 --2- 172.21.15.82:0/2073790201 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc0d3460 0x7fcafc0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.213+0000 7fcb04000700 1 --2- 172.21.15.82:0/2073790201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0b58b0 0x7fcafc0b5cc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.213+0000 7fcb04000700 1 -- 172.21.15.82:0/2073790201 >> 172.21.15.82:0/2073790201 conn(0x7fcafc0d0a90 msgr2=0x7fcafc0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.213+0000 7fcb04000700 1 -- 172.21.15.82:0/2073790201 shutdown_connections 2024-05-10T04:51:27.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.213+0000 7fcb04000700 1 -- 172.21.15.82:0/2073790201 wait complete. 2024-05-10T04:51:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.216+0000 7fcb04000700 1 Processor -- start 2024-05-10T04:51:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.216+0000 7fcb04000700 1 -- start start 2024-05-10T04:51:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb04000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcafc0b58b0 0x7fcafc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb04000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0d3460 0x7fcafc149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb04000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc1620e0 0x7fcafc0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb04000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc159bd0 con 0x7fcafc0d3460 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb04000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc14d780 con 0x7fcafc0b58b0 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb04000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc149bf0 con 0x7fcafc1620e0 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb00c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0d3460 0x7fcafc149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb00c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0d3460 0x7fcafc149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53758/0 (socket says 172.21.15.82:53758) 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.217+0000 7fcb00c00700 1 -- 172.21.15.82:0/1352542045 learned_addr learned my addr 172.21.15.82:0/1352542045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb02000700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc1620e0 0x7fcafc0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb01600700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcafc0b58b0 0x7fcafc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb00c00700 1 -- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc1620e0 msgr2=0x7fcafc0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb00c00700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc1620e0 0x7fcafc0b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb00c00700 1 -- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcafc0b58b0 msgr2=0x7fcafc0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb00c00700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcafc0b58b0 0x7fcafc0cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb00c00700 1 -- 172.21.15.82:0/1352542045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80094a0 con 0x7fcafc0d3460 2024-05-10T04:51:27.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb01600700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcafc0b58b0 0x7fcafc0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb00c00700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0d3460 0x7fcafc149260 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcae80090b0 tx=0x7fcae8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcaf9600700 1 -- 172.21.15.82:0/1352542045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80038a0 con 0x7fcafc0d3460 2024-05-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcaf9600700 1 -- 172.21.15.82:0/1352542045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae801e070 con 0x7fcafc0d3460 2024-05-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcaf9600700 1 -- 172.21.15.82:0/1352542045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8003c00 con 0x7fcafc0d3460 2024-05-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.218+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc149e40 con 0x7fcafc0d3460 2024-05-10T04:51:27.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.219+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc14a400 con 0x7fcafc0d3460 2024-05-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.220+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcafc14ad30 con 0x7fcafc0d3460 2024-05-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.221+0000 7fcaf9600700 1 -- 172.21.15.82:0/1352542045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcae801a420 con 0x7fcafc0d3460 2024-05-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.221+0000 7fcaf9600700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcadc06ac90 0x7fcadc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.222+0000 7fcaf9600700 1 -- 172.21.15.82:0/1352542045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcae808a080 con 0x7fcafc0d3460 2024-05-10T04:51:27.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.222+0000 7fcb01600700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcadc06ac90 0x7fcadc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.222+0000 7fcb01600700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcadc06ac90 0x7fcadc06d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0007a50 tx=0x7fcaf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:27.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.226+0000 7fcaf9600700 1 -- 172.21.15.82:0/1352542045 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcae8055640 con 0x7fcafc0d3460 2024-05-10T04:51:27.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.508+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fcafc0732b0 con 0x7fcafc0d3460 2024-05-10T04:51:27.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.514+0000 7fcaf9600700 1 -- 172.21.15.82:0/1352542045 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcae80090e0 con 0x7fcafc0d3460 2024-05-10T04:51:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcadc06ac90 msgr2=0x7fcadc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcadc06ac90 0x7fcadc06d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0007a50 tx=0x7fcaf0008040 comp rx=0 tx=0).stop 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0d3460 msgr2=0x7fcafc149260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0d3460 0x7fcafc149260 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcae80090b0 tx=0x7fcae8004750 comp rx=0 tx=0).stop 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 shutdown_connections 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcadc06ac90 0x7fcadc06d1a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcafc1620e0 0x7fcafc0b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcafc0b58b0 0x7fcafc0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 --2- 172.21.15.82:0/1352542045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcafc0d3460 0x7fcafc149260 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 >> 172.21.15.82:0/1352542045 conn(0x7fcafc0d0a90 msgr2=0x7fcafc1624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 shutdown_connections 2024-05-10T04:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.517+0000 7fcb04000700 1 -- 172.21.15.82:0/1352542045 wait complete. 2024-05-10T04:51:27.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-10T04:51:27.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.805+0000 7fa453200700 1 Processor -- start 2024-05-10T04:51:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.805+0000 7fa453200700 1 -- start start 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.807+0000 7fa453200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa44c0b2f50 0x7fa44c161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.807+0000 7fa453200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa44c0d3030 0x7fa44c0d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa453200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d0630 0x7fa44c0d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa453200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c0b3360 con 0x7fa44c0b2f50 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa453200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c1624e0 con 0x7fa44c0d3030 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa453200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0d28c0 con 0x7fa44c0d0630 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44be00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa44c0b2f50 0x7fa44c161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44be00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa44c0b2f50 0x7fa44c161fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53764/0 (socket says 172.21.15.82:53764) 2024-05-10T04:51:27.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44be00700 1 -- 172.21.15.82:0/1305313776 learned_addr learned my addr 172.21.15.82:0/1305313776 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44b400700 1 --2- 172.21.15.82:0/1305313776 >> v2:172.21.15.129:3300/0 conn(0x7fa44c0d3030 0x7fa44c0d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa451200700 1 --2- 172.21.15.82:0/1305313776 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d0630 0x7fa44c0d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44be00700 1 -- 172.21.15.82:0/1305313776 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d0630 msgr2=0x7fa44c0d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44be00700 1 --2- 172.21.15.82:0/1305313776 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d0630 0x7fa44c0d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44be00700 1 -- 172.21.15.82:0/1305313776 >> v2:172.21.15.129:3300/0 conn(0x7fa44c0d3030 msgr2=0x7fa44c0d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44be00700 1 --2- 172.21.15.82:0/1305313776 >> v2:172.21.15.129:3300/0 conn(0x7fa44c0d3030 0x7fa44c0d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44be00700 1 -- 172.21.15.82:0/1305313776 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c0d2ba0 con 0x7fa44c0b2f50 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.808+0000 7fa44b400700 1 --2- 172.21.15.82:0/1305313776 >> v2:172.21.15.129:3300/0 conn(0x7fa44c0d3030 0x7fa44c0d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.809+0000 7fa44be00700 1 --2- 172.21.15.82:0/1305313776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0b2f50 0x7fa44c161fa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0d0580 tx=0x7fa43c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7be32b530f0f6c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.809+0000 7fa44aa00700 1 -- 172.21.15.82:0/1305313776 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00b870 con 0x7fa44c0b2f50 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.809+0000 7fa44aa00700 1 -- 172.21.15.82:0/1305313776 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00b9d0 con 0x7fa44c0b2f50 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.809+0000 7fa44aa00700 1 -- 172.21.15.82:0/1305313776 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00bd60 con 0x7fa44c0b2f50 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.809+0000 7fa453200700 1 -- 172.21.15.82:0/1305313776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0b2f50 msgr2=0x7fa44c161fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.809+0000 7fa453200700 1 --2- 172.21.15.82:0/1305313776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0b2f50 0x7fa44c161fa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0d0580 tx=0x7fa43c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.810+0000 7fa453200700 1 -- 172.21.15.82:0/1305313776 shutdown_connections 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.810+0000 7fa453200700 1 --2- 172.21.15.82:0/1305313776 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d0630 0x7fa44c0d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.810+0000 7fa453200700 1 --2- 172.21.15.82:0/1305313776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0b2f50 0x7fa44c161fa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.810+0000 7fa453200700 1 --2- 172.21.15.82:0/1305313776 >> v2:172.21.15.129:3300/0 conn(0x7fa44c0d3030 0x7fa44c0d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.810+0000 7fa453200700 1 -- 172.21.15.82:0/1305313776 >> 172.21.15.82:0/1305313776 conn(0x7fa44c06c3f0 msgr2=0x7fa44c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.810+0000 7fa453200700 1 -- 172.21.15.82:0/1305313776 shutdown_connections 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.810+0000 7fa453200700 1 -- 172.21.15.82:0/1305313776 wait complete. 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.812+0000 7fa453200700 1 Processor -- start 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.812+0000 7fa453200700 1 -- start start 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa453200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa44c0b2f50 0x7fa44c0ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa453200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0d0630 0x7fa44c0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa453200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d3030 0x7fa44c0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa453200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0ab900 con 0x7fa44c0d0630 2024-05-10T04:51:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa453200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0cc790 con 0x7fa44c0b2f50 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa453200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c1f4b10 con 0x7fa44c0d3030 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa44b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0d0630 0x7fa44c0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa44b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0d0630 0x7fa44c0c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53766/0 (socket says 172.21.15.82:53766) 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa44b400700 1 -- 172.21.15.82:0/1651167515 learned_addr learned my addr 172.21.15.82:0/1651167515 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.814+0000 7fa44be00700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa44c0b2f50 0x7fa44c0ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa44b400700 1 -- 172.21.15.82:0/1651167515 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d3030 msgr2=0x7fa44c0c9fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa44b400700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d3030 0x7fa44c0c9fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa44b400700 1 -- 172.21.15.82:0/1651167515 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa44c0b2f50 msgr2=0x7fa44c0ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa44b400700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa44c0b2f50 0x7fa44c0ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa44b400700 1 -- 172.21.15.82:0/1651167515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009550 con 0x7fa44c0d0630 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa44b400700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0d0630 0x7fa44c0c9a60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa43800e810 tx=0x7fa43800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa443e00700 1 -- 172.21.15.82:0/1651167515 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43800c020 con 0x7fa44c0d0630 2024-05-10T04:51:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa443e00700 1 -- 172.21.15.82:0/1651167515 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa438004250 con 0x7fa44c0d0630 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa443e00700 1 -- 172.21.15.82:0/1651167515 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380036a0 con 0x7fa44c0d0630 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c0ab6b0 con 0x7fa44c0d0630 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.815+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c0cc0d0 con 0x7fa44c0d0630 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.816+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c074af0 con 0x7fa44c0d0630 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.817+0000 7fa443e00700 1 -- 172.21.15.82:0/1651167515 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa438003800 con 0x7fa44c0d0630 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.818+0000 7fa443e00700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa42c06ac90 0x7fa42c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.818+0000 7fa443e00700 1 -- 172.21.15.82:0/1651167515 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa438088db0 con 0x7fa44c0d0630 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.818+0000 7fa44be00700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa42c06ac90 0x7fa42c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.819+0000 7fa44be00700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa42c06ac90 0x7fa42c06d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0d0580 tx=0x7fa43c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:27.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:27.822+0000 7fa443e00700 1 -- 172.21.15.82:0/1651167515 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa43808d070 con 0x7fa44c0d0630 2024-05-10T04:51:28.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.107+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa44c0b34a0 con 0x7fa44c0d0630 2024-05-10T04:51:28.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.114+0000 7fa443e00700 1 -- 172.21.15.82:0/1651167515 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa438054240 con 0x7fa44c0d0630 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa42c06ac90 msgr2=0x7fa42c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa42c06ac90 0x7fa42c06d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0d0580 tx=0x7fa43c008030 comp rx=0 tx=0).stop 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0d0630 msgr2=0x7fa44c0c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0d0630 0x7fa44c0c9a60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa43800e810 tx=0x7fa43800eb20 comp rx=0 tx=0).stop 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 shutdown_connections 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa42c06ac90 0x7fa42c06d1a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa44c0d3030 0x7fa44c0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa44c0b2f50 0x7fa44c0ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 --2- 172.21.15.82:0/1651167515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa44c0d0630 0x7fa44c0c9a60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.116+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 >> 172.21.15.82:0/1651167515 conn(0x7fa44c06c3f0 msgr2=0x7fa44c0d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:28.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.117+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 shutdown_connections 2024-05-10T04:51:28.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.117+0000 7fa453200700 1 -- 172.21.15.82:0/1651167515 wait complete. 2024-05-10T04:51:28.145 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-10T04:51:28.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.406+0000 7fa247000700 1 Processor -- start 2024-05-10T04:51:28.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.406+0000 7fa247000700 1 -- start start 2024-05-10T04:51:28.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.408+0000 7fa247000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400b3090 0x7fa2400ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.408+0000 7fa247000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa2400d0990 0x7fa2400d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.408+0000 7fa247000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2400b5bb0 con 0x7fa240161d40 2024-05-10T04:51:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.408+0000 7fa247000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400cf6d0 con 0x7fa2400d0990 2024-05-10T04:51:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.408+0000 7fa247000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400d12e0 con 0x7fa2400b3090 2024-05-10T04:51:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa245200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400b3090 0x7fa2400ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa246600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa2400d0990 0x7fa2400d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa245c00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa240161d40 0x7fa2400b6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:59700/0 (socket says 172.21.15.82:59700) 2024-05-10T04:51:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa245c00700 1 -- 172.21.15.82:0/1440883982 learned_addr learned my addr 172.21.15.82:0/1440883982 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa245200700 1 -- 172.21.15.82:0/1440883982 >> v2:172.21.15.129:3300/0 conn(0x7fa2400d0990 msgr2=0x7fa2400d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa245200700 1 --2- 172.21.15.82:0/1440883982 >> v2:172.21.15.129:3300/0 conn(0x7fa2400d0990 0x7fa2400d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa245200700 1 -- 172.21.15.82:0/1440883982 >> v1:172.21.15.129:6789/0 conn(0x7fa240161d40 legacy=0x7fa2400b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa245200700 1 -- 172.21.15.82:0/1440883982 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400cf110 con 0x7fa2400b3090 2024-05-10T04:51:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.409+0000 7fa246600700 1 --2- 172.21.15.82:0/1440883982 >> v2:172.21.15.129:3300/0 conn(0x7fa2400d0990 0x7fa2400d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.410+0000 7fa245200700 1 --2- 172.21.15.82:0/1440883982 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400b3090 0x7fa2400ce7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009840 tx=0x7fa22c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffeb8a7c01f79623 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.410+0000 7fa23fe00700 1 -- 172.21.15.82:0/1440883982 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c011830 con 0x7fa2400b3090 2024-05-10T04:51:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.410+0000 7fa23fe00700 1 -- 172.21.15.82:0/1440883982 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c011990 con 0x7fa2400b3090 2024-05-10T04:51:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.410+0000 7fa23fe00700 1 -- 172.21.15.82:0/1440883982 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c011d20 con 0x7fa2400b3090 2024-05-10T04:51:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.411+0000 7fa247000700 1 -- 172.21.15.82:0/1440883982 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400b3090 msgr2=0x7fa2400ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.411+0000 7fa247000700 1 --2- 172.21.15.82:0/1440883982 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400b3090 0x7fa2400ce7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009840 tx=0x7fa22c009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.411+0000 7fa247000700 1 -- 172.21.15.82:0/1440883982 shutdown_connections 2024-05-10T04:51:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.411+0000 7fa247000700 1 --2- 172.21.15.82:0/1440883982 >> v2:172.21.15.129:3300/0 conn(0x7fa2400d0990 0x7fa2400d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.411+0000 7fa247000700 1 --2- 172.21.15.82:0/1440883982 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400b3090 0x7fa2400ce7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.411+0000 7fa247000700 1 -- 172.21.15.82:0/1440883982 >> 172.21.15.82:0/1440883982 conn(0x7fa24006c580 msgr2=0x7fa24006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.411+0000 7fa247000700 1 -- 172.21.15.82:0/1440883982 shutdown_connections 2024-05-10T04:51:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.411+0000 7fa247000700 1 -- 172.21.15.82:0/1440883982 wait complete. 2024-05-10T04:51:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.413+0000 7fa247000700 1 Processor -- start 2024-05-10T04:51:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.413+0000 7fa247000700 1 -- start start 2024-05-10T04:51:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa247000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2400b3090 0x7fa2401f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa247000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400d0990 0x7fa2401f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa247000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa240161d40 0x7fa240149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa247000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2401e9dd0 con 0x7fa240161d40 2024-05-10T04:51:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa247000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400cc760 con 0x7fa2400b3090 2024-05-10T04:51:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa247000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2401f4580 con 0x7fa2400d0990 2024-05-10T04:51:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa246600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa240161d40 0x7fa240149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa246600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa240161d40 0x7fa240149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53780/0 (socket says 172.21.15.82:53780) 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa246600700 1 -- 172.21.15.82:0/4050794001 learned_addr learned my addr 172.21.15.82:0/4050794001 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa245c00700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2400b3090 0x7fa2401f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.415+0000 7fa245200700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400d0990 0x7fa2401f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa246600700 1 -- 172.21.15.82:0/4050794001 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400d0990 msgr2=0x7fa2401f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa246600700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400d0990 0x7fa2401f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa246600700 1 -- 172.21.15.82:0/4050794001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2400b3090 msgr2=0x7fa2401f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa246600700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2400b3090 0x7fa2401f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa246600700 1 -- 172.21.15.82:0/4050794001 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa238009a70 con 0x7fa240161d40 2024-05-10T04:51:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa246600700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa240161d40 0x7fa240149730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa238009e00 tx=0x7fa23800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa23d600700 1 -- 172.21.15.82:0/4050794001 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800cc90 con 0x7fa240161d40 2024-05-10T04:51:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa23d600700 1 -- 172.21.15.82:0/4050794001 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23800f040 con 0x7fa240161d40 2024-05-10T04:51:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c0094a0 con 0x7fa240161d40 2024-05-10T04:51:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa23d600700 1 -- 172.21.15.82:0/4050794001 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238014480 con 0x7fa240161d40 2024-05-10T04:51:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.416+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2400ccc90 con 0x7fa240161d40 2024-05-10T04:51:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.417+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa240074af0 con 0x7fa240161d40 2024-05-10T04:51:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.418+0000 7fa23d600700 1 -- 172.21.15.82:0/4050794001 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2380145e0 con 0x7fa240161d40 2024-05-10T04:51:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.419+0000 7fa23d600700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa22006ac90 0x7fa22006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.419+0000 7fa23d600700 1 -- 172.21.15.82:0/4050794001 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa238089960 con 0x7fa240161d40 2024-05-10T04:51:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.420+0000 7fa245c00700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa22006ac90 0x7fa22006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.420+0000 7fa245c00700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa22006ac90 0x7fa22006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa234005910 tx=0x7fa234009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.424+0000 7fa23d600700 1 -- 172.21.15.82:0/4050794001 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa238054d60 con 0x7fa240161d40 2024-05-10T04:51:28.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.710+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa2400b6470 con 0x7fa240161d40 2024-05-10T04:51:28.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.716+0000 7fa23d600700 1 -- 172.21.15.82:0/4050794001 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa238018070 con 0x7fa240161d40 2024-05-10T04:51:28.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa22006ac90 msgr2=0x7fa22006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:28.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa22006ac90 0x7fa22006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa234005910 tx=0x7fa234009040 comp rx=0 tx=0).stop 2024-05-10T04:51:28.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa240161d40 msgr2=0x7fa240149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa240161d40 0x7fa240149730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa238009e00 tx=0x7fa23800c3a0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 shutdown_connections 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa22006ac90 0x7fa22006d1a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa240161d40 0x7fa240149730 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2400b3090 0x7fa2401f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 --2- 172.21.15.82:0/4050794001 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2400d0990 0x7fa2401f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.719+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 >> 172.21.15.82:0/4050794001 conn(0x7fa24006c580 msgr2=0x7fa24015f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.720+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 shutdown_connections 2024-05-10T04:51:28.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:28.720+0000 7fa247000700 1 -- 172.21.15.82:0/4050794001 wait complete. 2024-05-10T04:51:28.748 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:29.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.010+0000 7f79cd800700 1 Processor -- start 2024-05-10T04:51:29.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.010+0000 7f79cd800700 1 -- start start 2024-05-10T04:51:29.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79cd800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79c815bfe0 0x7f79c815f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79cd800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f79c8161fb0 0x7f79c81623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79cd800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c8162a70 con 0x7f79c80b5890 2024-05-10T04:51:29.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79cd800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c815c3f0 con 0x7f79c815bfe0 2024-05-10T04:51:29.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79cd800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c8162d50 con 0x7f79c8161fb0 2024-05-10T04:51:29.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79c6a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79c815bfe0 0x7f79c815f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79c6a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79c815bfe0 0x7f79c815f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53792/0 (socket says 172.21.15.82:53792) 2024-05-10T04:51:29.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79c6a00700 1 -- 172.21.15.82:0/1505934501 learned_addr learned my addr 172.21.15.82:0/1505934501 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:29.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.012+0000 7f79c6000700 1 --2- 172.21.15.82:0/1505934501 >> v2:172.21.15.129:3300/0 conn(0x7f79c8161fb0 0x7f79c81623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.013+0000 7f79c6a00700 1 -- 172.21.15.82:0/1505934501 >> v2:172.21.15.129:3300/0 conn(0x7f79c8161fb0 msgr2=0x7f79c81623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.013+0000 7f79c6a00700 1 --2- 172.21.15.82:0/1505934501 >> v2:172.21.15.129:3300/0 conn(0x7f79c8161fb0 0x7f79c81623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.013+0000 7f79c6a00700 1 -- 172.21.15.82:0/1505934501 >> v1:172.21.15.129:6789/0 conn(0x7f79c80b5890 legacy=0x7f79c80b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.013+0000 7f79c6a00700 1 -- 172.21.15.82:0/1505934501 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c815ecf0 con 0x7f79c815bfe0 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.013+0000 7f79c6a00700 1 --2- 172.21.15.82:0/1505934501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c815f4f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f79c80b66e0 tx=0x7f79b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91461864dd1913 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.013+0000 7f79c5600700 1 -- 172.21.15.82:0/1505934501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8004230 con 0x7f79c815bfe0 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.013+0000 7f79c5600700 1 -- 172.21.15.82:0/1505934501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b8004390 con 0x7f79c815bfe0 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.013+0000 7f79c5600700 1 -- 172.21.15.82:0/1505934501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80036a0 con 0x7f79c815bfe0 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.014+0000 7f79cd800700 1 -- 172.21.15.82:0/1505934501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 msgr2=0x7f79c815f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.014+0000 7f79cd800700 1 --2- 172.21.15.82:0/1505934501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c815f4f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f79c80b66e0 tx=0x7f79b8009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.014+0000 7f79cd800700 1 -- 172.21.15.82:0/1505934501 shutdown_connections 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.014+0000 7f79cd800700 1 --2- 172.21.15.82:0/1505934501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c815f4f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.014+0000 7f79cd800700 1 --2- 172.21.15.82:0/1505934501 >> v2:172.21.15.129:3300/0 conn(0x7f79c8161fb0 0x7f79c81623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.014+0000 7f79cd800700 1 -- 172.21.15.82:0/1505934501 >> 172.21.15.82:0/1505934501 conn(0x7f79c80d0a70 msgr2=0x7f79c80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:29.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.014+0000 7f79cd800700 1 -- 172.21.15.82:0/1505934501 shutdown_connections 2024-05-10T04:51:29.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.014+0000 7f79cd800700 1 -- 172.21.15.82:0/1505934501 wait complete. 2024-05-10T04:51:29.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.016+0000 7f79cd800700 1 Processor -- start 2024-05-10T04:51:29.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.016+0000 7f79cd800700 1 -- start start 2024-05-10T04:51:29.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79cd800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c80b5890 0x7f79c81ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79cd800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c80c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79cd800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f79c8161fb0 0x7f79c815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79cd800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c814cea0 con 0x7f79c815bfe0 2024-05-10T04:51:29.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79cd800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80c81d0 con 0x7f79c80b5890 2024-05-10T04:51:29.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79cd800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80c9030 con 0x7f79c8161fb0 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79c6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c80c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79c6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c80c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53802/0 (socket says 172.21.15.82:53802) 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79c6000700 1 -- 172.21.15.82:0/3314607371 learned_addr learned my addr 172.21.15.82:0/3314607371 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79c6a00700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c80b5890 0x7f79c81ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.018+0000 7f79c7400700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f79c8161fb0 0x7f79c815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79c6000700 1 -- 172.21.15.82:0/3314607371 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f79c8161fb0 msgr2=0x7f79c815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79c6000700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f79c8161fb0 0x7f79c815c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79c6000700 1 -- 172.21.15.82:0/3314607371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c80b5890 msgr2=0x7f79c81ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79c6000700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c80b5890 0x7f79c81ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79c6000700 1 -- 172.21.15.82:0/3314607371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8009550 con 0x7f79c815bfe0 2024-05-10T04:51:29.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79c6000700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c80c7920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79b400d800 tx=0x7f79b400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79bea00700 1 -- 172.21.15.82:0/3314607371 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40125f0 con 0x7f79c815bfe0 2024-05-10T04:51:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79bea00700 1 -- 172.21.15.82:0/3314607371 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b4012750 con 0x7f79c815bfe0 2024-05-10T04:51:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79bea00700 1 -- 172.21.15.82:0/3314607371 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4012b00 con 0x7f79c815bfe0 2024-05-10T04:51:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.019+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c80c8420 con 0x7f79c815bfe0 2024-05-10T04:51:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.020+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c80c89e0 con 0x7f79c815bfe0 2024-05-10T04:51:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.020+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c80c9310 con 0x7f79c815bfe0 2024-05-10T04:51:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.021+0000 7f79bea00700 1 -- 172.21.15.82:0/3314607371 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f79b4012c60 con 0x7f79c815bfe0 2024-05-10T04:51:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.022+0000 7f79bea00700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f79a806ac90 0x7f79a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.022+0000 7f79bea00700 1 -- 172.21.15.82:0/3314607371 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f79b4089020 con 0x7f79c815bfe0 2024-05-10T04:51:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.023+0000 7f79c6a00700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f79a806ac90 0x7f79a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.023+0000 7f79c6a00700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f79a806ac90 0x7f79a806d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009130 tx=0x7f79b8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.028+0000 7f79bea00700 1 -- 172.21.15.82:0/3314607371 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f79b40544c0 con 0x7f79c815bfe0 2024-05-10T04:51:29.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.233+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c80c9170 con 0x7f79c815bfe0 2024-05-10T04:51:29.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.234+0000 7f79bea00700 1 -- 172.21.15.82:0/3314607371 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12389 (secure 0 0 0) 0x7f79c80c9170 con 0x7f79c815bfe0 2024-05-10T04:51:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:29.236 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:51:24.509255+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.236+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f79a806ac90 msgr2=0x7f79a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.236+0000 7f79cd800700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f79a806ac90 0x7f79a806d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009130 tx=0x7f79b8008030 comp rx=0 tx=0).stop 2024-05-10T04:51:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.236+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 msgr2=0x7f79c80c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.236+0000 7f79cd800700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c80c7920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f79b400d800 tx=0x7f79b400db10 comp rx=0 tx=0).stop 2024-05-10T04:51:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.237+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 shutdown_connections 2024-05-10T04:51:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.237+0000 7f79cd800700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f79a806ac90 0x7f79a806d1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.237+0000 7f79cd800700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f79c8161fb0 0x7f79c815c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.237+0000 7f79cd800700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c80b5890 0x7f79c81ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.237+0000 7f79cd800700 1 --2- 172.21.15.82:0/3314607371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c815bfe0 0x7f79c80c7920 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.237+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 >> 172.21.15.82:0/3314607371 conn(0x7f79c80d0a70 msgr2=0x7f79c80c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.237+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 shutdown_connections 2024-05-10T04:51:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.237+0000 7f79cd800700 1 -- 172.21.15.82:0/3314607371 wait complete. 2024-05-10T04:51:29.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:51:29.266 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:51:29.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.529+0000 7feba7600700 1 Processor -- start 2024-05-10T04:51:29.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.529+0000 7feba7600700 1 -- start start 2024-05-10T04:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feba7600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7feba0162150 0x7feba015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feba7600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feba00cf4d0 0x7feba00b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feba7600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00d2c00 con 0x7feba00b7910 2024-05-10T04:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feba7600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba0162630 con 0x7feba00cf4d0 2024-05-10T04:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feba7600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba0162910 con 0x7feba0162150 2024-05-10T04:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feb9fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feba00cf4d0 0x7feba00b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feba5600700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feba00b7910 0x7feba006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38856/0 (socket says 172.21.15.82:38856) 2024-05-10T04:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feba5600700 1 -- 172.21.15.82:0/3765912742 learned_addr learned my addr 172.21.15.82:0/3765912742 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.531+0000 7feba4c00700 1 --2- 172.21.15.82:0/3765912742 >> v2:172.21.15.129:3300/0 conn(0x7feba0162150 0x7feba015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.532+0000 7feb9fe00700 1 -- 172.21.15.82:0/3765912742 >> v2:172.21.15.129:3300/0 conn(0x7feba0162150 msgr2=0x7feba015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.532+0000 7feb9fe00700 1 --2- 172.21.15.82:0/3765912742 >> v2:172.21.15.129:3300/0 conn(0x7feba0162150 0x7feba015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.532+0000 7feb9fe00700 1 -- 172.21.15.82:0/3765912742 >> v1:172.21.15.82:6789/0 conn(0x7feba00b7910 legacy=0x7feba006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.532+0000 7feb9fe00700 1 -- 172.21.15.82:0/3765912742 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0162bf0 con 0x7feba00cf4d0 2024-05-10T04:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.532+0000 7feb9fe00700 1 --2- 172.21.15.82:0/3765912742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba00cf4d0 0x7feba00b73d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009840 tx=0x7feb8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b2ebef36757fa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.532+0000 7feb9f400700 1 -- 172.21.15.82:0/3765912742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011830 con 0x7feba00cf4d0 2024-05-10T04:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.532+0000 7feb9f400700 1 -- 172.21.15.82:0/3765912742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c011990 con 0x7feba00cf4d0 2024-05-10T04:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.532+0000 7feb9f400700 1 -- 172.21.15.82:0/3765912742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c011d20 con 0x7feba00cf4d0 2024-05-10T04:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.533+0000 7feba7600700 1 -- 172.21.15.82:0/3765912742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba00cf4d0 msgr2=0x7feba00b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.533+0000 7feba7600700 1 --2- 172.21.15.82:0/3765912742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba00cf4d0 0x7feba00b73d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009840 tx=0x7feb8c009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.533+0000 7feba7600700 1 -- 172.21.15.82:0/3765912742 shutdown_connections 2024-05-10T04:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.533+0000 7feba7600700 1 --2- 172.21.15.82:0/3765912742 >> v2:172.21.15.129:3300/0 conn(0x7feba0162150 0x7feba015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.533+0000 7feba7600700 1 --2- 172.21.15.82:0/3765912742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba00cf4d0 0x7feba00b73d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.533+0000 7feba7600700 1 -- 172.21.15.82:0/3765912742 >> 172.21.15.82:0/3765912742 conn(0x7feba00d3e10 msgr2=0x7feba00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:29.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.533+0000 7feba7600700 1 -- 172.21.15.82:0/3765912742 shutdown_connections 2024-05-10T04:51:29.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.533+0000 7feba7600700 1 -- 172.21.15.82:0/3765912742 wait complete. 2024-05-10T04:51:29.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.535+0000 7feba7600700 1 Processor -- start 2024-05-10T04:51:29.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.535+0000 7feba7600700 1 -- start start 2024-05-10T04:51:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba7600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feba00b7910 0x7feba0157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba7600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feba00cf4d0 0x7feba015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba7600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba0162150 0x7feba01ea390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba7600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c8d20 con 0x7feba0162150 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba7600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01f8130 con 0x7feba00b7910 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba7600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba01f8370 con 0x7feba00cf4d0 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba5600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba0162150 0x7feba01ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba5600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba0162150 0x7feba01ea390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53814/0 (socket says 172.21.15.82:53814) 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba5600700 1 -- 172.21.15.82:0/3768554107 learned_addr learned my addr 172.21.15.82:0/3768554107 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba5600700 1 -- 172.21.15.82:0/3768554107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feba00cf4d0 msgr2=0x7feba015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba5600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feba00cf4d0 0x7feba015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba5600700 1 -- 172.21.15.82:0/3768554107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feba00b7910 msgr2=0x7feba0157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba5600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feba00b7910 0x7feba0157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.537+0000 7feba5600700 1 -- 172.21.15.82:0/3768554107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0094a0 con 0x7feba0162150 2024-05-10T04:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.538+0000 7feba5600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba0162150 0x7feba01ea390 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feb9800ca80 tx=0x7feb9800ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.538+0000 7feb9cc00700 1 -- 172.21.15.82:0/3768554107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800aaa0 con 0x7feba0162150 2024-05-10T04:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.538+0000 7feb9cc00700 1 -- 172.21.15.82:0/3768554107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800ac00 con 0x7feba0162150 2024-05-10T04:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.538+0000 7feb9cc00700 1 -- 172.21.15.82:0/3768554107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98012400 con 0x7feba0162150 2024-05-10T04:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.538+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00c7550 con 0x7feba0162150 2024-05-10T04:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.538+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba01f88a0 con 0x7feba0162150 2024-05-10T04:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.539+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba0074af0 con 0x7feba0162150 2024-05-10T04:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.540+0000 7feb9cc00700 1 -- 172.21.15.82:0/3768554107 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb9801b3b0 con 0x7feba0162150 2024-05-10T04:51:29.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.541+0000 7feb9cc00700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7feb8006ac90 0x7feb8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.541+0000 7feb9cc00700 1 -- 172.21.15.82:0/3768554107 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb98088cb0 con 0x7feba0162150 2024-05-10T04:51:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.541+0000 7feba4c00700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7feb8006ac90 0x7feb8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.542+0000 7feba4c00700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7feb8006ac90 0x7feb8006d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feba00d1920 tx=0x7feb94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.546+0000 7feb9cc00700 1 -- 172.21.15.82:0/3768554107 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feb98054160 con 0x7feba0162150 2024-05-10T04:51:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.751+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feba0161ec0 con 0x7feba0162150 2024-05-10T04:51:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.752+0000 7feb9cc00700 1 -- 172.21.15.82:0/3768554107 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb98017020 con 0x7feba0162150 2024-05-10T04:51:29.754 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:51:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.754+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7feb8006ac90 msgr2=0x7feb8006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.754+0000 7feba7600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7feb8006ac90 0x7feb8006d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feba00d1920 tx=0x7feb94008040 comp rx=0 tx=0).stop 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.754+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba0162150 msgr2=0x7feba01ea390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.754+0000 7feba7600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba0162150 0x7feba01ea390 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feb9800ca80 tx=0x7feb9800ce40 comp rx=0 tx=0).stop 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.755+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 shutdown_connections 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.755+0000 7feba7600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7feb8006ac90 0x7feb8006d1a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.755+0000 7feba7600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba0162150 0x7feba01ea390 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.755+0000 7feba7600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feba00b7910 0x7feba0157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.755+0000 7feba7600700 1 --2- 172.21.15.82:0/3768554107 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feba00cf4d0 0x7feba015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.755+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 >> 172.21.15.82:0/3768554107 conn(0x7feba00d3e10 msgr2=0x7feba0161590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.755+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 shutdown_connections 2024-05-10T04:51:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:29.755+0000 7feba7600700 1 -- 172.21.15.82:0/3768554107 wait complete. 2024-05-10T04:51:29.781 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T04:51:30.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.043+0000 7f9741c00700 1 Processor -- start 2024-05-10T04:51:30.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.043+0000 7f9741c00700 1 -- start start 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.044+0000 7f9741c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f973c162c30 0x7f973c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.045+0000 7f9741c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c1627a0 con 0x7f973c0b5ee0 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.045+0000 7f9741c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c15fa20 con 0x7f973c0d2e60 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.045+0000 7f9741c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c163040 con 0x7f973c162c30 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.045+0000 7f973a000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f973c0b5ee0 0x7f973c0d2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38872/0 (socket says 172.21.15.82:38872) 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.045+0000 7f973a000700 1 -- 172.21.15.82:0/911642203 learned_addr learned my addr 172.21.15.82:0/911642203 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.045+0000 7f973aa00700 1 --2- 172.21.15.82:0/911642203 >> v2:172.21.15.129:3300/0 conn(0x7f973c162c30 0x7f973c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.045+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458801981 0 0) 0x7f973c1627a0 con 0x7f973c0b5ee0 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.045+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97200035b0 con 0x7f973c0b5ee0 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1021664472 0 0) 0x7f97200035b0 con 0x7f973c0b5ee0 2024-05-10T04:51:30.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 >> v2:172.21.15.129:3300/0 conn(0x7f973c162c30 msgr2=0x7f973c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 --2- 172.21.15.82:0/911642203 >> v2:172.21.15.129:3300/0 conn(0x7f973c162c30 0x7f973c0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 >> v1:172.21.15.129:6789/0 conn(0x7f973c0d2e60 legacy=0x7f973c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0b62f0 con 0x7f973c0b5ee0 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f9728001670 con 0x7f973c0b5ee0 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 >> v1:172.21.15.82:6789/0 conn(0x7f973c0b5ee0 legacy=0x7f973c0d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9720003a00 0x7f9720003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720004850 0x7f9720004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9720005210 0x7f972000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972000c180 con 0x7f9720003a00 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972000c2f0 con 0x7f9720004850 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972000c4b0 con 0x7f9720005210 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f973aa00700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9720003a00 0x7f9720003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f973a000700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720004850 0x7f9720004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.046+0000 7f973b400700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9720005210 0x7f972000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f973aa00700 1 -- 172.21.15.82:0/911642203 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9720005210 msgr2=0x7f972000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f973aa00700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9720005210 0x7f972000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f973aa00700 1 -- 172.21.15.82:0/911642203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720004850 msgr2=0x7f9720004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f973aa00700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720004850 0x7f9720004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f973aa00700 1 -- 172.21.15.82:0/911642203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97200035b0 con 0x7f9720003a00 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f973b400700 1 -- 172.21.15.82:0/911642203 reap_dead start 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f973aa00700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9720003a00 0x7f9720003e70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f972c009b60 tx=0x7f9720005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a352b58a88f2a64 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00e6c0 con 0x7f9720003a00 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c00e820 con 0x7f9720003a00 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.047+0000 7f9739600700 1 -- 172.21.15.82:0/911642203 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00ebb0 con 0x7f9720003a00 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.048+0000 7f9741c00700 1 -- 172.21.15.82:0/911642203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9720003a00 msgr2=0x7f9720003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.048+0000 7f9741c00700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9720003a00 0x7f9720003e70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f972c009b60 tx=0x7f9720005880 comp rx=0 tx=0).stop 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.048+0000 7f9741c00700 1 -- 172.21.15.82:0/911642203 shutdown_connections 2024-05-10T04:51:30.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.048+0000 7f9741c00700 1 --2- 172.21.15.82:0/911642203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9720003a00 0x7f9720003e70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.048+0000 7f9741c00700 1 -- 172.21.15.82:0/911642203 >> 172.21.15.82:0/911642203 conn(0x7f973c0d0b80 msgr2=0x7f973c0d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:30.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.048+0000 7f9741c00700 1 -- 172.21.15.82:0/911642203 shutdown_connections 2024-05-10T04:51:30.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.048+0000 7f9741c00700 1 -- 172.21.15.82:0/911642203 wait complete. 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.050+0000 7f9741c00700 1 Processor -- start 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.051+0000 7f9741c00700 1 -- start start 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f9741c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720003a00 0x7f973c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f9741c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f973c0cea60 0x7f973c0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f9741c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973c1f4230 0x7f973c0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f9741c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0cee70 con 0x7f973c1f4230 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f9741c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1f4d60 con 0x7f9720003a00 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f9741c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0cb5d0 con 0x7f973c0cea60 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f973b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973c1f4230 0x7f973c0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f973b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973c1f4230 0x7f973c0cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53828/0 (socket says 172.21.15.82:53828) 2024-05-10T04:51:30.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.052+0000 7f973b400700 1 -- 172.21.15.82:0/553168009 learned_addr learned my addr 172.21.15.82:0/553168009 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973aa00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720003a00 0x7f973c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973a000700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f973c0cea60 0x7f973c0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973b400700 1 -- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f973c0cea60 msgr2=0x7f973c0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973b400700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f973c0cea60 0x7f973c0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973b400700 1 -- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720003a00 msgr2=0x7f973c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973b400700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720003a00 0x7f973c0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973b400700 1 -- 172.21.15.82:0/553168009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0ca020 con 0x7f973c1f4230 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973a000700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f973c0cea60 0x7f973c0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f973b400700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973c1f4230 0x7f973c0cc8c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f973c0caf50 tx=0x7f973400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f9732a00700 1 -- 172.21.15.82:0/553168009 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734003c10 con 0x7f973c1f4230 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f9732a00700 1 -- 172.21.15.82:0/553168009 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9734003d70 con 0x7f973c1f4230 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c0cb820 con 0x7f973c1f4230 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f9732a00700 1 -- 172.21.15.82:0/553168009 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734005310 con 0x7f973c1f4230 2024-05-10T04:51:30.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.053+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c0cbde0 con 0x7f973c1f4230 2024-05-10T04:51:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.054+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c0732b0 con 0x7f973c1f4230 2024-05-10T04:51:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.055+0000 7f9732a00700 1 -- 172.21.15.82:0/553168009 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9734005470 con 0x7f973c1f4230 2024-05-10T04:51:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.056+0000 7f9732a00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f971c06acc0 0x7f971c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.056+0000 7f9732a00700 1 -- 172.21.15.82:0/553168009 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f97340890a0 con 0x7f973c1f4230 2024-05-10T04:51:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.056+0000 7f973aa00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f971c06acc0 0x7f971c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.057+0000 7f973aa00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f971c06acc0 0x7f971c06d1d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f972c0090b0 tx=0x7f972c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:30.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.061+0000 7f9732a00700 1 -- 172.21.15.82:0/553168009 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9734054540 con 0x7f973c1f4230 2024-05-10T04:51:30.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.268+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f973c074af0 con 0x7f973c1f4230 2024-05-10T04:51:30.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.268+0000 7f9732a00700 1 -- 172.21.15.82:0/553168009 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9734057b60 con 0x7f973c1f4230 2024-05-10T04:51:30.270 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:30.270 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-05-10T04:51:30.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-10T04:51:30.270 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-05-10T04:51:30.270 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-05-10T04:51:30.270 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-10T04:51:30.270 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-05-10T04:51:30.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f971c06acc0 msgr2=0x7f971c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f971c06acc0 0x7f971c06d1d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f972c0090b0 tx=0x7f972c008030 comp rx=0 tx=0).stop 2024-05-10T04:51:30.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973c1f4230 msgr2=0x7f973c0cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973c1f4230 0x7f973c0cc8c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f973c0caf50 tx=0x7f973400ee80 comp rx=0 tx=0).stop 2024-05-10T04:51:30.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 shutdown_connections 2024-05-10T04:51:30.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f971c06acc0 0x7f971c06d1d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973c1f4230 0x7f973c0cc8c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9720003a00 0x7f973c0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 --2- 172.21.15.82:0/553168009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f973c0cea60 0x7f973c0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 >> 172.21.15.82:0/553168009 conn(0x7f973c0d0b80 msgr2=0x7f973c0d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 shutdown_connections 2024-05-10T04:51:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.271+0000 7f9741c00700 1 -- 172.21.15.82:0/553168009 wait complete. 2024-05-10T04:51:30.297 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T04:51:30.298 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T04:51:30.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.563+0000 7fe0a6400700 1 Processor -- start 2024-05-10T04:51:30.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.563+0000 7fe0a6400700 1 -- start start 2024-05-10T04:51:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.564+0000 7fe0a6400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe0a6400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a01626b0 con 0x7fe0a00cea50 2024-05-10T04:51:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe0a6400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a0162990 con 0x7fe0a00b5c10 2024-05-10T04:51:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe0a6400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00cada0 con 0x7fe0a015e5e0 2024-05-10T04:51:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe09ea00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe0a00cea50 0x7fe0a00b7340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38878/0 (socket says 172.21.15.82:38878) 2024-05-10T04:51:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe09ea00700 1 -- 172.21.15.82:0/420933056 learned_addr learned my addr 172.21.15.82:0/420933056 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe09f400700 1 --2- 172.21.15.82:0/420933056 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe09e000700 1 -- 172.21.15.82:0/420933056 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295467681 0 0) 0x7fe0a01626b0 con 0x7fe0a00cea50 2024-05-10T04:51:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe09e000700 1 -- 172.21.15.82:0/420933056 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0840035b0 con 0x7fe0a00cea50 2024-05-10T04:51:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe09e000700 1 -- 172.21.15.82:0/420933056 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84476951 0 0) 0x7fe0a0162990 con 0x7fe0a00b5c10 2024-05-10T04:51:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.565+0000 7fe09e000700 1 -- 172.21.15.82:0/420933056 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a01626b0 con 0x7fe0a00b5c10 2024-05-10T04:51:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.566+0000 7fe09f400700 1 -- 172.21.15.82:0/420933056 >> v1:172.21.15.129:6789/0 conn(0x7fe0a00b5c10 legacy=0x7fe0a00b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.566+0000 7fe09f400700 1 -- 172.21.15.82:0/420933056 >> v1:172.21.15.82:6789/0 conn(0x7fe0a00cea50 legacy=0x7fe0a00b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.566+0000 7fe09f400700 1 -- 172.21.15.82:0/420933056 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0162c70 con 0x7fe0a015e5e0 2024-05-10T04:51:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.566+0000 7fe09f400700 1 --2- 172.21.15.82:0/420933056 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0161f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe090009870 tx=0x7fe090009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9158d23bf743d9fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.566+0000 7fe09e000700 1 -- 172.21.15.82:0/420933056 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090011830 con 0x7fe0a015e5e0 2024-05-10T04:51:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.566+0000 7fe09e000700 1 -- 172.21.15.82:0/420933056 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090011990 con 0x7fe0a015e5e0 2024-05-10T04:51:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.566+0000 7fe09e000700 1 -- 172.21.15.82:0/420933056 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090011d20 con 0x7fe0a015e5e0 2024-05-10T04:51:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.567+0000 7fe0a6400700 1 -- 172.21.15.82:0/420933056 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 msgr2=0x7fe0a0161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.567+0000 7fe0a6400700 1 --2- 172.21.15.82:0/420933056 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0161f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe090009870 tx=0x7fe090009b80 comp rx=0 tx=0).stop 2024-05-10T04:51:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.567+0000 7fe0a6400700 1 -- 172.21.15.82:0/420933056 shutdown_connections 2024-05-10T04:51:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.567+0000 7fe0a6400700 1 --2- 172.21.15.82:0/420933056 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0161f60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.567+0000 7fe0a6400700 1 -- 172.21.15.82:0/420933056 >> 172.21.15.82:0/420933056 conn(0x7fe0a00d0cd0 msgr2=0x7fe0a00d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.567+0000 7fe0a6400700 1 -- 172.21.15.82:0/420933056 shutdown_connections 2024-05-10T04:51:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.567+0000 7fe0a6400700 1 -- 172.21.15.82:0/420933056 wait complete. 2024-05-10T04:51:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.569+0000 7fe0a6400700 1 Processor -- start 2024-05-10T04:51:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.570+0000 7fe0a6400700 1 -- start start 2024-05-10T04:51:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe0a6400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a00b5c10 0x7fe0a00cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe0a6400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0a00cea50 0x7fe0a014f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe0a6400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe0a6400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01515a0 con 0x7fe0a00b5c10 2024-05-10T04:51:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe0a6400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015c910 con 0x7fe0a00cea50 2024-05-10T04:51:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe0a6400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015bd00 con 0x7fe0a015e5e0 2024-05-10T04:51:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe09f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a00b5c10 0x7fe0a00cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe09f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a00b5c10 0x7fe0a00cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53840/0 (socket says 172.21.15.82:53840) 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe09f400700 1 -- 172.21.15.82:0/2292095490 learned_addr learned my addr 172.21.15.82:0/2292095490 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe09ea00700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0a00cea50 0x7fe0a014f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.571+0000 7fe09fe00700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe09f400700 1 -- 172.21.15.82:0/2292095490 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 msgr2=0x7fe0a0157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe09f400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe09f400700 1 -- 172.21.15.82:0/2292095490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0a00cea50 msgr2=0x7fe0a014f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe09f400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0a00cea50 0x7fe0a014f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe09f400700 1 -- 172.21.15.82:0/2292095490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900094a0 con 0x7fe0a00b5c10 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe09f400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a00b5c10 0x7fe0a00cc870 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe090009bc0 tx=0x7fe090004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe097400700 1 -- 172.21.15.82:0/2292095490 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09001a860 con 0x7fe0a00b5c10 2024-05-10T04:51:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe097400700 1 -- 172.21.15.82:0/2292095490 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09001a9c0 con 0x7fe0a00b5c10 2024-05-10T04:51:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe097400700 1 -- 172.21.15.82:0/2292095490 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09001ad50 con 0x7fe0a00b5c10 2024-05-10T04:51:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a00cd0c0 con 0x7fe0a00b5c10 2024-05-10T04:51:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.572+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a015c2c0 con 0x7fe0a00b5c10 2024-05-10T04:51:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.573+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a0074af0 con 0x7fe0a00b5c10 2024-05-10T04:51:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.574+0000 7fe097400700 1 -- 172.21.15.82:0/2292095490 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe090022070 con 0x7fe0a00b5c10 2024-05-10T04:51:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.575+0000 7fe097400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe08006ac90 0x7fe08006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.575+0000 7fe097400700 1 -- 172.21.15.82:0/2292095490 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe090089d40 con 0x7fe0a00b5c10 2024-05-10T04:51:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.575+0000 7fe09ea00700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe08006ac90 0x7fe08006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.576+0000 7fe09ea00700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe08006ac90 0x7fe08006d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00cdee0 tx=0x7fe08c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.580+0000 7fe097400700 1 -- 172.21.15.82:0/2292095490 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe090055260 con 0x7fe0a00b5c10 2024-05-10T04:51:30.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:30.784+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe0a00d2280 con 0x7fe0a00b5c10 2024-05-10T04:51:31.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.535+0000 7fe097400700 1 -- 172.21.15.82:0/2292095490 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe090058880 con 0x7fe0a00b5c10 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe08006ac90 msgr2=0x7fe08006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe08006ac90 0x7fe08006d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00cdee0 tx=0x7fe08c009040 comp rx=0 tx=0).stop 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a00b5c10 msgr2=0x7fe0a00cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a00b5c10 0x7fe0a00cc870 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe090009bc0 tx=0x7fe090004750 comp rx=0 tx=0).stop 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 shutdown_connections 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe08006ac90 0x7fe08006d1a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe0a015e5e0 0x7fe0a0157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a00b5c10 0x7fe0a00cc870 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 --2- 172.21.15.82:0/2292095490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe0a00cea50 0x7fe0a014f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 >> 172.21.15.82:0/2292095490 conn(0x7fe0a00d0cd0 msgr2=0x7fe0a00b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:31.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 shutdown_connections 2024-05-10T04:51:31.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.539+0000 7fe0a6400700 1 -- 172.21.15.82:0/2292095490 wait complete. 2024-05-10T04:51:31.542 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-05-10T04:51:31.573 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T04:51:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.841+0000 7f3019600700 1 Processor -- start 2024-05-10T04:51:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.841+0000 7f3019600700 1 -- start start 2024-05-10T04:51:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3019600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3014162150 0x7f301415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3019600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f301406c160 0x7f301406c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3019600700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30140d2c00 con 0x7f30140cf4d0 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3019600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301406cab0 con 0x7f3014162150 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3019600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3014162630 con 0x7f301406c160 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3012a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3014162150 0x7f301415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3012a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3014162150 0x7f301415e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53846/0 (socket says 172.21.15.82:53846) 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3012a00700 1 -- 172.21.15.82:0/2582518613 learned_addr learned my addr 172.21.15.82:0/2582518613 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.843+0000 7f3013400700 1 --2- 172.21.15.82:0/2582518613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f301406c160 0x7f301406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.844+0000 7f3012a00700 1 -- 172.21.15.82:0/2582518613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f301406c160 msgr2=0x7f301406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.844+0000 7f3012a00700 1 --2- 172.21.15.82:0/2582518613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f301406c160 0x7f301406c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.844+0000 7f3012a00700 1 -- 172.21.15.82:0/2582518613 >> v1:172.21.15.129:6789/0 conn(0x7f30140cf4d0 legacy=0x7f30140b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.844+0000 7f3012a00700 1 -- 172.21.15.82:0/2582518613 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3014162910 con 0x7f3014162150 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.844+0000 7f3012a00700 1 --2- 172.21.15.82:0/2582518613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3014162150 0x7f301415e610 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3004009920 tx=0x7f3004009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aaaac8f0bda0a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.844+0000 7f3011600700 1 -- 172.21.15.82:0/2582518613 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004011830 con 0x7f3014162150 2024-05-10T04:51:31.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.844+0000 7f3011600700 1 -- 172.21.15.82:0/2582518613 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3004011990 con 0x7f3014162150 2024-05-10T04:51:31.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.844+0000 7f3011600700 1 -- 172.21.15.82:0/2582518613 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004011d20 con 0x7f3014162150 2024-05-10T04:51:31.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.845+0000 7f3019600700 1 -- 172.21.15.82:0/2582518613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3014162150 msgr2=0x7f301415e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.845+0000 7f3019600700 1 --2- 172.21.15.82:0/2582518613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3014162150 0x7f301415e610 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3004009920 tx=0x7f3004009c30 comp rx=0 tx=0).stop 2024-05-10T04:51:31.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.845+0000 7f3019600700 1 -- 172.21.15.82:0/2582518613 shutdown_connections 2024-05-10T04:51:31.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.845+0000 7f3019600700 1 --2- 172.21.15.82:0/2582518613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3014162150 0x7f301415e610 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.845+0000 7f3019600700 1 --2- 172.21.15.82:0/2582518613 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f301406c160 0x7f301406c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.845+0000 7f3019600700 1 -- 172.21.15.82:0/2582518613 >> 172.21.15.82:0/2582518613 conn(0x7f30140d3e10 msgr2=0x7f30140d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:31.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.845+0000 7f3019600700 1 -- 172.21.15.82:0/2582518613 shutdown_connections 2024-05-10T04:51:31.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.845+0000 7f3019600700 1 -- 172.21.15.82:0/2582518613 wait complete. 2024-05-10T04:51:31.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.848+0000 7f3019600700 1 Processor -- start 2024-05-10T04:51:31.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.848+0000 7f3019600700 1 -- start start 2024-05-10T04:51:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3019600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f301406c160 0x7f3014152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3019600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f30140cf4d0 0x7f30141f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3019600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3014162150 0x7f301415d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3019600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30141f5790 con 0x7f301406c160 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3019600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30141f8a70 con 0x7f3014162150 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3019600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30141f59e0 con 0x7f30140cf4d0 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f301406c160 0x7f3014152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f301406c160 0x7f3014152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53860/0 (socket says 172.21.15.82:53860) 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012a00700 1 -- 172.21.15.82:0/2302233074 learned_addr learned my addr 172.21.15.82:0/2302233074 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012000700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f30140cf4d0 0x7f30141f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3013400700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3014162150 0x7f301415d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012a00700 1 -- 172.21.15.82:0/2302233074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f30140cf4d0 msgr2=0x7f30141f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012a00700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f30140cf4d0 0x7f30141f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012a00700 1 -- 172.21.15.82:0/2302233074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3014162150 msgr2=0x7f301415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012a00700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3014162150 0x7f301415d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.850+0000 7f3012a00700 1 -- 172.21.15.82:0/2302233074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3004009550 con 0x7f301406c160 2024-05-10T04:51:31.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.851+0000 7f3012a00700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f301406c160 0x7f3014152300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3004009c70 tx=0x7f3004004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:31.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.851+0000 7f300aa00700 1 -- 172.21.15.82:0/2302233074 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30040036a0 con 0x7f301406c160 2024-05-10T04:51:31.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.851+0000 7f300aa00700 1 -- 172.21.15.82:0/2302233074 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300401e070 con 0x7f301406c160 2024-05-10T04:51:31.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.851+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30141f8140 con 0x7f301406c160 2024-05-10T04:51:31.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.851+0000 7f300aa00700 1 -- 172.21.15.82:0/2302233074 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004003a20 con 0x7f301406c160 2024-05-10T04:51:31.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.851+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30141f8700 con 0x7f301406c160 2024-05-10T04:51:31.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.852+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3014074af0 con 0x7f301406c160 2024-05-10T04:51:31.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.853+0000 7f300aa00700 1 -- 172.21.15.82:0/2302233074 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3004003b80 con 0x7f301406c160 2024-05-10T04:51:31.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.854+0000 7f300aa00700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2ff406ac90 0x7f2ff406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.854+0000 7f300aa00700 1 -- 172.21.15.82:0/2302233074 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f300408a100 con 0x7f301406c160 2024-05-10T04:51:31.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.854+0000 7f3012000700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2ff406ac90 0x7f2ff406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.855+0000 7f3012000700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2ff406ac90 0x7f2ff406d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f30140cfa00 tx=0x7f3000009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:31.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:31.859+0000 7f300aa00700 1 -- 172.21.15.82:0/2302233074 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f30040554b0 con 0x7f301406c160 2024-05-10T04:51:32.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.060+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3014161ec0 con 0x7f301406c160 2024-05-10T04:51:32.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.542+0000 7f300aa00700 1 -- 172.21.15.82:0/2302233074 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3004058ad0 con 0x7f301406c160 2024-05-10T04:51:32.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.548+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2ff406ac90 msgr2=0x7f2ff406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.548+0000 7f3019600700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2ff406ac90 0x7f2ff406d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f30140cfa00 tx=0x7f3000009040 comp rx=0 tx=0).stop 2024-05-10T04:51:32.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.549+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f301406c160 msgr2=0x7f3014152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.549+0000 7f3019600700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f301406c160 0x7f3014152300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3004009c70 tx=0x7f3004004750 comp rx=0 tx=0).stop 2024-05-10T04:51:32.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.549+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 shutdown_connections 2024-05-10T04:51:32.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.549+0000 7f3019600700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2ff406ac90 0x7f2ff406d1a0 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f30140cfa00 tx=0x7f3000009040 comp rx=0 tx=0).stop 2024-05-10T04:51:32.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.549+0000 7f3019600700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3014162150 0x7f301415d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.549+0000 7f3019600700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f301406c160 0x7f3014152300 secure :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3004009c70 tx=0x7f3004004750 comp rx=0 tx=0).stop 2024-05-10T04:51:32.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.549+0000 7f3019600700 1 --2- 172.21.15.82:0/2302233074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f30140cf4d0 0x7f30141f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.549+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 >> 172.21.15.82:0/2302233074 conn(0x7f30140d3e10 msgr2=0x7f3014158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:32.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.550+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 shutdown_connections 2024-05-10T04:51:32.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.551+0000 7f3019600700 1 -- 172.21.15.82:0/2302233074 wait complete. 2024-05-10T04:51:32.558 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-05-10T04:51:32.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T04:51:32.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.856+0000 7f483be00700 1 Processor -- start 2024-05-10T04:51:32.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.857+0000 7f483be00700 1 -- start start 2024-05-10T04:51:32.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.858+0000 7f483be00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483415e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.858+0000 7f483be00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f483406c160 0x7f483406c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.858+0000 7f483be00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48340d2c00 con 0x7f48340cf4d0 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.858+0000 7f483be00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483406cab0 con 0x7f483406c160 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.858+0000 7f483be00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4834162630 con 0x7f4834162150 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4839e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f483406c160 0x7f483406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4838a00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f48340cf4d0 0x7f48340b73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38890/0 (socket says 172.21.15.82:38890) 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4838a00700 1 -- 172.21.15.82:0/2575715035 learned_addr learned my addr 172.21.15.82:0/2575715035 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4839400700 1 --2- 172.21.15.82:0/2575715035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4839e00700 1 -- 172.21.15.82:0/2575715035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 msgr2=0x7f483415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4839e00700 1 --2- 172.21.15.82:0/2575715035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4839e00700 1 -- 172.21.15.82:0/2575715035 >> v1:172.21.15.82:6789/0 conn(0x7f48340cf4d0 legacy=0x7f48340b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4839e00700 1 -- 172.21.15.82:0/2575715035 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834162910 con 0x7f483406c160 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4833e00700 1 -- 172.21.15.82:0/2575715035 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853858613 0 0) 0x7f48340d2c00 con 0x7f48340cf4d0 2024-05-10T04:51:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.859+0000 7f4839e00700 1 --2- 172.21.15.82:0/2575715035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f483406c160 0x7f483406c570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f482c009d90 tx=0x7f482c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f062f3be1f61f4a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f4833e00700 1 -- 172.21.15.82:0/2575715035 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00e070 con 0x7f483406c160 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f4833e00700 1 -- 172.21.15.82:0/2575715035 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c00bbd0 con 0x7f483406c160 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f4833e00700 1 -- 172.21.15.82:0/2575715035 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c012430 con 0x7f483406c160 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f483be00700 1 -- 172.21.15.82:0/2575715035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f483406c160 msgr2=0x7f483406c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f483be00700 1 --2- 172.21.15.82:0/2575715035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f483406c160 0x7f483406c570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f482c009d90 tx=0x7f482c00b330 comp rx=0 tx=0).stop 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f483be00700 1 -- 172.21.15.82:0/2575715035 shutdown_connections 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f483be00700 1 --2- 172.21.15.82:0/2575715035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f483406c160 0x7f483406c570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f483be00700 1 --2- 172.21.15.82:0/2575715035 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.860+0000 7f483be00700 1 -- 172.21.15.82:0/2575715035 >> 172.21.15.82:0/2575715035 conn(0x7f48340d3e10 msgr2=0x7f48340d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.861+0000 7f483be00700 1 -- 172.21.15.82:0/2575715035 shutdown_connections 2024-05-10T04:51:32.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.861+0000 7f483be00700 1 -- 172.21.15.82:0/2575715035 wait complete. 2024-05-10T04:51:32.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.864+0000 7f483be00700 1 Processor -- start 2024-05-10T04:51:32.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.864+0000 7f483be00700 1 -- start start 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f483be00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f483406c160 0x7f48340cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f483be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48340cf4d0 0x7f483414e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f483be00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483414ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f483be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48340b0490 con 0x7f48340cf4d0 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f483be00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48340ab840 con 0x7f483406c160 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f483be00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48340ad380 con 0x7f4834162150 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4838a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48340cf4d0 0x7f483414e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4838a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48340cf4d0 0x7f483414e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53874/0 (socket says 172.21.15.82:53874) 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4838a00700 1 -- 172.21.15.82:0/2894191780 learned_addr learned my addr 172.21.15.82:0/2894191780 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:32.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4839400700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f483406c160 0x7f48340cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4839e00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483414ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4838a00700 1 -- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 msgr2=0x7f483414ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4838a00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483414ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4838a00700 1 -- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f483406c160 msgr2=0x7f48340cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4838a00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f483406c160 0x7f48340cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4838a00700 1 -- 172.21.15.82:0/2894191780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c009a70 con 0x7f48340cf4d0 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.866+0000 7f4839e00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483414ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.867+0000 7f4838a00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48340cf4d0 0x7f483414e900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f482000c550 tx=0x7f482000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:32.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.867+0000 7f4831600700 1 -- 172.21.15.82:0/2894191780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820004c80 con 0x7f48340cf4d0 2024-05-10T04:51:32.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.867+0000 7f4831600700 1 -- 172.21.15.82:0/2894191780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4820004e00 con 0x7f48340cf4d0 2024-05-10T04:51:32.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.867+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48340ad110 con 0x7f48340cf4d0 2024-05-10T04:51:32.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.867+0000 7f4831600700 1 -- 172.21.15.82:0/2894191780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820007310 con 0x7f48340cf4d0 2024-05-10T04:51:32.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.867+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48340b1a40 con 0x7f48340cf4d0 2024-05-10T04:51:32.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.868+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4834074af0 con 0x7f48340cf4d0 2024-05-10T04:51:32.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.869+0000 7f4831600700 1 -- 172.21.15.82:0/2894191780 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4820007470 con 0x7f48340cf4d0 2024-05-10T04:51:32.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.870+0000 7f4831600700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f481406ac90 0x7f481406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.870+0000 7f4831600700 1 -- 172.21.15.82:0/2894191780 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4820089750 con 0x7f48340cf4d0 2024-05-10T04:51:32.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.870+0000 7f4839400700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f481406ac90 0x7f481406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.871+0000 7f4839400700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f481406ac90 0x7f481406d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48340d1920 tx=0x7f4828008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:32.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:32.874+0000 7f4831600700 1 -- 172.21.15.82:0/2894191780 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f48200548e0 con 0x7f48340cf4d0 2024-05-10T04:51:33.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.122+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f48340b3550 con 0x7f48340cf4d0 2024-05-10T04:51:33.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.131+0000 7f4831600700 1 -- 172.21.15.82:0/2894191780 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4820057f00 con 0x7f48340cf4d0 2024-05-10T04:51:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.135+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f481406ac90 msgr2=0x7f481406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.135+0000 7f483be00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f481406ac90 0x7f481406d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48340d1920 tx=0x7f4828008040 comp rx=0 tx=0).stop 2024-05-10T04:51:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.135+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48340cf4d0 msgr2=0x7f483414e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.135+0000 7f483be00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48340cf4d0 0x7f483414e900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f482000c550 tx=0x7f482000c910 comp rx=0 tx=0).stop 2024-05-10T04:51:33.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.138+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 shutdown_connections 2024-05-10T04:51:33.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.138+0000 7f483be00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f481406ac90 0x7f481406d1a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.138+0000 7f483be00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f4834162150 0x7f483414ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.138+0000 7f483be00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f483406c160 0x7f48340cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.138+0000 7f483be00700 1 --2- 172.21.15.82:0/2894191780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48340cf4d0 0x7f483414e900 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.138+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 >> 172.21.15.82:0/2894191780 conn(0x7f48340d3e10 msgr2=0x7f48340b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:33.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.138+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 shutdown_connections 2024-05-10T04:51:33.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.138+0000 7f483be00700 1 -- 172.21.15.82:0/2894191780 wait complete. 2024-05-10T04:51:33.142 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 4 and data pool 5 2024-05-10T04:51:33.184 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.446+0000 7fc177e00700 1 Processor -- start 2024-05-10T04:51:33.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.446+0000 7fc177e00700 1 -- start start 2024-05-10T04:51:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc177e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc17015e6e0 0x7fc17006c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc177e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1700b2b90 0x7fc17006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc177e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 0x7fc1700d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc177e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1700d34c0 con 0x7fc1700b2b90 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc177e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17006d340 con 0x7fc17015e6e0 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc177e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700d2b90 con 0x7fc1700b3050 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc174a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1700b2b90 0x7fc17006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc174a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1700b2b90 0x7fc17006c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53886/0 (socket says 172.21.15.82:53886) 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc174a00700 1 -- 172.21.15.82:0/2392626829 learned_addr learned my addr 172.21.15.82:0/2392626829 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc175e00700 1 --2- 172.21.15.82:0/2392626829 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 0x7fc1700d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.448+0000 7fc175400700 1 --2- 172.21.15.82:0/2392626829 >> v2:172.21.15.129:3300/0 conn(0x7fc17015e6e0 0x7fc17006c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc174a00700 1 -- 172.21.15.82:0/2392626829 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 msgr2=0x7fc1700d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc174a00700 1 --2- 172.21.15.82:0/2392626829 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 0x7fc1700d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc174a00700 1 -- 172.21.15.82:0/2392626829 >> v2:172.21.15.129:3300/0 conn(0x7fc17015e6e0 msgr2=0x7fc17006c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc174a00700 1 --2- 172.21.15.82:0/2392626829 >> v2:172.21.15.129:3300/0 conn(0x7fc17015e6e0 0x7fc17006c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc174a00700 1 -- 172.21.15.82:0/2392626829 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1700d2e70 con 0x7fc1700b2b90 2024-05-10T04:51:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc174a00700 1 --2- 172.21.15.82:0/2392626829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17006c730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc1700d1680 tx=0x7fc15c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425e13f6d36a336d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc16fe00700 1 -- 172.21.15.82:0/2392626829 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c011830 con 0x7fc1700b2b90 2024-05-10T04:51:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc16fe00700 1 -- 172.21.15.82:0/2392626829 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c011990 con 0x7fc1700b2b90 2024-05-10T04:51:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.449+0000 7fc16fe00700 1 -- 172.21.15.82:0/2392626829 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c011d20 con 0x7fc1700b2b90 2024-05-10T04:51:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 -- 172.21.15.82:0/2392626829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 msgr2=0x7fc17006c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 --2- 172.21.15.82:0/2392626829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17006c730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc1700d1680 tx=0x7fc15c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 -- 172.21.15.82:0/2392626829 shutdown_connections 2024-05-10T04:51:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 --2- 172.21.15.82:0/2392626829 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 0x7fc1700d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 --2- 172.21.15.82:0/2392626829 >> v2:172.21.15.129:3300/0 conn(0x7fc17015e6e0 0x7fc17006c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 --2- 172.21.15.82:0/2392626829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17006c730 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 -- 172.21.15.82:0/2392626829 >> 172.21.15.82:0/2392626829 conn(0x7fc1700b5db0 msgr2=0x7fc1700b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 -- 172.21.15.82:0/2392626829 shutdown_connections 2024-05-10T04:51:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.450+0000 7fc177e00700 1 -- 172.21.15.82:0/2392626829 wait complete. 2024-05-10T04:51:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.452+0000 7fc177e00700 1 Processor -- start 2024-05-10T04:51:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.452+0000 7fc177e00700 1 -- start start 2024-05-10T04:51:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc177e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc177e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 0x7fc170160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc177e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc17015e6e0 0x7fc17014c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc177e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1701f51c0 con 0x7fc1700b2b90 2024-05-10T04:51:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc177e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17015f060 con 0x7fc17015e6e0 2024-05-10T04:51:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc177e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17015f2b0 con 0x7fc1700b3050 2024-05-10T04:51:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc175400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc175400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53892/0 (socket says 172.21.15.82:53892) 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc175400700 1 -- 172.21.15.82:0/3257509872 learned_addr learned my addr 172.21.15.82:0/3257509872 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc174a00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 0x7fc170160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc175e00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc17015e6e0 0x7fc17014c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc175400700 1 -- 172.21.15.82:0/3257509872 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 msgr2=0x7fc170160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc175400700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 0x7fc170160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc175400700 1 -- 172.21.15.82:0/3257509872 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc17015e6e0 msgr2=0x7fc17014c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.454+0000 7fc175400700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc17015e6e0 0x7fc17014c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.455+0000 7fc175400700 1 -- 172.21.15.82:0/3257509872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c009550 con 0x7fc1700b2b90 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.455+0000 7fc175400700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17015eaf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc16400e870 tx=0x7fc16400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.455+0000 7fc16d600700 1 -- 172.21.15.82:0/3257509872 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164009590 con 0x7fc1700b2b90 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.455+0000 7fc16d600700 1 -- 172.21.15.82:0/3257509872 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16400ee70 con 0x7fc1700b2b90 2024-05-10T04:51:33.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.455+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17015f590 con 0x7fc1700b2b90 2024-05-10T04:51:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.455+0000 7fc16d600700 1 -- 172.21.15.82:0/3257509872 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16400ca50 con 0x7fc1700b2b90 2024-05-10T04:51:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.455+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17015fb50 con 0x7fc1700b2b90 2024-05-10T04:51:33.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.456+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1700732b0 con 0x7fc1700b2b90 2024-05-10T04:51:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.457+0000 7fc16d600700 1 -- 172.21.15.82:0/3257509872 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc16400cbb0 con 0x7fc1700b2b90 2024-05-10T04:51:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.458+0000 7fc16d600700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc15006ac90 0x7fc15006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.458+0000 7fc16d600700 1 -- 172.21.15.82:0/3257509872 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc164089460 con 0x7fc1700b2b90 2024-05-10T04:51:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.458+0000 7fc174a00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc15006ac90 0x7fc15006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.459+0000 7fc174a00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc15006ac90 0x7fc15006d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc15c014040 tx=0x7fc15c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.463+0000 7fc16d600700 1 -- 172.21.15.82:0/3257509872 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc164054510 con 0x7fc1700b2b90 2024-05-10T04:51:33.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.675+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc170074af0 con 0x7fc1700b2b90 2024-05-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.676+0000 7fc16d600700 1 -- 172.21.15.82:0/3257509872 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16114 (secure 0 0 0) 0x7fc16400ce60 con 0x7fc1700b2b90 2024-05-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":34,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:51:33.124081+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:30.829302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:32.104657+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc15006ac90 msgr2=0x7fc15006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc15006ac90 0x7fc15006d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc15c014040 tx=0x7fc15c008030 comp rx=0 tx=0).stop 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 msgr2=0x7fc17015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17015eaf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc16400e870 tx=0x7fc16400ec30 comp rx=0 tx=0).stop 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 shutdown_connections 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc15006ac90 0x7fc15006d1a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc17015e6e0 0x7fc17014c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1700b2b90 0x7fc17015eaf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 --2- 172.21.15.82:0/3257509872 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc1700b3050 0x7fc170160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 >> 172.21.15.82:0/3257509872 conn(0x7fc1700b5db0 msgr2=0x7fc1700b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 shutdown_connections 2024-05-10T04:51:33.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.679+0000 7fc177e00700 1 -- 172.21.15.82:0/3257509872 wait complete. 2024-05-10T04:51:33.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:33.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.966+0000 7fed8b200700 1 Processor -- start 2024-05-10T04:51:33.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.966+0000 7fed8b200700 1 -- start start 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed8b200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed8415f4f0 0x7fed840b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed8b200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fed840b5dd0 0x7fed840b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed8b200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8415f900 con 0x7fed8415bfe0 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed8b200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8415c3f0 con 0x7fed8415f4f0 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed8b200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed840b61e0 con 0x7fed840b5dd0 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed83400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed8415f4f0 0x7fed840b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed83400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed8415f4f0 0x7fed840b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53904/0 (socket says 172.21.15.82:53904) 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed83400700 1 -- 172.21.15.82:0/3243793059 learned_addr learned my addr 172.21.15.82:0/3243793059 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.968+0000 7fed89200700 1 --2- 172.21.15.82:0/3243793059 >> v2:172.21.15.129:3300/0 conn(0x7fed840b5dd0 0x7fed840b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.969+0000 7fed83400700 1 -- 172.21.15.82:0/3243793059 >> v2:172.21.15.129:3300/0 conn(0x7fed840b5dd0 msgr2=0x7fed840b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:33.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.969+0000 7fed83400700 1 --2- 172.21.15.82:0/3243793059 >> v2:172.21.15.129:3300/0 conn(0x7fed840b5dd0 0x7fed840b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.969+0000 7fed83400700 1 -- 172.21.15.82:0/3243793059 >> v1:172.21.15.129:6789/0 conn(0x7fed8415bfe0 legacy=0x7fed84161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.969+0000 7fed83400700 1 -- 172.21.15.82:0/3243793059 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84162a70 con 0x7fed8415f4f0 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.969+0000 7fed83400700 1 --2- 172.21.15.82:0/3243793059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840b5890 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fed840b6670 tx=0x7fed70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de7cdf8e369adf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.969+0000 7fed82a00700 1 -- 172.21.15.82:0/3243793059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011830 con 0x7fed8415f4f0 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.969+0000 7fed82a00700 1 -- 172.21.15.82:0/3243793059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70011990 con 0x7fed8415f4f0 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.969+0000 7fed82a00700 1 -- 172.21.15.82:0/3243793059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011d20 con 0x7fed8415f4f0 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.970+0000 7fed8b200700 1 -- 172.21.15.82:0/3243793059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 msgr2=0x7fed840b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.970+0000 7fed8b200700 1 --2- 172.21.15.82:0/3243793059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840b5890 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fed840b6670 tx=0x7fed70009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.970+0000 7fed8b200700 1 -- 172.21.15.82:0/3243793059 shutdown_connections 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.970+0000 7fed8b200700 1 --2- 172.21.15.82:0/3243793059 >> v2:172.21.15.129:3300/0 conn(0x7fed840b5dd0 0x7fed840b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.970+0000 7fed8b200700 1 --2- 172.21.15.82:0/3243793059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840b5890 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.970+0000 7fed8b200700 1 -- 172.21.15.82:0/3243793059 >> 172.21.15.82:0/3243793059 conn(0x7fed840d0a70 msgr2=0x7fed840d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.970+0000 7fed8b200700 1 -- 172.21.15.82:0/3243793059 shutdown_connections 2024-05-10T04:51:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.970+0000 7fed8b200700 1 -- 172.21.15.82:0/3243793059 wait complete. 2024-05-10T04:51:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.972+0000 7fed8b200700 1 Processor -- start 2024-05-10T04:51:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.972+0000 7fed8b200700 1 -- start start 2024-05-10T04:51:33.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed8b200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed840b5dd0 0x7fed8415a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed8b200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fed8415bfe0 0x7fed840c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed8b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed8b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8415aea0 con 0x7fed8415f4f0 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed8b200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed840c8330 con 0x7fed840b5dd0 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed8b200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed841e9110 con 0x7fed8415bfe0 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed89200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed89200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53906/0 (socket says 172.21.15.82:53906) 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed89200700 1 -- 172.21.15.82:0/360882232 learned_addr learned my addr 172.21.15.82:0/360882232 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed83e00700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed840b5dd0 0x7fed8415a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed83400700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fed8415bfe0 0x7fed840c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed89200700 1 -- 172.21.15.82:0/360882232 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fed8415bfe0 msgr2=0x7fed840c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.974+0000 7fed89200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fed8415bfe0 0x7fed840c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed89200700 1 -- 172.21.15.82:0/360882232 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed840b5dd0 msgr2=0x7fed8415a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed89200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed840b5dd0 0x7fed8415a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed89200700 1 -- 172.21.15.82:0/360882232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed70009550 con 0x7fed8415f4f0 2024-05-10T04:51:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed89200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840ca200 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00ef90 tx=0x7fed7c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed7be00700 1 -- 172.21.15.82:0/360882232 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c009b20 con 0x7fed8415f4f0 2024-05-10T04:51:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed7be00700 1 -- 172.21.15.82:0/360882232 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c00f040 con 0x7fed8415f4f0 2024-05-10T04:51:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed841f45f0 con 0x7fed8415f4f0 2024-05-10T04:51:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed7be00700 1 -- 172.21.15.82:0/360882232 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c00cc10 con 0x7fed8415f4f0 2024-05-10T04:51:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.975+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed840c8580 con 0x7fed8415f4f0 2024-05-10T04:51:33.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.976+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed84074af0 con 0x7fed8415f4f0 2024-05-10T04:51:33.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.977+0000 7fed7be00700 1 -- 172.21.15.82:0/360882232 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fed7c014480 con 0x7fed8415f4f0 2024-05-10T04:51:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.979+0000 7fed7be00700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fed6406acc0 0x7fed6406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.979+0000 7fed7be00700 1 -- 172.21.15.82:0/360882232 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed7c089d60 con 0x7fed8415f4f0 2024-05-10T04:51:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.979+0000 7fed83e00700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fed6406acc0 0x7fed6406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.980+0000 7fed83e00700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fed6406acc0 0x7fed6406d1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fed74007fd0 tx=0x7fed74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:33.983+0000 7fed7be00700 1 -- 172.21.15.82:0/360882232 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fed7c054ea0 con 0x7fed8415f4f0 2024-05-10T04:51:34.145 INFO:tasks.ceph.mds.c.smithi082.stderr:2024-05-10T04:51:34.144+0000 7f72fde00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:51:34.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.194+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed8415e370 con 0x7fed8415f4f0 2024-05-10T04:51:34.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.195+0000 7fed7be00700 1 -- 172.21.15.82:0/360882232 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16101 (secure 0 0 0) 0x7fed7c018020 con 0x7fed8415f4f0 2024-05-10T04:51:34.196 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:34.197 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":35,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:51:34.127363+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:30.829302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:32.104657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.197+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fed6406acc0 msgr2=0x7fed6406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.197+0000 7fed8b200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fed6406acc0 0x7fed6406d1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fed74007fd0 tx=0x7fed74009040 comp rx=0 tx=0).stop 2024-05-10T04:51:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.197+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 msgr2=0x7fed840ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.197+0000 7fed8b200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840ca200 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00ef90 tx=0x7fed7c009f60 comp rx=0 tx=0).stop 2024-05-10T04:51:34.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.198+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 shutdown_connections 2024-05-10T04:51:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.198+0000 7fed8b200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fed6406acc0 0x7fed6406d1d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.198+0000 7fed8b200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed8415f4f0 0x7fed840ca200 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.198+0000 7fed8b200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fed840b5dd0 0x7fed8415a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.198+0000 7fed8b200700 1 --2- 172.21.15.82:0/360882232 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fed8415bfe0 0x7fed840c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.198+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 >> 172.21.15.82:0/360882232 conn(0x7fed840d0a70 msgr2=0x7fed840d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.198+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 shutdown_connections 2024-05-10T04:51:34.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.198+0000 7fed8b200700 1 -- 172.21.15.82:0/360882232 wait complete. 2024-05-10T04:51:34.225 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T04:51:34.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.487+0000 7f511ee00700 1 Processor -- start 2024-05-10T04:51:34.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.487+0000 7f511ee00700 1 -- start start 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.489+0000 7f511ee00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f51180d0dc0 0x7f51180d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.489+0000 7f511ee00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51181638e0 con 0x7f51180d08b0 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.489+0000 7f511ee00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511806c5c0 con 0x7f51180d11d0 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.489+0000 7f511ee00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511806d9c0 con 0x7f51180d0dc0 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.489+0000 7f510fe00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f51180d08b0 0x7f5118162ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38892/0 (socket says 172.21.15.82:38892) 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.489+0000 7f510fe00700 1 -- 172.21.15.82:0/497032805 learned_addr learned my addr 172.21.15.82:0/497032805 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117e00700 1 --2- 172.21.15.82:0/497032805 >> v2:172.21.15.129:3300/0 conn(0x7f51180d0dc0 0x7f51180d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016840771 0 0) 0x7f51181638e0 con 0x7f51180d08b0 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50fc0035b0 con 0x7f51180d08b0 2024-05-10T04:51:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1333736226 0 0) 0x7f50fc0035b0 con 0x7f51180d08b0 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 >> v2:172.21.15.129:3300/0 conn(0x7f51180d0dc0 msgr2=0x7f51180d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 --2- 172.21.15.82:0/497032805 >> v2:172.21.15.129:3300/0 conn(0x7f51180d0dc0 0x7f51180d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 >> v1:172.21.15.129:6789/0 conn(0x7f51180d11d0 legacy=0x7f51181631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511806c0e0 con 0x7f51180d08b0 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f5100001670 con 0x7f51180d08b0 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 >> v1:172.21.15.82:6789/0 conn(0x7f51180d08b0 legacy=0x7f5118162ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50fc003a00 0x7f50fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc004850 0x7f50fc004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc005210 0x7f50fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc00c180 con 0x7f50fc003a00 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc00c2f0 con 0x7f50fc004850 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.490+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc00c4b0 con 0x7f50fc005210 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f5117e00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50fc003a00 0x7f50fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f510fe00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc004850 0x7f50fc004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f5117e00700 1 -- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc005210 msgr2=0x7f50fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f511ce00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc005210 0x7f50fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f5117e00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc005210 0x7f50fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f5117e00700 1 -- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc004850 msgr2=0x7f50fc004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f5117e00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f50fc004850 0x7f50fc004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f5117e00700 1 -- 172.21.15.82:0/497032805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0035b0 con 0x7f50fc003a00 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f511ce00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc005210 0x7f50fc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f511ce00700 1 -- 172.21.15.82:0/497032805 reap_dead start 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.491+0000 7f5117e00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50fc003a00 0x7f50fc003e70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5108009b10 tx=0x7f50fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3195da12048d98 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108009e80 con 0x7f50fc003a00 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5108005a20 con 0x7f50fc003a00 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f5117400700 1 -- 172.21.15.82:0/497032805 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108005d90 con 0x7f50fc003a00 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f511ee00700 1 -- 172.21.15.82:0/497032805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50fc003a00 msgr2=0x7f50fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f511ee00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50fc003a00 0x7f50fc003e70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5108009b10 tx=0x7f50fc005880 comp rx=0 tx=0).stop 2024-05-10T04:51:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f511ee00700 1 -- 172.21.15.82:0/497032805 shutdown_connections 2024-05-10T04:51:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f511ee00700 1 --2- 172.21.15.82:0/497032805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50fc003a00 0x7f50fc003e70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f511ee00700 1 -- 172.21.15.82:0/497032805 >> 172.21.15.82:0/497032805 conn(0x7f51180ce6a0 msgr2=0x7f51180ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f511ee00700 1 -- 172.21.15.82:0/497032805 shutdown_connections 2024-05-10T04:51:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.492+0000 7f511ee00700 1 -- 172.21.15.82:0/497032805 wait complete. 2024-05-10T04:51:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.495+0000 7f511ee00700 1 Processor -- start 2024-05-10T04:51:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.495+0000 7f511ee00700 1 -- start start 2024-05-10T04:51:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.496+0000 7f511ee00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc003a00 0x7f51181f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.496+0000 7f511ee00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51180c74a0 0x7f51180caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.496+0000 7f511ee00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51180c78b0 0x7f51180cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.496+0000 7f511ee00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511809b980 con 0x7f51180c78b0 2024-05-10T04:51:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.496+0000 7f511ee00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511809d6d0 con 0x7f51180c74a0 2024-05-10T04:51:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.496+0000 7f511ee00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51180c7dc0 con 0x7f50fc003a00 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51180c78b0 0x7f51180cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51180c78b0 0x7f51180cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53922/0 (socket says 172.21.15.82:53922) 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 -- 172.21.15.82:0/3166011236 learned_addr learned my addr 172.21.15.82:0/3166011236 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f5117e00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc003a00 0x7f51181f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f510fe00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51180c74a0 0x7f51180caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 -- 172.21.15.82:0/3166011236 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc003a00 msgr2=0x7f51181f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc003a00 0x7f51181f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 -- 172.21.15.82:0/3166011236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51180c74a0 msgr2=0x7f51180caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51180c74a0 0x7f51180caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 -- 172.21.15.82:0/3166011236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180c8010 con 0x7f51180c78b0 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.497+0000 7f511ce00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51180c78b0 0x7f51180cb3e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f511806b6f0 tx=0x7f511000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.498+0000 7f5114c00700 1 -- 172.21.15.82:0/3166011236 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110003e10 con 0x7f51180c78b0 2024-05-10T04:51:34.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.498+0000 7f5114c00700 1 -- 172.21.15.82:0/3166011236 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5110005070 con 0x7f51180c78b0 2024-05-10T04:51:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.498+0000 7f5114c00700 1 -- 172.21.15.82:0/3166011236 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110005420 con 0x7f51180c78b0 2024-05-10T04:51:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.498+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51180c82f0 con 0x7f51180c78b0 2024-05-10T04:51:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.498+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511809be70 con 0x7f51180c78b0 2024-05-10T04:51:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.499+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511809c030 con 0x7f51180c78b0 2024-05-10T04:51:34.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.500+0000 7f5114c00700 1 -- 172.21.15.82:0/3166011236 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5110005580 con 0x7f51180c78b0 2024-05-10T04:51:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.501+0000 7f5114c00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f50f406ac90 0x7f50f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.502+0000 7f5114c00700 1 -- 172.21.15.82:0/3166011236 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5110089020 con 0x7f51180c78b0 2024-05-10T04:51:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.502+0000 7f5117e00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f50f406ac90 0x7f50f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.502+0000 7f5117e00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f50f406ac90 0x7f50f406d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5108000c00 tx=0x7f510801d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.507+0000 7f5114c00700 1 -- 172.21.15.82:0/3166011236 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5110054200 con 0x7f51180c78b0 2024-05-10T04:51:34.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:34.759+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f51180b3510 con 0x7f51180c78b0 2024-05-10T04:51:35.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:51:35.535 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:51:35.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.562+0000 7f5114c00700 1 -- 172.21.15.82:0/3166011236 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f51100180b0 con 0x7f51180c78b0 2024-05-10T04:51:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f50f406ac90 msgr2=0x7f50f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f50f406ac90 0x7f50f406d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5108000c00 tx=0x7f510801d040 comp rx=0 tx=0).stop 2024-05-10T04:51:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51180c78b0 msgr2=0x7f51180cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51180c78b0 0x7f51180cb3e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f511806b6f0 tx=0x7f511000de70 comp rx=0 tx=0).stop 2024-05-10T04:51:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 shutdown_connections 2024-05-10T04:51:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f50f406ac90 0x7f50f406d1a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51180c78b0 0x7f51180cb3e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f50fc003a00 0x7f51181f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 --2- 172.21.15.82:0/3166011236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51180c74a0 0x7f51180caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 >> 172.21.15.82:0/3166011236 conn(0x7f51180ce6a0 msgr2=0x7f5118161fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:35.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.565+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 shutdown_connections 2024-05-10T04:51:35.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.566+0000 7f511ee00700 1 -- 172.21.15.82:0/3166011236 wait complete. 2024-05-10T04:51:35.599 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-10T04:51:35.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T04:51:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.945+0000 7fa2d2000700 1 Processor -- start 2024-05-10T04:51:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.945+0000 7fa2d2000700 1 -- start start 2024-05-10T04:51:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.947+0000 7fa2d2000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa2cc158c70 0x7fa2cc15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.947+0000 7fa2d2000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2cc0b5c90 0x7fa2cc0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.947+0000 7fa2d2000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2cc06c5f0 con 0x7fa2cc162000 2024-05-10T04:51:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.947+0000 7fa2d2000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc0b65e0 con 0x7fa2cc0b5c90 2024-05-10T04:51:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.947+0000 7fa2d2000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc06d190 con 0x7fa2cc158c70 2024-05-10T04:51:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.947+0000 7fa2cbe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2cc0b5c90 0x7fa2cc0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.948+0000 7fa2cbe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2cc0b5c90 0x7fa2cc0b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53934/0 (socket says 172.21.15.82:53934) 2024-05-10T04:51:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.948+0000 7fa2cbe00700 1 -- 172.21.15.82:0/933447110 learned_addr learned my addr 172.21.15.82:0/933447110 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.948+0000 7fa2cb400700 1 --2- 172.21.15.82:0/933447110 >> v2:172.21.15.129:3300/0 conn(0x7fa2cc158c70 0x7fa2cc15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.948+0000 7fa2cbe00700 1 -- 172.21.15.82:0/933447110 >> v2:172.21.15.129:3300/0 conn(0x7fa2cc158c70 msgr2=0x7fa2cc15ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.948+0000 7fa2cbe00700 1 --2- 172.21.15.82:0/933447110 >> v2:172.21.15.129:3300/0 conn(0x7fa2cc158c70 0x7fa2cc15ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.948+0000 7fa2cbe00700 1 -- 172.21.15.82:0/933447110 >> v1:172.21.15.129:6789/0 conn(0x7fa2cc162000 legacy=0x7fa2cc06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.948+0000 7fa2cbe00700 1 -- 172.21.15.82:0/933447110 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc162850 con 0x7fa2cc0b5c90 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.948+0000 7fa2cbe00700 1 --2- 172.21.15.82:0/933447110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc0b5c90 0x7fa2cc0b60a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc08cba0 tx=0x7fa2c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed4c561ca84a2cb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2caa00700 1 -- 172.21.15.82:0/933447110 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400e070 con 0x7fa2cc0b5c90 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2caa00700 1 -- 172.21.15.82:0/933447110 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c400b9c0 con 0x7fa2cc0b5c90 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2caa00700 1 -- 172.21.15.82:0/933447110 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400bd70 con 0x7fa2cc0b5c90 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2d2000700 1 -- 172.21.15.82:0/933447110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc0b5c90 msgr2=0x7fa2cc0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2d2000700 1 --2- 172.21.15.82:0/933447110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc0b5c90 0x7fa2cc0b60a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc08cba0 tx=0x7fa2c400b330 comp rx=0 tx=0).stop 2024-05-10T04:51:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2d2000700 1 -- 172.21.15.82:0/933447110 shutdown_connections 2024-05-10T04:51:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2d2000700 1 --2- 172.21.15.82:0/933447110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc0b5c90 0x7fa2cc0b60a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2d2000700 1 --2- 172.21.15.82:0/933447110 >> v2:172.21.15.129:3300/0 conn(0x7fa2cc158c70 0x7fa2cc15ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.949+0000 7fa2d2000700 1 -- 172.21.15.82:0/933447110 >> 172.21.15.82:0/933447110 conn(0x7fa2cc0d0d30 msgr2=0x7fa2cc0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.950+0000 7fa2d2000700 1 -- 172.21.15.82:0/933447110 shutdown_connections 2024-05-10T04:51:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.950+0000 7fa2d2000700 1 -- 172.21.15.82:0/933447110 wait complete. 2024-05-10T04:51:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.952+0000 7fa2d2000700 1 Processor -- start 2024-05-10T04:51:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.952+0000 7fa2d2000700 1 -- start start 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.953+0000 7fa2d2000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2cc0b5c90 0x7fa2cc0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.953+0000 7fa2d2000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2cc158c70 0x7fa2cc158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.953+0000 7fa2d2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc162000 0x7fa2cc1f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.953+0000 7fa2d2000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc158680 con 0x7fa2cc162000 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.953+0000 7fa2d2000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc0c9830 con 0x7fa2cc158c70 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.953+0000 7fa2d2000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc1f51d0 con 0x7fa2cc0b5c90 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc162000 0x7fa2cc1f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc162000 0x7fa2cc1f4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53946/0 (socket says 172.21.15.82:53946) 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 -- 172.21.15.82:0/2146493155 learned_addr learned my addr 172.21.15.82:0/2146493155 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:35.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cb400700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2cc0b5c90 0x7fa2cc0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2c3e00700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2cc158c70 0x7fa2cc158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 -- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2cc0b5c90 msgr2=0x7fa2cc0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2cc0b5c90 0x7fa2cc0c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 -- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2cc158c70 msgr2=0x7fa2cc158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2cc158c70 0x7fa2cc158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 -- 172.21.15.82:0/2146493155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c4009b30 con 0x7fa2cc162000 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cb400700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2cc0b5c90 0x7fa2cc0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2c3e00700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2cc158c70 0x7fa2cc158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2cbe00700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc162000 0x7fa2cc1f4a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400b730 tx=0x7fa2c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.954+0000 7fa2c3400700 1 -- 172.21.15.82:0/2146493155 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40099b0 con 0x7fa2cc162000 2024-05-10T04:51:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.955+0000 7fa2c3400700 1 -- 172.21.15.82:0/2146493155 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c40092e0 con 0x7fa2cc162000 2024-05-10T04:51:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.955+0000 7fa2c3400700 1 -- 172.21.15.82:0/2146493155 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c401b630 con 0x7fa2cc162000 2024-05-10T04:51:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.955+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc1f4f80 con 0x7fa2cc162000 2024-05-10T04:51:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.955+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc1f5420 con 0x7fa2cc162000 2024-05-10T04:51:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.956+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc0732b0 con 0x7fa2cc162000 2024-05-10T04:51:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.957+0000 7fa2c3400700 1 -- 172.21.15.82:0/2146493155 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2c401b790 con 0x7fa2cc162000 2024-05-10T04:51:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.958+0000 7fa2c3400700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2a806ac90 0x7fa2a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.958+0000 7fa2c3400700 1 -- 172.21.15.82:0/2146493155 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2c408a810 con 0x7fa2cc162000 2024-05-10T04:51:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.958+0000 7fa2cb400700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2a806ac90 0x7fa2a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.959+0000 7fa2cb400700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2a806ac90 0x7fa2a806d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0d2210 tx=0x7fa2bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:35.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:35.963+0000 7fa2c3400700 1 -- 172.21.15.82:0/2146493155 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa2c4055a90 con 0x7fa2cc162000 2024-05-10T04:51:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.210+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa2cc1f4f80 con 0x7fa2cc162000 2024-05-10T04:51:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.564+0000 7fa2c3400700 1 -- 172.21.15.82:0/2146493155 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa2cc1f4f80 con 0x7fa2cc162000 2024-05-10T04:51:36.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2a806ac90 msgr2=0x7fa2a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2a806ac90 0x7fa2a806d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0d2210 tx=0x7fa2bc008040 comp rx=0 tx=0).stop 2024-05-10T04:51:36.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc162000 msgr2=0x7fa2cc1f4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc162000 0x7fa2cc1f4a40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400b730 tx=0x7fa2c4004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 shutdown_connections 2024-05-10T04:51:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2a806ac90 0x7fa2a806d1a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2cc162000 0x7fa2cc1f4a40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa2cc0b5c90 0x7fa2cc0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 --2- 172.21.15.82:0/2146493155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa2cc158c70 0x7fa2cc158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 >> 172.21.15.82:0/2146493155 conn(0x7fa2cc0d0d30 msgr2=0x7fa2cc0b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 shutdown_connections 2024-05-10T04:51:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.567+0000 7fa2d2000700 1 -- 172.21.15.82:0/2146493155 wait complete. 2024-05-10T04:51:36.593 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T04:51:36.593 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.853+0000 7fd164e00700 1 Processor -- start 2024-05-10T04:51:36.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.853+0000 7fd164e00700 1 -- start start 2024-05-10T04:51:36.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.855+0000 7fd164e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1600b2ca0 0x7fd1600cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.855+0000 7fd164e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd16015df40 0x7fd1600d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.855+0000 7fd164e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1600d3500 con 0x7fd16015e350 2024-05-10T04:51:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.855+0000 7fd164e00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd160161e40 con 0x7fd16015df40 2024-05-10T04:51:36.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.855+0000 7fd164e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd160162120 con 0x7fd1600b2ca0 2024-05-10T04:51:36.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.856+0000 7fd157e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd16015df40 0x7fd1600d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.856+0000 7fd157e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd16015df40 0x7fd1600d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:52210/0 (socket says 172.21.15.82:52210) 2024-05-10T04:51:36.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.856+0000 7fd157e00700 1 -- 172.21.15.82:0/1057388223 learned_addr learned my addr 172.21.15.82:0/1057388223 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:36.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.856+0000 7fd15f400700 1 --2- 172.21.15.82:0/1057388223 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1600b2ca0 0x7fd1600cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.856+0000 7fd157e00700 1 -- 172.21.15.82:0/1057388223 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1600b2ca0 msgr2=0x7fd1600cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:36.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.856+0000 7fd157e00700 1 --2- 172.21.15.82:0/1057388223 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1600b2ca0 0x7fd1600cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.856+0000 7fd157e00700 1 -- 172.21.15.82:0/1057388223 >> v1:172.21.15.129:6789/0 conn(0x7fd16015e350 legacy=0x7fd1600b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.856+0000 7fd157e00700 1 -- 172.21.15.82:0/1057388223 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd160162400 con 0x7fd16015df40 2024-05-10T04:51:36.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.857+0000 7fd157e00700 1 --2- 172.21.15.82:0/1057388223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd16015df40 0x7fd1600d03b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1480098f0 tx=0x7fd148009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b92bc7916dc9efb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:36.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.857+0000 7fd15ea00700 1 -- 172.21.15.82:0/1057388223 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800b8a0 con 0x7fd16015df40 2024-05-10T04:51:36.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.857+0000 7fd15ea00700 1 -- 172.21.15.82:0/1057388223 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14800ba00 con 0x7fd16015df40 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.857+0000 7fd15ea00700 1 -- 172.21.15.82:0/1057388223 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800bd90 con 0x7fd16015df40 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.858+0000 7fd164e00700 1 -- 172.21.15.82:0/1057388223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd16015df40 msgr2=0x7fd1600d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.858+0000 7fd164e00700 1 --2- 172.21.15.82:0/1057388223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd16015df40 0x7fd1600d03b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1480098f0 tx=0x7fd148009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.858+0000 7fd164e00700 1 -- 172.21.15.82:0/1057388223 shutdown_connections 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.858+0000 7fd164e00700 1 --2- 172.21.15.82:0/1057388223 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1600b2ca0 0x7fd1600cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.858+0000 7fd164e00700 1 --2- 172.21.15.82:0/1057388223 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd16015df40 0x7fd1600d03b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.858+0000 7fd164e00700 1 -- 172.21.15.82:0/1057388223 >> 172.21.15.82:0/1057388223 conn(0x7fd160067600 msgr2=0x7fd16006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.858+0000 7fd164e00700 1 -- 172.21.15.82:0/1057388223 shutdown_connections 2024-05-10T04:51:36.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.858+0000 7fd164e00700 1 -- 172.21.15.82:0/1057388223 wait complete. 2024-05-10T04:51:36.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.860+0000 7fd164e00700 1 Processor -- start 2024-05-10T04:51:36.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.860+0000 7fd164e00700 1 -- start start 2024-05-10T04:51:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd164e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1600b2ca0 0x7fd1600ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd164e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd16015df40 0x7fd160156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd164e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd16015e350 0x7fd160156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd164e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd160157c70 con 0x7fd16015df40 2024-05-10T04:51:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd164e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1600c2bf0 con 0x7fd1600b2ca0 2024-05-10T04:51:36.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd164e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd160156da0 con 0x7fd16015e350 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd157e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd16015df40 0x7fd160156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd157e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd16015df40 0x7fd160156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53954/0 (socket says 172.21.15.82:53954) 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd157e00700 1 -- 172.21.15.82:0/840775742 learned_addr learned my addr 172.21.15.82:0/840775742 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd15f400700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1600b2ca0 0x7fd1600ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.862+0000 7fd15fe00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd16015e350 0x7fd160156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157e00700 1 -- 172.21.15.82:0/840775742 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd16015e350 msgr2=0x7fd160156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd16015e350 0x7fd160156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157e00700 1 -- 172.21.15.82:0/840775742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1600b2ca0 msgr2=0x7fd1600ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1600b2ca0 0x7fd1600ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157e00700 1 -- 172.21.15.82:0/840775742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd148009550 con 0x7fd16015df40 2024-05-10T04:51:36.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd16015df40 0x7fd160156250 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd148014040 tx=0x7fd148004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157400700 1 -- 172.21.15.82:0/840775742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148004510 con 0x7fd16015df40 2024-05-10T04:51:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157400700 1 -- 172.21.15.82:0/840775742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14801e070 con 0x7fd16015df40 2024-05-10T04:51:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd160156ff0 con 0x7fd16015df40 2024-05-10T04:51:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd157400700 1 -- 172.21.15.82:0/840775742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1480038e0 con 0x7fd16015df40 2024-05-10T04:51:36.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.863+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1601575b0 con 0x7fd16015df40 2024-05-10T04:51:36.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.865+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd160074af0 con 0x7fd16015df40 2024-05-10T04:51:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.865+0000 7fd157400700 1 -- 172.21.15.82:0/840775742 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd148003a40 con 0x7fd16015df40 2024-05-10T04:51:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.866+0000 7fd157400700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd13c06ac90 0x7fd13c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.866+0000 7fd157400700 1 -- 172.21.15.82:0/840775742 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd148020070 con 0x7fd16015df40 2024-05-10T04:51:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.866+0000 7fd15f400700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd13c06ac90 0x7fd13c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.867+0000 7fd15f400700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd13c06ac90 0x7fd13c06d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd150006b20 tx=0x7fd150008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:36.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:36.871+0000 7fd157400700 1 -- 172.21.15.82:0/840775742 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd148055940 con 0x7fd16015df40 2024-05-10T04:51:37.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.115+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1600ce5f0 con 0x7fd16015df40 2024-05-10T04:51:37.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.115+0000 7fd157400700 1 -- 172.21.15.82:0/840775742 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fd148058f60 con 0x7fd16015df40 2024-05-10T04:51:37.117 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:37.117 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:51:36.561071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6836/3440576054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3440576054},{"type":"v1","addr":"172.21.15.82:6836","nonce":3440576054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd13c06ac90 msgr2=0x7fd13c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd13c06ac90 0x7fd13c06d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd150006b20 tx=0x7fd150008040 comp rx=0 tx=0).stop 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd16015df40 msgr2=0x7fd160156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd16015df40 0x7fd160156250 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd148014040 tx=0x7fd148004750 comp rx=0 tx=0).stop 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 shutdown_connections 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd13c06ac90 0x7fd13c06d1a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd16015e350 0x7fd160156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1600b2ca0 0x7fd1600ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 --2- 172.21.15.82:0/840775742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd16015df40 0x7fd160156250 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 >> 172.21.15.82:0/840775742 conn(0x7fd160067600 msgr2=0x7fd160160370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:37.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 shutdown_connections 2024-05-10T04:51:37.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.118+0000 7fd164e00700 1 -- 172.21.15.82:0/840775742 wait complete. 2024-05-10T04:51:37.121 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-05-10T04:51:37.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:37.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.410+0000 7fdd91800700 1 Processor -- start 2024-05-10T04:51:38.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.410+0000 7fdd91800700 1 -- start start 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd91800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c0b2ca0 0x7fdd8c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd91800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd8c15df40 0x7fdd8c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd91800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0d3500 con 0x7fdd8c15e350 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd91800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c161e40 con 0x7fdd8c15df40 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd91800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c162120 con 0x7fdd8c0b2ca0 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd8b400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd8c15df40 0x7fdd8c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd8b400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd8c15df40 0x7fdd8c0d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53956/0 (socket says 172.21.15.82:53956) 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd90e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdd8c15e350 0x7fdd8c0b56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41938/0 (socket says 172.21.15.82:41938) 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd8b400700 1 -- 172.21.15.82:0/3116248627 learned_addr learned my addr 172.21.15.82:0/3116248627 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.412+0000 7fdd8be00700 1 --2- 172.21.15.82:0/3116248627 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c0b2ca0 0x7fdd8c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8b400700 1 -- 172.21.15.82:0/3116248627 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c0b2ca0 msgr2=0x7fdd8c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8b400700 1 --2- 172.21.15.82:0/3116248627 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c0b2ca0 0x7fdd8c0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8b400700 1 -- 172.21.15.82:0/3116248627 >> v1:172.21.15.82:6789/0 conn(0x7fdd8c15e350 legacy=0x7fdd8c0b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8b400700 1 -- 172.21.15.82:0/3116248627 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c162400 con 0x7fdd8c15df40 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8aa00700 1 -- 172.21.15.82:0/3116248627 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117824259 0 0) 0x7fdd8c0d3500 con 0x7fdd8c15e350 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8b400700 1 --2- 172.21.15.82:0/3116248627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15df40 0x7fdd8c0d03b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd780098f0 tx=0x7fdd78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18629f4f84081625 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8aa00700 1 -- 172.21.15.82:0/3116248627 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800b8a0 con 0x7fdd8c15df40 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8aa00700 1 -- 172.21.15.82:0/3116248627 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800ba00 con 0x7fdd8c15df40 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.413+0000 7fdd8aa00700 1 -- 172.21.15.82:0/3116248627 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800bd90 con 0x7fdd8c15df40 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.414+0000 7fdd91800700 1 -- 172.21.15.82:0/3116248627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15df40 msgr2=0x7fdd8c0d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.414+0000 7fdd91800700 1 --2- 172.21.15.82:0/3116248627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15df40 0x7fdd8c0d03b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd780098f0 tx=0x7fdd78009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:38.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.414+0000 7fdd91800700 1 -- 172.21.15.82:0/3116248627 shutdown_connections 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.414+0000 7fdd91800700 1 --2- 172.21.15.82:0/3116248627 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c0b2ca0 0x7fdd8c0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.414+0000 7fdd91800700 1 --2- 172.21.15.82:0/3116248627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15df40 0x7fdd8c0d03b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.414+0000 7fdd91800700 1 -- 172.21.15.82:0/3116248627 >> 172.21.15.82:0/3116248627 conn(0x7fdd8c067600 msgr2=0x7fdd8c06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.414+0000 7fdd91800700 1 -- 172.21.15.82:0/3116248627 shutdown_connections 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.414+0000 7fdd91800700 1 -- 172.21.15.82:0/3116248627 wait complete. 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.417+0000 7fdd91800700 1 Processor -- start 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.417+0000 7fdd91800700 1 -- start start 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd91800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c0b2ca0 0x7fdd8c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd91800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c15df40 0x7fdd8c14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd91800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15e350 0x7fdd8c149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd91800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c15b120 con 0x7fdd8c15e350 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd91800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c14e530 con 0x7fdd8c0b2ca0 2024-05-10T04:51:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd91800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c14a9e0 con 0x7fdd8c15df40 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd90e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15e350 0x7fdd8c149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd90e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15e350 0x7fdd8c149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53962/0 (socket says 172.21.15.82:53962) 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd90e00700 1 -- 172.21.15.82:0/1764681013 learned_addr learned my addr 172.21.15.82:0/1764681013 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd8b400700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c15df40 0x7fdd8c14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.419+0000 7fdd8be00700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c0b2ca0 0x7fdd8c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd90e00700 1 -- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c15df40 msgr2=0x7fdd8c14dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd90e00700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c15df40 0x7fdd8c14dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd90e00700 1 -- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c0b2ca0 msgr2=0x7fdd8c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd90e00700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c0b2ca0 0x7fdd8c15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd90e00700 1 -- 172.21.15.82:0/1764681013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78009550 con 0x7fdd8c15e350 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd8b400700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c15df40 0x7fdd8c14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd8be00700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c0b2ca0 0x7fdd8c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd90e00700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15e350 0x7fdd8c149ce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400cba0 tx=0x7fdd8400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd83e00700 1 -- 172.21.15.82:0/1764681013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400ab80 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd83e00700 1 -- 172.21.15.82:0/1764681013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400ad00 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c14b840 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd83e00700 1 -- 172.21.15.82:0/1764681013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84007310 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.420+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c14af10 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.421+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c074af0 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.423+0000 7fdd83e00700 1 -- 172.21.15.82:0/1764681013 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdd84007470 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.424+0000 7fdd83e00700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.424+0000 7fdd83e00700 1 -- 172.21.15.82:0/1764681013 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd840891a0 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.424+0000 7fdd8be00700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.424+0000 7fdd8be00700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c007a50 tx=0x7fdd7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.428+0000 7fdd83e00700 1 -- 172.21.15.82:0/1764681013 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdd840542e0 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.634+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd8c15c4a0 con 0x7fdd8c15e350 2024-05-10T04:51:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.635+0000 7fdd83e00700 1 -- 172.21.15.82:0/1764681013 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16101 (secure 0 0 0) 0x7fdd84057900 con 0x7fdd8c15e350 2024-05-10T04:51:38.345 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:38.345 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":35,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:51:34.127363+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:30.829302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:32.104657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:38.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 msgr2=0x7fdd6c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c007a50 tx=0x7fdd7c008040 comp rx=0 tx=0).stop 2024-05-10T04:51:38.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15e350 msgr2=0x7fdd8c149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15e350 0x7fdd8c149ce0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400cba0 tx=0x7fdd8400cf60 comp rx=0 tx=0).stop 2024-05-10T04:51:38.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 shutdown_connections 2024-05-10T04:51:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fdd6c06acc0 0x7fdd6c06d1d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd8c15e350 0x7fdd8c149ce0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdd8c0b2ca0 0x7fdd8c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 --2- 172.21.15.82:0/1764681013 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fdd8c15df40 0x7fdd8c14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 >> 172.21.15.82:0/1764681013 conn(0x7fdd8c067600 msgr2=0x7fdd8c15b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 shutdown_connections 2024-05-10T04:51:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:37.638+0000 7fdd91800700 1 -- 172.21.15.82:0/1764681013 wait complete. 2024-05-10T04:51:38.348 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-10T04:51:38.348 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:51:38.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.610+0000 7fecc2400700 1 Processor -- start 2024-05-10T04:51:38.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.610+0000 7fecc2400700 1 -- start start 2024-05-10T04:51:38.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.612+0000 7fecc2400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fecbc15df40 0x7fecbc0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.612+0000 7fecc2400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc161e40 con 0x7fecbc0b2ca0 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.612+0000 7fecc2400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc162120 con 0x7fecbc15e350 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.612+0000 7fecc2400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecbc162400 con 0x7fecbc15df40 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.612+0000 7fecc1000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fecbc0b2ca0 0x7fecbc0cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41954/0 (socket says 172.21.15.82:41954) 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.612+0000 7fecc1000700 1 -- 172.21.15.82:0/612810844 learned_addr learned my addr 172.21.15.82:0/612810844 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564546135 0 0) 0x7fecbc161e40 con 0x7fecbc0b2ca0 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca40035b0 con 0x7fecbc0b2ca0 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbbe00700 1 --2- 172.21.15.82:0/612810844 >> v2:172.21.15.129:3300/0 conn(0x7fecbc15df40 0x7fecbc0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2140300651 0 0) 0x7feca40035b0 con 0x7fecbc0b2ca0 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 >> v2:172.21.15.129:3300/0 conn(0x7fecbc15df40 msgr2=0x7fecbc0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 --2- 172.21.15.82:0/612810844 >> v2:172.21.15.129:3300/0 conn(0x7fecbc15df40 0x7fecbc0d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 >> v1:172.21.15.129:6789/0 conn(0x7fecbc15e350 legacy=0x7fecbc0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc1626e0 con 0x7fecbc0b2ca0 2024-05-10T04:51:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fecb0001670 con 0x7fecbc0b2ca0 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 >> v1:172.21.15.82:6789/0 conn(0x7fecbc0b2ca0 legacy=0x7fecbc0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.613+0000 7fecbb400700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7feca4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecbb400700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feca4004850 0x7feca4004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecbb400700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feca40053a0 0x7feca400ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc162400 con 0x7feca4003a50 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca400c330 con 0x7feca40053a0 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca400c4f0 con 0x7feca4004850 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecc1000700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7feca4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecbbe00700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feca4004850 0x7feca4004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecc1a00700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feca40053a0 0x7feca400ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecc1000700 1 -- 172.21.15.82:0/612810844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feca4004850 msgr2=0x7feca4004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecc1000700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7feca4004850 0x7feca4004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecc1000700 1 -- 172.21.15.82:0/612810844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feca40053a0 msgr2=0x7feca400ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecc1000700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feca40053a0 0x7feca400ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecc1a00700 1 -- 172.21.15.82:0/612810844 reap_dead start 2024-05-10T04:51:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.614+0000 7fecc1000700 1 -- 172.21.15.82:0/612810844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40035b0 con 0x7feca4003a50 2024-05-10T04:51:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.615+0000 7fecc1000700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7feca4003ec0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c160 tx=0x7feca4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1906ca61b93ba server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.615+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0007b70 con 0x7feca4003a50 2024-05-10T04:51:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.615+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb000cd20 con 0x7feca4003a50 2024-05-10T04:51:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.615+0000 7fecbb400700 1 -- 172.21.15.82:0/612810844 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0005ba0 con 0x7feca4003a50 2024-05-10T04:51:38.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.615+0000 7fecc2400700 1 -- 172.21.15.82:0/612810844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 msgr2=0x7feca4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.615+0000 7fecc2400700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7feca4003ec0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c160 tx=0x7feca4005880 comp rx=0 tx=0).stop 2024-05-10T04:51:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.616+0000 7fecc2400700 1 -- 172.21.15.82:0/612810844 shutdown_connections 2024-05-10T04:51:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.616+0000 7fecc2400700 1 --2- 172.21.15.82:0/612810844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7feca4003ec0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.616+0000 7fecc2400700 1 -- 172.21.15.82:0/612810844 >> 172.21.15.82:0/612810844 conn(0x7fecbc067600 msgr2=0x7fecbc06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.616+0000 7fecc2400700 1 -- 172.21.15.82:0/612810844 shutdown_connections 2024-05-10T04:51:38.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.616+0000 7fecc2400700 1 -- 172.21.15.82:0/612810844 wait complete. 2024-05-10T04:51:38.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.618+0000 7fecc2400700 1 Processor -- start 2024-05-10T04:51:38.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.618+0000 7fecc2400700 1 -- start start 2024-05-10T04:51:38.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc2400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7fecbc14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc2400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fecbc14d700 0x7fecbc0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc2400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecbc0cdd40 0x7fecbc0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc2400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc14f3f0 con 0x7feca4003a50 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc2400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0ce690 con 0x7fecbc0cdd40 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc2400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc150b50 con 0x7fecbc14d700 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7fecbc14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7fecbc14de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53990/0 (socket says 172.21.15.82:53990) 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1000700 1 -- 172.21.15.82:0/1008511854 learned_addr learned my addr 172.21.15.82:0/1008511854 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecbbe00700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fecbc14d700 0x7fecbc0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1a00700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecbc0cdd40 0x7fecbc0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1000700 1 -- 172.21.15.82:0/1008511854 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fecbc14d700 msgr2=0x7fecbc0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1000700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fecbc14d700 0x7fecbc0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1000700 1 -- 172.21.15.82:0/1008511854 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecbc0cdd40 msgr2=0x7fecbc0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1000700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecbc0cdd40 0x7fecbc0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.620+0000 7fecc1000700 1 -- 172.21.15.82:0/1008511854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc14e520 con 0x7feca4003a50 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.621+0000 7fecc1000700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7fecbc14de70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c750 tx=0x7fecb0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.621+0000 7fecb8c00700 1 -- 172.21.15.82:0/1008511854 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0001610 con 0x7feca4003a50 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.621+0000 7fecb8c00700 1 -- 172.21.15.82:0/1008511854 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0000f90 con 0x7feca4003a50 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.621+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc14e770 con 0x7feca4003a50 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.621+0000 7fecb8c00700 1 -- 172.21.15.82:0/1008511854 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0007310 con 0x7feca4003a50 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.621+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc14ed30 con 0x7feca4003a50 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.622+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc0d4a60 con 0x7feca4003a50 2024-05-10T04:51:38.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.623+0000 7fecb8c00700 1 -- 172.21.15.82:0/1008511854 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fecb0007470 con 0x7feca4003a50 2024-05-10T04:51:38.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.624+0000 7fecb8c00700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fec9c06ac90 0x7fec9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:38.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.624+0000 7fecb8c00700 1 -- 172.21.15.82:0/1008511854 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecb008a870 con 0x7feca4003a50 2024-05-10T04:51:38.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.624+0000 7fecbbe00700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fec9c06ac90 0x7fec9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:38.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.625+0000 7fecbbe00700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fec9c06ac90 0x7fec9c06d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feca8009160 tx=0x7feca8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:38.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.629+0000 7fecb8c00700 1 -- 172.21.15.82:0/1008511854 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fecb0055b60 con 0x7feca4003a50 2024-05-10T04:51:38.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.831+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecbc0cf150 con 0x7fec9c06ac90 2024-05-10T04:51:38.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.841+0000 7fecb8c00700 1 -- 172.21.15.82:0/1008511854 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289347 (secure 0 0 0) 0x7feca8014870 con 0x7fec9c06ac90 2024-05-10T04:51:38.847 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:38.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fec9c06ac90 msgr2=0x7fec9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fec9c06ac90 0x7fec9c06d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feca8009160 tx=0x7feca8008040 comp rx=0 tx=0).stop 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 msgr2=0x7fecbc14de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7fecbc14de70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c750 tx=0x7fecb0001930 comp rx=0 tx=0).stop 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 shutdown_connections 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fec9c06ac90 0x7fec9c06d1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fecbc0cdd40 0x7fecbc0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca4003a50 0x7fecbc14de70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 --2- 172.21.15.82:0/1008511854 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fecbc14d700 0x7fecbc0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 >> 172.21.15.82:0/1008511854 conn(0x7fecbc067600 msgr2=0x7fecbc0c6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 shutdown_connections 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:38.846+0000 7fecc2400700 1 -- 172.21.15.82:0/1008511854 wait complete. 2024-05-10T04:51:38.850 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:51:38.875 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-05-10T04:51:36.985807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220448,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754272,"statfs":{"total":773094113280,"available":772868374528,"internally_reserved":0,"allocated":4333568,"data_stored":2388884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.452600"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159921+0000","last_change":"2024-05-10T04:51:33.151427+0000","last_active":"2024-05-10T04:51:33.159921+0000","last_peered":"2024-05-10T04:51:33.159921+0000","last_clean":"2024-05-10T04:51:33.159921+0000","last_became_active":"2024-05-10T04:51:33.150956+0000","last_became_peered":"2024-05-10T04:51:33.150956+0000","last_unstale":"2024-05-10T04:51:33.159921+0000","last_undegraded":"2024-05-10T04:51:33.159921+0000","last_fullsized":"2024-05-10T04:51:33.159921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:38:48.192168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.173849+0000","last_change":"2024-05-10T04:51:33.169485+0000","last_active":"2024-05-10T04:51:33.173849+0000","last_peered":"2024-05-10T04:51:33.173849+0000","last_clean":"2024-05-10T04:51:33.173849+0000","last_became_active":"2024-05-10T04:51:33.162870+0000","last_became_peered":"2024-05-10T04:51:33.162870+0000","last_unstale":"2024-05-10T04:51:33.173849+0000","last_undegraded":"2024-05-10T04:51:33.173849+0000","last_fullsized":"2024-05-10T04:51:33.173849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:28.154722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168450+0000","last_change":"2024-05-10T04:51:33.166727+0000","last_active":"2024-05-10T04:51:33.168450+0000","last_peered":"2024-05-10T04:51:33.168450+0000","last_clean":"2024-05-10T04:51:33.168450+0000","last_became_active":"2024-05-10T04:51:33.166419+0000","last_became_peered":"2024-05-10T04:51:33.166419+0000","last_unstale":"2024-05-10T04:51:33.168450+0000","last_undegraded":"2024-05-10T04:51:33.168450+0000","last_fullsized":"2024-05-10T04:51:33.168450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:21:54.544038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167395+0000","last_change":"2024-05-10T04:51:33.161609+0000","last_active":"2024-05-10T04:51:33.167395+0000","last_peered":"2024-05-10T04:51:33.167395+0000","last_clean":"2024-05-10T04:51:33.167395+0000","last_became_active":"2024-05-10T04:51:33.161277+0000","last_became_peered":"2024-05-10T04:51:33.161277+0000","last_unstale":"2024-05-10T04:51:33.167395+0000","last_undegraded":"2024-05-10T04:51:33.167395+0000","last_fullsized":"2024-05-10T04:51:33.167395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:57.993718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.174125+0000","last_change":"2024-05-10T04:51:33.171166+0000","last_active":"2024-05-10T04:51:33.174125+0000","last_peered":"2024-05-10T04:51:33.174125+0000","last_clean":"2024-05-10T04:51:33.174125+0000","last_became_active":"2024-05-10T04:51:33.170908+0000","last_became_peered":"2024-05-10T04:51:33.170908+0000","last_unstale":"2024-05-10T04:51:33.174125+0000","last_undegraded":"2024-05-10T04:51:33.174125+0000","last_fullsized":"2024-05-10T04:51:33.174125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:27.441656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.169421+0000","last_change":"2024-05-10T04:51:33.152215+0000","last_active":"2024-05-10T04:51:33.169421+0000","last_peered":"2024-05-10T04:51:33.169421+0000","last_clean":"2024-05-10T04:51:33.169421+0000","last_became_active":"2024-05-10T04:51:33.150812+0000","last_became_peered":"2024-05-10T04:51:33.150812+0000","last_unstale":"2024-05-10T04:51:33.169421+0000","last_undegraded":"2024-05-10T04:51:33.169421+0000","last_fullsized":"2024-05-10T04:51:33.169421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:15.474173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.160170+0000","last_change":"2024-05-10T04:51:33.150885+0000","last_active":"2024-05-10T04:51:33.160170+0000","last_peered":"2024-05-10T04:51:33.160170+0000","last_clean":"2024-05-10T04:51:33.160170+0000","last_became_active":"2024-05-10T04:51:33.150512+0000","last_became_peered":"2024-05-10T04:51:33.150512+0000","last_unstale":"2024-05-10T04:51:33.160170+0000","last_undegraded":"2024-05-10T04:51:33.160170+0000","last_fullsized":"2024-05-10T04:51:33.160170+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:34:12.132883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.161599+0000","last_change":"2024-05-10T04:51:33.155024+0000","last_active":"2024-05-10T04:51:33.161599+0000","last_peered":"2024-05-10T04:51:33.161599+0000","last_clean":"2024-05-10T04:51:33.161599+0000","last_became_active":"2024-05-10T04:51:33.154803+0000","last_became_peered":"2024-05-10T04:51:33.154803+0000","last_unstale":"2024-05-10T04:51:33.161599+0000","last_undegraded":"2024-05-10T04:51:33.161599+0000","last_fullsized":"2024-05-10T04:51:33.161599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:21:54.544038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163112+0000","last_change":"2024-05-10T04:51:33.154908+0000","last_active":"2024-05-10T04:51:33.163112+0000","last_peered":"2024-05-10T04:51:33.163112+0000","last_clean":"2024-05-10T04:51:33.163112+0000","last_became_active":"2024-05-10T04:51:33.152109+0000","last_became_peered":"2024-05-10T04:51:33.152109+0000","last_unstale":"2024-05-10T04:51:33.163112+0000","last_undegraded":"2024-05-10T04:51:33.163112+0000","last_fullsized":"2024-05-10T04:51:33.163112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:13.620010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.151317+0000","last_change":"2024-05-10T04:51:33.148400+0000","last_active":"2024-05-10T04:51:33.151317+0000","last_peered":"2024-05-10T04:51:33.151317+0000","last_clean":"2024-05-10T04:51:33.151317+0000","last_became_active":"2024-05-10T04:51:33.147569+0000","last_became_peered":"2024-05-10T04:51:33.147569+0000","last_unstale":"2024-05-10T04:51:33.151317+0000","last_undegraded":"2024-05-10T04:51:33.151317+0000","last_fullsized":"2024-05-10T04:51:33.151317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:28.154722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158001+0000","last_change":"2024-05-10T04:51:33.148285+0000","last_active":"2024-05-10T04:51:33.158001+0000","last_peered":"2024-05-10T04:51:33.158001+0000","last_clean":"2024-05-10T04:51:33.158001+0000","last_became_active":"2024-05-10T04:51:33.147983+0000","last_became_peered":"2024-05-10T04:51:33.147983+0000","last_unstale":"2024-05-10T04:51:33.158001+0000","last_undegraded":"2024-05-10T04:51:33.158001+0000","last_fullsized":"2024-05-10T04:51:33.158001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:07.739150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.152806+0000","last_change":"2024-05-10T04:51:33.148467+0000","last_active":"2024-05-10T04:51:33.152806+0000","last_peered":"2024-05-10T04:51:33.152806+0000","last_clean":"2024-05-10T04:51:33.152806+0000","last_became_active":"2024-05-10T04:51:33.148153+0000","last_became_peered":"2024-05-10T04:51:33.148153+0000","last_unstale":"2024-05-10T04:51:33.152806+0000","last_undegraded":"2024-05-10T04:51:33.152806+0000","last_fullsized":"2024-05-10T04:51:33.152806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:07:02.361391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163707+0000","last_change":"2024-05-10T04:51:33.154990+0000","last_active":"2024-05-10T04:51:33.163707+0000","last_peered":"2024-05-10T04:51:33.163707+0000","last_clean":"2024-05-10T04:51:33.163707+0000","last_became_active":"2024-05-10T04:51:33.152725+0000","last_became_peered":"2024-05-10T04:51:33.152725+0000","last_unstale":"2024-05-10T04:51:33.163707+0000","last_undegraded":"2024-05-10T04:51:33.163707+0000","last_fullsized":"2024-05-10T04:51:33.163707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:13.620010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.169432+0000","last_change":"2024-05-10T04:51:33.153093+0000","last_active":"2024-05-10T04:51:33.169432+0000","last_peered":"2024-05-10T04:51:33.169432+0000","last_clean":"2024-05-10T04:51:33.169432+0000","last_became_active":"2024-05-10T04:51:33.152770+0000","last_became_peered":"2024-05-10T04:51:33.152770+0000","last_unstale":"2024-05-10T04:51:33.169432+0000","last_undegraded":"2024-05-10T04:51:33.169432+0000","last_fullsized":"2024-05-10T04:51:33.169432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:21:54.544038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166127+0000","last_change":"2024-05-10T04:51:33.155839+0000","last_active":"2024-05-10T04:51:33.166127+0000","last_peered":"2024-05-10T04:51:33.166127+0000","last_clean":"2024-05-10T04:51:33.166127+0000","last_became_active":"2024-05-10T04:51:33.155462+0000","last_became_peered":"2024-05-10T04:51:33.155462+0000","last_unstale":"2024-05-10T04:51:33.166127+0000","last_undegraded":"2024-05-10T04:51:33.166127+0000","last_fullsized":"2024-05-10T04:51:33.166127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:14.683857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.155582+0000","last_change":"2024-05-10T04:51:33.141405+0000","last_active":"2024-05-10T04:51:33.155582+0000","last_peered":"2024-05-10T04:51:33.155582+0000","last_clean":"2024-05-10T04:51:33.155582+0000","last_became_active":"2024-05-10T04:51:33.141068+0000","last_became_peered":"2024-05-10T04:51:33.141068+0000","last_unstale":"2024-05-10T04:51:33.155582+0000","last_undegraded":"2024-05-10T04:51:33.155582+0000","last_fullsized":"2024-05-10T04:51:33.155582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:14.683857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.157966+0000","last_change":"2024-05-10T04:51:33.146394+0000","last_active":"2024-05-10T04:51:33.157966+0000","last_peered":"2024-05-10T04:51:33.157966+0000","last_clean":"2024-05-10T04:51:33.157966+0000","last_became_active":"2024-05-10T04:51:33.146056+0000","last_became_peered":"2024-05-10T04:51:33.146056+0000","last_unstale":"2024-05-10T04:51:33.157966+0000","last_undegraded":"2024-05-10T04:51:33.157966+0000","last_fullsized":"2024-05-10T04:51:33.157966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:07:02.361391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.171581+0000","last_change":"2024-05-10T04:51:33.162475+0000","last_active":"2024-05-10T04:51:33.171581+0000","last_peered":"2024-05-10T04:51:33.171581+0000","last_clean":"2024-05-10T04:51:33.171581+0000","last_became_active":"2024-05-10T04:51:33.149752+0000","last_became_peered":"2024-05-10T04:51:33.149752+0000","last_unstale":"2024-05-10T04:51:33.171581+0000","last_undegraded":"2024-05-10T04:51:33.171581+0000","last_fullsized":"2024-05-10T04:51:33.171581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:34:01.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.169345+0000","last_change":"2024-05-10T04:51:33.152570+0000","last_active":"2024-05-10T04:51:33.169345+0000","last_peered":"2024-05-10T04:51:33.169345+0000","last_clean":"2024-05-10T04:51:33.169345+0000","last_became_active":"2024-05-10T04:51:33.150705+0000","last_became_peered":"2024-05-10T04:51:33.150705+0000","last_unstale":"2024-05-10T04:51:33.169345+0000","last_undegraded":"2024-05-10T04:51:33.169345+0000","last_fullsized":"2024-05-10T04:51:33.169345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:14.683857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167840+0000","last_change":"2024-05-10T04:51:33.158621+0000","last_active":"2024-05-10T04:51:33.167840+0000","last_peered":"2024-05-10T04:51:33.167840+0000","last_clean":"2024-05-10T04:51:33.167840+0000","last_became_active":"2024-05-10T04:51:33.158338+0000","last_became_peered":"2024-05-10T04:51:33.158338+0000","last_unstale":"2024-05-10T04:51:33.167840+0000","last_undegraded":"2024-05-10T04:51:33.167840+0000","last_fullsized":"2024-05-10T04:51:33.167840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:32:08.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163859+0000","last_change":"2024-05-10T04:51:33.158913+0000","last_active":"2024-05-10T04:51:33.163859+0000","last_peered":"2024-05-10T04:51:33.163859+0000","last_clean":"2024-05-10T04:51:33.163859+0000","last_became_active":"2024-05-10T04:51:33.158469+0000","last_became_peered":"2024-05-10T04:51:33.158469+0000","last_unstale":"2024-05-10T04:51:33.163859+0000","last_undegraded":"2024-05-10T04:51:33.163859+0000","last_fullsized":"2024-05-10T04:51:33.163859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:34.610114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163264+0000","last_change":"2024-05-10T04:51:33.155791+0000","last_active":"2024-05-10T04:51:33.163264+0000","last_peered":"2024-05-10T04:51:33.163264+0000","last_clean":"2024-05-10T04:51:33.163264+0000","last_became_active":"2024-05-10T04:51:33.144155+0000","last_became_peered":"2024-05-10T04:51:33.144155+0000","last_unstale":"2024-05-10T04:51:33.163264+0000","last_undegraded":"2024-05-10T04:51:33.163264+0000","last_fullsized":"2024-05-10T04:51:33.163264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:32:08.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167680+0000","last_change":"2024-05-10T04:51:33.161103+0000","last_active":"2024-05-10T04:51:33.167680+0000","last_peered":"2024-05-10T04:51:33.167680+0000","last_clean":"2024-05-10T04:51:33.167680+0000","last_became_active":"2024-05-10T04:51:33.160848+0000","last_became_peered":"2024-05-10T04:51:33.160848+0000","last_unstale":"2024-05-10T04:51:33.167680+0000","last_undegraded":"2024-05-10T04:51:33.167680+0000","last_fullsized":"2024-05-10T04:51:33.167680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:34.610114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166271+0000","last_change":"2024-05-10T04:51:33.157534+0000","last_active":"2024-05-10T04:51:33.166271+0000","last_peered":"2024-05-10T04:51:33.166271+0000","last_clean":"2024-05-10T04:51:33.166271+0000","last_became_active":"2024-05-10T04:51:33.156269+0000","last_became_peered":"2024-05-10T04:51:33.156269+0000","last_unstale":"2024-05-10T04:51:33.166271+0000","last_undegraded":"2024-05-10T04:51:33.166271+0000","last_fullsized":"2024-05-10T04:51:33.166271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:03:42.513724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167744+0000","last_change":"2024-05-10T04:51:33.162822+0000","last_active":"2024-05-10T04:51:33.167744+0000","last_peered":"2024-05-10T04:51:33.167744+0000","last_clean":"2024-05-10T04:51:33.167744+0000","last_became_active":"2024-05-10T04:51:33.162534+0000","last_became_peered":"2024-05-10T04:51:33.162534+0000","last_unstale":"2024-05-10T04:51:33.167744+0000","last_undegraded":"2024-05-10T04:51:33.167744+0000","last_fullsized":"2024-05-10T04:51:33.167744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:38:48.192168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.144597+0000","last_change":"2024-05-10T04:51:33.138367+0000","last_active":"2024-05-10T04:51:33.144597+0000","last_peered":"2024-05-10T04:51:33.144597+0000","last_clean":"2024-05-10T04:51:33.144597+0000","last_became_active":"2024-05-10T04:51:33.138088+0000","last_became_peered":"2024-05-10T04:51:33.138088+0000","last_unstale":"2024-05-10T04:51:33.144597+0000","last_undegraded":"2024-05-10T04:51:33.144597+0000","last_fullsized":"2024-05-10T04:51:33.144597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:38:43.707977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168411+0000","last_change":"2024-05-10T04:51:33.163203+0000","last_active":"2024-05-10T04:51:33.168411+0000","last_peered":"2024-05-10T04:51:33.168411+0000","last_clean":"2024-05-10T04:51:33.168411+0000","last_became_active":"2024-05-10T04:51:33.160180+0000","last_became_peered":"2024-05-10T04:51:33.160180+0000","last_unstale":"2024-05-10T04:51:33.168411+0000","last_undegraded":"2024-05-10T04:51:33.168411+0000","last_fullsized":"2024-05-10T04:51:33.168411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:22.784368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166942+0000","last_change":"2024-05-10T04:51:33.160848+0000","last_active":"2024-05-10T04:51:33.166942+0000","last_peered":"2024-05-10T04:51:33.166942+0000","last_clean":"2024-05-10T04:51:33.166942+0000","last_became_active":"2024-05-10T04:51:33.160588+0000","last_became_peered":"2024-05-10T04:51:33.160588+0000","last_unstale":"2024-05-10T04:51:33.166942+0000","last_undegraded":"2024-05-10T04:51:33.166942+0000","last_fullsized":"2024-05-10T04:51:33.166942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:47.329908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.154116+0000","last_change":"2024-05-10T04:51:33.146005+0000","last_active":"2024-05-10T04:51:33.154116+0000","last_peered":"2024-05-10T04:51:33.154116+0000","last_clean":"2024-05-10T04:51:33.154116+0000","last_became_active":"2024-05-10T04:51:33.145547+0000","last_became_peered":"2024-05-10T04:51:33.145547+0000","last_unstale":"2024-05-10T04:51:33.154116+0000","last_undegraded":"2024-05-10T04:51:33.154116+0000","last_fullsized":"2024-05-10T04:51:33.154116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:03.842436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158424+0000","last_change":"2024-05-10T04:51:33.144451+0000","last_active":"2024-05-10T04:51:33.158424+0000","last_peered":"2024-05-10T04:51:33.158424+0000","last_clean":"2024-05-10T04:51:33.158424+0000","last_became_active":"2024-05-10T04:51:33.144066+0000","last_became_peered":"2024-05-10T04:51:33.144066+0000","last_unstale":"2024-05-10T04:51:33.158424+0000","last_undegraded":"2024-05-10T04:51:33.158424+0000","last_fullsized":"2024-05-10T04:51:33.158424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:49.507207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162467+0000","last_change":"2024-05-10T04:51:33.157547+0000","last_active":"2024-05-10T04:51:33.162467+0000","last_peered":"2024-05-10T04:51:33.162467+0000","last_clean":"2024-05-10T04:51:33.162467+0000","last_became_active":"2024-05-10T04:51:33.156793+0000","last_became_peered":"2024-05-10T04:51:33.156793+0000","last_unstale":"2024-05-10T04:51:33.162467+0000","last_undegraded":"2024-05-10T04:51:33.162467+0000","last_fullsized":"2024-05-10T04:51:33.162467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:57.993718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158711+0000","last_change":"2024-05-10T04:51:33.144599+0000","last_active":"2024-05-10T04:51:33.158711+0000","last_peered":"2024-05-10T04:51:33.158711+0000","last_clean":"2024-05-10T04:51:33.158711+0000","last_became_active":"2024-05-10T04:51:33.144243+0000","last_became_peered":"2024-05-10T04:51:33.144243+0000","last_unstale":"2024-05-10T04:51:33.158711+0000","last_undegraded":"2024-05-10T04:51:33.158711+0000","last_fullsized":"2024-05-10T04:51:33.158711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:38:43.707977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167506+0000","last_change":"2024-05-10T04:51:33.163411+0000","last_active":"2024-05-10T04:51:33.167506+0000","last_peered":"2024-05-10T04:51:33.167506+0000","last_clean":"2024-05-10T04:51:33.167506+0000","last_became_active":"2024-05-10T04:51:33.161002+0000","last_became_peered":"2024-05-10T04:51:33.161002+0000","last_unstale":"2024-05-10T04:51:33.167506+0000","last_undegraded":"2024-05-10T04:51:33.167506+0000","last_fullsized":"2024-05-10T04:51:33.167506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:02.083025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167021+0000","last_change":"2024-05-10T04:51:32.571442+0000","last_active":"2024-05-10T04:51:33.167021+0000","last_peered":"2024-05-10T04:51:33.167021+0000","last_clean":"2024-05-10T04:51:33.167021+0000","last_became_active":"2024-05-10T04:51:32.571115+0000","last_became_peered":"2024-05-10T04:51:32.571115+0000","last_unstale":"2024-05-10T04:51:33.167021+0000","last_undegraded":"2024-05-10T04:51:33.167021+0000","last_fullsized":"2024-05-10T04:51:33.167021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:52.083841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159903+0000","last_change":"2024-05-10T04:51:33.149893+0000","last_active":"2024-05-10T04:51:33.159903+0000","last_peered":"2024-05-10T04:51:33.159903+0000","last_clean":"2024-05-10T04:51:33.159903+0000","last_became_active":"2024-05-10T04:51:33.146652+0000","last_became_peered":"2024-05-10T04:51:33.146652+0000","last_unstale":"2024-05-10T04:51:33.159903+0000","last_undegraded":"2024-05-10T04:51:33.159903+0000","last_fullsized":"2024-05-10T04:51:33.159903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:22.784368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.164546+0000","last_change":"2024-05-10T04:51:32.561378+0000","last_active":"2024-05-10T04:51:33.164546+0000","last_peered":"2024-05-10T04:51:33.164546+0000","last_clean":"2024-05-10T04:51:33.164546+0000","last_became_active":"2024-05-10T04:51:32.561105+0000","last_became_peered":"2024-05-10T04:51:32.561105+0000","last_unstale":"2024-05-10T04:51:33.164546+0000","last_undegraded":"2024-05-10T04:51:33.164546+0000","last_fullsized":"2024-05-10T04:51:33.164546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:19:50.178207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163747+0000","last_change":"2024-05-10T04:51:33.155425+0000","last_active":"2024-05-10T04:51:33.163747+0000","last_peered":"2024-05-10T04:51:33.163747+0000","last_clean":"2024-05-10T04:51:33.163747+0000","last_became_active":"2024-05-10T04:51:33.150118+0000","last_became_peered":"2024-05-10T04:51:33.150118+0000","last_unstale":"2024-05-10T04:51:33.163747+0000","last_undegraded":"2024-05-10T04:51:33.163747+0000","last_fullsized":"2024-05-10T04:51:33.163747+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:12.784029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.171763+0000","last_change":"2024-05-10T04:51:32.570170+0000","last_active":"2024-05-10T04:51:33.171763+0000","last_peered":"2024-05-10T04:51:33.171763+0000","last_clean":"2024-05-10T04:51:33.171763+0000","last_became_active":"2024-05-10T04:51:32.569866+0000","last_became_peered":"2024-05-10T04:51:32.569866+0000","last_unstale":"2024-05-10T04:51:33.171763+0000","last_undegraded":"2024-05-10T04:51:33.171763+0000","last_fullsized":"2024-05-10T04:51:33.171763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:12.611451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168459+0000","last_change":"2024-05-10T04:51:33.165989+0000","last_active":"2024-05-10T04:51:33.168459+0000","last_peered":"2024-05-10T04:51:33.168459+0000","last_clean":"2024-05-10T04:51:33.168459+0000","last_became_active":"2024-05-10T04:51:33.159406+0000","last_became_peered":"2024-05-10T04:51:33.159406+0000","last_unstale":"2024-05-10T04:51:33.168459+0000","last_undegraded":"2024-05-10T04:51:33.168459+0000","last_fullsized":"2024-05-10T04:51:33.168459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:47.329908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159153+0000","last_change":"2024-05-10T04:51:32.566262+0000","last_active":"2024-05-10T04:51:33.159153+0000","last_peered":"2024-05-10T04:51:33.159153+0000","last_clean":"2024-05-10T04:51:33.159153+0000","last_became_active":"2024-05-10T04:51:32.565767+0000","last_became_peered":"2024-05-10T04:51:32.565767+0000","last_unstale":"2024-05-10T04:51:33.159153+0000","last_undegraded":"2024-05-10T04:51:33.159153+0000","last_fullsized":"2024-05-10T04:51:33.159153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:33:19.494459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.161687+0000","last_change":"2024-05-10T04:51:33.158542+0000","last_active":"2024-05-10T04:51:33.161687+0000","last_peered":"2024-05-10T04:51:33.161687+0000","last_clean":"2024-05-10T04:51:33.161687+0000","last_became_active":"2024-05-10T04:51:33.158196+0000","last_became_peered":"2024-05-10T04:51:33.158196+0000","last_unstale":"2024-05-10T04:51:33.161687+0000","last_undegraded":"2024-05-10T04:51:33.161687+0000","last_fullsized":"2024-05-10T04:51:33.161687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:03:42.513724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.170112+0000","last_change":"2024-05-10T04:51:32.565265+0000","last_active":"2024-05-10T04:51:33.170112+0000","last_peered":"2024-05-10T04:51:33.170112+0000","last_clean":"2024-05-10T04:51:33.170112+0000","last_became_active":"2024-05-10T04:51:32.564964+0000","last_became_peered":"2024-05-10T04:51:32.564964+0000","last_unstale":"2024-05-10T04:51:33.170112+0000","last_undegraded":"2024-05-10T04:51:33.170112+0000","last_fullsized":"2024-05-10T04:51:33.170112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:53:39.259816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167013+0000","last_change":"2024-05-10T04:51:33.164318+0000","last_active":"2024-05-10T04:51:33.167013+0000","last_peered":"2024-05-10T04:51:33.167013+0000","last_clean":"2024-05-10T04:51:33.167013+0000","last_became_active":"2024-05-10T04:51:33.164015+0000","last_became_peered":"2024-05-10T04:51:33.164015+0000","last_unstale":"2024-05-10T04:51:33.167013+0000","last_undegraded":"2024-05-10T04:51:33.167013+0000","last_fullsized":"2024-05-10T04:51:33.167013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:22.784368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.170087+0000","last_change":"2024-05-10T04:51:32.566066+0000","last_active":"2024-05-10T04:51:33.170087+0000","last_peered":"2024-05-10T04:51:33.170087+0000","last_clean":"2024-05-10T04:51:33.170087+0000","last_became_active":"2024-05-10T04:51:32.565776+0000","last_became_peered":"2024-05-10T04:51:32.565776+0000","last_unstale":"2024-05-10T04:51:33.170087+0000","last_undegraded":"2024-05-10T04:51:33.170087+0000","last_fullsized":"2024-05-10T04:51:33.170087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:47.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.157859+0000","last_change":"2024-05-10T04:51:33.146922+0000","last_active":"2024-05-10T04:51:33.157859+0000","last_peered":"2024-05-10T04:51:33.157859+0000","last_clean":"2024-05-10T04:51:33.157859+0000","last_became_active":"2024-05-10T04:51:33.146482+0000","last_became_peered":"2024-05-10T04:51:33.146482+0000","last_unstale":"2024-05-10T04:51:33.157859+0000","last_undegraded":"2024-05-10T04:51:33.157859+0000","last_fullsized":"2024-05-10T04:51:33.157859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:53.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.129681+0000","last_change":"2024-05-10T04:51:32.555121+0000","last_active":"2024-05-10T04:51:33.129681+0000","last_peered":"2024-05-10T04:51:33.129681+0000","last_clean":"2024-05-10T04:51:33.129681+0000","last_became_active":"2024-05-10T04:51:32.554838+0000","last_became_peered":"2024-05-10T04:51:32.554838+0000","last_unstale":"2024-05-10T04:51:33.129681+0000","last_undegraded":"2024-05-10T04:51:33.129681+0000","last_fullsized":"2024-05-10T04:51:33.129681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:58:17.933313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167311+0000","last_change":"2024-05-10T04:51:33.161253+0000","last_active":"2024-05-10T04:51:33.167311+0000","last_peered":"2024-05-10T04:51:33.167311+0000","last_clean":"2024-05-10T04:51:33.167311+0000","last_became_active":"2024-05-10T04:51:33.160132+0000","last_became_peered":"2024-05-10T04:51:33.160132+0000","last_unstale":"2024-05-10T04:51:33.167311+0000","last_undegraded":"2024-05-10T04:51:33.167311+0000","last_fullsized":"2024-05-10T04:51:33.167311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:27:56.587168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.132604+0000","last_change":"2024-05-10T04:51:32.566522+0000","last_active":"2024-05-10T04:51:33.132604+0000","last_peered":"2024-05-10T04:51:33.132604+0000","last_clean":"2024-05-10T04:51:33.132604+0000","last_became_active":"2024-05-10T04:51:32.565421+0000","last_became_peered":"2024-05-10T04:51:32.565421+0000","last_unstale":"2024-05-10T04:51:33.132604+0000","last_undegraded":"2024-05-10T04:51:33.132604+0000","last_fullsized":"2024-05-10T04:51:33.132604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:34:37.876663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159549+0000","last_change":"2024-05-10T04:51:33.148694+0000","last_active":"2024-05-10T04:51:33.159549+0000","last_peered":"2024-05-10T04:51:33.159549+0000","last_clean":"2024-05-10T04:51:33.159549+0000","last_became_active":"2024-05-10T04:51:33.148379+0000","last_became_peered":"2024-05-10T04:51:33.148379+0000","last_unstale":"2024-05-10T04:51:33.159549+0000","last_undegraded":"2024-05-10T04:51:33.159549+0000","last_fullsized":"2024-05-10T04:51:33.159549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:15.474173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.130440+0000","last_change":"2024-05-10T04:51:32.562908+0000","last_active":"2024-05-10T04:51:33.130440+0000","last_peered":"2024-05-10T04:51:33.130440+0000","last_clean":"2024-05-10T04:51:33.130440+0000","last_became_active":"2024-05-10T04:51:32.562637+0000","last_became_peered":"2024-05-10T04:51:32.562637+0000","last_unstale":"2024-05-10T04:51:33.130440+0000","last_undegraded":"2024-05-10T04:51:33.130440+0000","last_fullsized":"2024-05-10T04:51:33.130440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:50:31.051444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.171623+0000","last_change":"2024-05-10T04:51:33.163093+0000","last_active":"2024-05-10T04:51:33.171623+0000","last_peered":"2024-05-10T04:51:33.171623+0000","last_clean":"2024-05-10T04:51:33.171623+0000","last_became_active":"2024-05-10T04:51:33.162795+0000","last_became_peered":"2024-05-10T04:51:33.162795+0000","last_unstale":"2024-05-10T04:51:33.171623+0000","last_undegraded":"2024-05-10T04:51:33.171623+0000","last_fullsized":"2024-05-10T04:51:33.171623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:07:02.361391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.150128+0000","last_change":"2024-05-10T04:51:32.558292+0000","last_active":"2024-05-10T04:51:33.150128+0000","last_peered":"2024-05-10T04:51:33.150128+0000","last_clean":"2024-05-10T04:51:33.150128+0000","last_became_active":"2024-05-10T04:51:32.556956+0000","last_became_peered":"2024-05-10T04:51:32.556956+0000","last_unstale":"2024-05-10T04:51:33.150128+0000","last_undegraded":"2024-05-10T04:51:33.150128+0000","last_fullsized":"2024-05-10T04:51:33.150128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:05.557807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.144658+0000","last_change":"2024-05-10T04:51:33.139868+0000","last_active":"2024-05-10T04:51:33.144658+0000","last_peered":"2024-05-10T04:51:33.144658+0000","last_clean":"2024-05-10T04:51:33.144658+0000","last_became_active":"2024-05-10T04:51:33.139604+0000","last_became_peered":"2024-05-10T04:51:33.139604+0000","last_unstale":"2024-05-10T04:51:33.144658+0000","last_undegraded":"2024-05-10T04:51:33.144658+0000","last_fullsized":"2024-05-10T04:51:33.144658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:03:42.513724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.165458+0000","last_change":"2024-05-10T04:51:32.564236+0000","last_active":"2024-05-10T04:51:33.165458+0000","last_peered":"2024-05-10T04:51:33.165458+0000","last_clean":"2024-05-10T04:51:33.165458+0000","last_became_active":"2024-05-10T04:51:32.563926+0000","last_became_peered":"2024-05-10T04:51:32.563926+0000","last_unstale":"2024-05-10T04:51:33.165458+0000","last_undegraded":"2024-05-10T04:51:33.165458+0000","last_fullsized":"2024-05-10T04:51:33.165458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:12.611451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168464+0000","last_change":"2024-05-10T04:51:33.166728+0000","last_active":"2024-05-10T04:51:33.168464+0000","last_peered":"2024-05-10T04:51:33.168464+0000","last_clean":"2024-05-10T04:51:33.168464+0000","last_became_active":"2024-05-10T04:51:33.166431+0000","last_became_peered":"2024-05-10T04:51:33.166431+0000","last_unstale":"2024-05-10T04:51:33.168464+0000","last_undegraded":"2024-05-10T04:51:33.168464+0000","last_fullsized":"2024-05-10T04:51:33.168464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:07.739150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.179724+0000","last_change":"2024-05-10T04:51:32.570057+0000","last_active":"2024-05-10T04:51:33.179724+0000","last_peered":"2024-05-10T04:51:33.179724+0000","last_clean":"2024-05-10T04:51:33.179724+0000","last_became_active":"2024-05-10T04:51:32.569773+0000","last_became_peered":"2024-05-10T04:51:32.569773+0000","last_unstale":"2024-05-10T04:51:33.179724+0000","last_undegraded":"2024-05-10T04:51:33.179724+0000","last_fullsized":"2024-05-10T04:51:33.179724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:52.083841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159940+0000","last_change":"2024-05-10T04:51:33.154519+0000","last_active":"2024-05-10T04:51:33.159940+0000","last_peered":"2024-05-10T04:51:33.159940+0000","last_clean":"2024-05-10T04:51:33.159940+0000","last_became_active":"2024-05-10T04:51:33.154245+0000","last_became_peered":"2024-05-10T04:51:33.154245+0000","last_unstale":"2024-05-10T04:51:33.159940+0000","last_undegraded":"2024-05-10T04:51:33.159940+0000","last_fullsized":"2024-05-10T04:51:33.159940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:21.431928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162737+0000","last_change":"2024-05-10T04:51:32.564552+0000","last_active":"2024-05-10T04:51:33.162737+0000","last_peered":"2024-05-10T04:51:33.162737+0000","last_clean":"2024-05-10T04:51:33.162737+0000","last_became_active":"2024-05-10T04:51:32.564264+0000","last_became_peered":"2024-05-10T04:51:32.564264+0000","last_unstale":"2024-05-10T04:51:33.162737+0000","last_undegraded":"2024-05-10T04:51:33.162737+0000","last_fullsized":"2024-05-10T04:51:33.162737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:54:36.895126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.171941+0000","last_change":"2024-05-10T04:51:33.164771+0000","last_active":"2024-05-10T04:51:33.171941+0000","last_peered":"2024-05-10T04:51:33.171941+0000","last_clean":"2024-05-10T04:51:33.171941+0000","last_became_active":"2024-05-10T04:51:33.164227+0000","last_became_peered":"2024-05-10T04:51:33.164227+0000","last_unstale":"2024-05-10T04:51:33.171941+0000","last_undegraded":"2024-05-10T04:51:33.171941+0000","last_fullsized":"2024-05-10T04:51:33.171941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:07.739150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.140885+0000","last_change":"2024-05-10T04:51:32.564537+0000","last_active":"2024-05-10T04:51:33.140885+0000","last_peered":"2024-05-10T04:51:33.140885+0000","last_clean":"2024-05-10T04:51:33.140885+0000","last_became_active":"2024-05-10T04:51:32.564177+0000","last_became_peered":"2024-05-10T04:51:32.564177+0000","last_unstale":"2024-05-10T04:51:33.140885+0000","last_undegraded":"2024-05-10T04:51:33.140885+0000","last_fullsized":"2024-05-10T04:51:33.140885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:50:31.051444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158732+0000","last_change":"2024-05-10T04:51:33.144840+0000","last_active":"2024-05-10T04:51:33.158732+0000","last_peered":"2024-05-10T04:51:33.158732+0000","last_clean":"2024-05-10T04:51:33.158732+0000","last_became_active":"2024-05-10T04:51:33.144524+0000","last_became_peered":"2024-05-10T04:51:33.144524+0000","last_unstale":"2024-05-10T04:51:33.158732+0000","last_undegraded":"2024-05-10T04:51:33.158732+0000","last_fullsized":"2024-05-10T04:51:33.158732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:15.474173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.129785+0000","last_change":"2024-05-10T04:51:32.562815+0000","last_active":"2024-05-10T04:51:33.129785+0000","last_peered":"2024-05-10T04:51:33.129785+0000","last_clean":"2024-05-10T04:51:33.129785+0000","last_became_active":"2024-05-10T04:51:32.562362+0000","last_became_peered":"2024-05-10T04:51:32.562362+0000","last_unstale":"2024-05-10T04:51:33.129785+0000","last_undegraded":"2024-05-10T04:51:33.129785+0000","last_fullsized":"2024-05-10T04:51:33.129785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:21.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.153814+0000","last_change":"2024-05-10T04:51:33.149475+0000","last_active":"2024-05-10T04:51:33.153814+0000","last_peered":"2024-05-10T04:51:33.153814+0000","last_clean":"2024-05-10T04:51:33.153814+0000","last_became_active":"2024-05-10T04:51:33.149124+0000","last_became_peered":"2024-05-10T04:51:33.149124+0000","last_unstale":"2024-05-10T04:51:33.153814+0000","last_undegraded":"2024-05-10T04:51:33.153814+0000","last_fullsized":"2024-05-10T04:51:33.153814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:47.329908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.180026+0000","last_change":"2024-05-10T04:51:32.570251+0000","last_active":"2024-05-10T04:51:33.180026+0000","last_peered":"2024-05-10T04:51:33.180026+0000","last_clean":"2024-05-10T04:51:33.180026+0000","last_became_active":"2024-05-10T04:51:32.569912+0000","last_became_peered":"2024-05-10T04:51:32.569912+0000","last_unstale":"2024-05-10T04:51:33.180026+0000","last_undegraded":"2024-05-10T04:51:33.180026+0000","last_fullsized":"2024-05-10T04:51:33.180026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:33.601555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163527+0000","last_change":"2024-05-10T04:51:33.156001+0000","last_active":"2024-05-10T04:51:33.163527+0000","last_peered":"2024-05-10T04:51:33.163527+0000","last_clean":"2024-05-10T04:51:33.163527+0000","last_became_active":"2024-05-10T04:51:33.154367+0000","last_became_peered":"2024-05-10T04:51:33.154367+0000","last_unstale":"2024-05-10T04:51:33.163527+0000","last_undegraded":"2024-05-10T04:51:33.163527+0000","last_fullsized":"2024-05-10T04:51:33.163527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:27.441656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.170132+0000","last_change":"2024-05-10T04:51:32.566132+0000","last_active":"2024-05-10T04:51:33.170132+0000","last_peered":"2024-05-10T04:51:33.170132+0000","last_clean":"2024-05-10T04:51:33.170132+0000","last_became_active":"2024-05-10T04:51:32.565832+0000","last_became_peered":"2024-05-10T04:51:32.565832+0000","last_unstale":"2024-05-10T04:51:33.170132+0000","last_undegraded":"2024-05-10T04:51:33.170132+0000","last_fullsized":"2024-05-10T04:51:33.170132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:20:18.461147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166929+0000","last_change":"2024-05-10T04:51:33.161025+0000","last_active":"2024-05-10T04:51:33.166929+0000","last_peered":"2024-05-10T04:51:33.166929+0000","last_clean":"2024-05-10T04:51:33.166929+0000","last_became_active":"2024-05-10T04:51:33.159994+0000","last_became_peered":"2024-05-10T04:51:33.159994+0000","last_unstale":"2024-05-10T04:51:33.166929+0000","last_undegraded":"2024-05-10T04:51:33.166929+0000","last_fullsized":"2024-05-10T04:51:33.166929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:34:01.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162917+0000","last_change":"2024-05-10T04:51:32.566726+0000","last_active":"2024-05-10T04:51:33.162917+0000","last_peered":"2024-05-10T04:51:33.162917+0000","last_clean":"2024-05-10T04:51:33.162917+0000","last_became_active":"2024-05-10T04:51:32.566404+0000","last_became_peered":"2024-05-10T04:51:32.566404+0000","last_unstale":"2024-05-10T04:51:33.162917+0000","last_undegraded":"2024-05-10T04:51:33.162917+0000","last_fullsized":"2024-05-10T04:51:33.162917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:19:50.178207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167270+0000","last_change":"2024-05-10T04:51:33.160950+0000","last_active":"2024-05-10T04:51:33.167270+0000","last_peered":"2024-05-10T04:51:33.167270+0000","last_clean":"2024-05-10T04:51:33.167270+0000","last_became_active":"2024-05-10T04:51:33.160785+0000","last_became_peered":"2024-05-10T04:51:33.160785+0000","last_unstale":"2024-05-10T04:51:33.167270+0000","last_undegraded":"2024-05-10T04:51:33.167270+0000","last_fullsized":"2024-05-10T04:51:33.167270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:07.953438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.164996+0000","last_change":"2024-05-10T04:51:32.562931+0000","last_active":"2024-05-10T04:51:33.164996+0000","last_peered":"2024-05-10T04:51:33.164996+0000","last_clean":"2024-05-10T04:51:33.164996+0000","last_became_active":"2024-05-10T04:51:32.562610+0000","last_became_peered":"2024-05-10T04:51:32.562610+0000","last_unstale":"2024-05-10T04:51:33.164996+0000","last_undegraded":"2024-05-10T04:51:33.164996+0000","last_fullsized":"2024-05-10T04:51:33.164996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:01:21.723243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167871+0000","last_change":"2024-05-10T04:51:33.160807+0000","last_active":"2024-05-10T04:51:33.167871+0000","last_peered":"2024-05-10T04:51:33.167871+0000","last_clean":"2024-05-10T04:51:33.167871+0000","last_became_active":"2024-05-10T04:51:33.160524+0000","last_became_peered":"2024-05-10T04:51:33.160524+0000","last_unstale":"2024-05-10T04:51:33.167871+0000","last_undegraded":"2024-05-10T04:51:33.167871+0000","last_fullsized":"2024-05-10T04:51:33.167871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:53.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.134261+0000","last_change":"2024-05-10T04:51:32.569232+0000","last_active":"2024-05-10T04:51:33.134261+0000","last_peered":"2024-05-10T04:51:33.134261+0000","last_clean":"2024-05-10T04:51:33.134261+0000","last_became_active":"2024-05-10T04:51:32.568909+0000","last_became_peered":"2024-05-10T04:51:32.568909+0000","last_unstale":"2024-05-10T04:51:33.134261+0000","last_undegraded":"2024-05-10T04:51:33.134261+0000","last_fullsized":"2024-05-10T04:51:33.134261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:33:19.494459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158992+0000","last_change":"2024-05-10T04:51:33.151567+0000","last_active":"2024-05-10T04:51:33.158992+0000","last_peered":"2024-05-10T04:51:33.158992+0000","last_clean":"2024-05-10T04:51:33.158992+0000","last_became_active":"2024-05-10T04:51:33.151259+0000","last_became_peered":"2024-05-10T04:51:33.151259+0000","last_unstale":"2024-05-10T04:51:33.158992+0000","last_undegraded":"2024-05-10T04:51:33.158992+0000","last_fullsized":"2024-05-10T04:51:33.158992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:03.842436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.169116+0000","last_change":"2024-05-10T04:51:32.559781+0000","last_active":"2024-05-10T04:51:33.169116+0000","last_peered":"2024-05-10T04:51:33.169116+0000","last_clean":"2024-05-10T04:51:33.169116+0000","last_became_active":"2024-05-10T04:51:32.559514+0000","last_became_peered":"2024-05-10T04:51:32.559514+0000","last_unstale":"2024-05-10T04:51:33.169116+0000","last_undegraded":"2024-05-10T04:51:33.169116+0000","last_fullsized":"2024-05-10T04:51:33.169116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:33:19.494459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168446+0000","last_change":"2024-05-10T04:51:33.165548+0000","last_active":"2024-05-10T04:51:33.168446+0000","last_peered":"2024-05-10T04:51:33.168446+0000","last_clean":"2024-05-10T04:51:33.168446+0000","last_became_active":"2024-05-10T04:51:33.160996+0000","last_became_peered":"2024-05-10T04:51:33.160996+0000","last_unstale":"2024-05-10T04:51:33.168446+0000","last_undegraded":"2024-05-10T04:51:33.168446+0000","last_fullsized":"2024-05-10T04:51:33.168446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:34.610114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.143274+0000","last_change":"2024-05-10T04:51:32.565063+0000","last_active":"2024-05-10T04:51:33.143274+0000","last_peered":"2024-05-10T04:51:33.143274+0000","last_clean":"2024-05-10T04:51:33.143274+0000","last_became_active":"2024-05-10T04:51:32.564678+0000","last_became_peered":"2024-05-10T04:51:32.564678+0000","last_unstale":"2024-05-10T04:51:33.143274+0000","last_undegraded":"2024-05-10T04:51:33.143274+0000","last_fullsized":"2024-05-10T04:51:33.143274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:33.601555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.164944+0000","last_change":"2024-05-10T04:51:33.156515+0000","last_active":"2024-05-10T04:51:33.164944+0000","last_peered":"2024-05-10T04:51:33.164944+0000","last_clean":"2024-05-10T04:51:33.164944+0000","last_became_active":"2024-05-10T04:51:33.156278+0000","last_became_peered":"2024-05-10T04:51:33.156278+0000","last_unstale":"2024-05-10T04:51:33.164944+0000","last_undegraded":"2024-05-10T04:51:33.164944+0000","last_fullsized":"2024-05-10T04:51:33.164944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:18:31.463323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.131802+0000","last_change":"2024-05-10T04:51:32.568412+0000","last_active":"2024-05-10T04:51:33.131802+0000","last_peered":"2024-05-10T04:51:33.131802+0000","last_clean":"2024-05-10T04:51:33.131802+0000","last_became_active":"2024-05-10T04:51:32.567696+0000","last_became_peered":"2024-05-10T04:51:32.567696+0000","last_unstale":"2024-05-10T04:51:33.131802+0000","last_undegraded":"2024-05-10T04:51:33.131802+0000","last_fullsized":"2024-05-10T04:51:33.131802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:00:51.934015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.160192+0000","last_change":"2024-05-10T04:51:33.150718+0000","last_active":"2024-05-10T04:51:33.160192+0000","last_peered":"2024-05-10T04:51:33.160192+0000","last_clean":"2024-05-10T04:51:33.160192+0000","last_became_active":"2024-05-10T04:51:33.150409+0000","last_became_peered":"2024-05-10T04:51:33.150409+0000","last_unstale":"2024-05-10T04:51:33.160192+0000","last_undegraded":"2024-05-10T04:51:33.160192+0000","last_fullsized":"2024-05-10T04:51:33.160192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:34:01.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.139457+0000","last_change":"2024-05-10T04:51:32.561515+0000","last_active":"2024-05-10T04:51:33.139457+0000","last_peered":"2024-05-10T04:51:33.139457+0000","last_clean":"2024-05-10T04:51:33.139457+0000","last_became_active":"2024-05-10T04:51:32.561191+0000","last_became_peered":"2024-05-10T04:51:32.561191+0000","last_unstale":"2024-05-10T04:51:33.139457+0000","last_undegraded":"2024-05-10T04:51:33.139457+0000","last_fullsized":"2024-05-10T04:51:33.139457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:52.083841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.170597+0000","last_change":"2024-05-10T04:51:33.167263+0000","last_active":"2024-05-10T04:51:33.170597+0000","last_peered":"2024-05-10T04:51:33.170597+0000","last_clean":"2024-05-10T04:51:33.170597+0000","last_became_active":"2024-05-10T04:51:33.167007+0000","last_became_peered":"2024-05-10T04:51:33.167007+0000","last_unstale":"2024-05-10T04:51:33.170597+0000","last_undegraded":"2024-05-10T04:51:33.170597+0000","last_fullsized":"2024-05-10T04:51:33.170597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:58:18.941872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.165682+0000","last_change":"2024-05-10T04:51:32.568282+0000","last_active":"2024-05-10T04:51:33.165682+0000","last_peered":"2024-05-10T04:51:33.165682+0000","last_clean":"2024-05-10T04:51:33.165682+0000","last_became_active":"2024-05-10T04:51:32.566265+0000","last_became_peered":"2024-05-10T04:51:32.566265+0000","last_unstale":"2024-05-10T04:51:33.165682+0000","last_undegraded":"2024-05-10T04:51:33.165682+0000","last_fullsized":"2024-05-10T04:51:33.165682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:54.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166259+0000","last_change":"2024-05-10T04:51:33.157956+0000","last_active":"2024-05-10T04:51:33.166259+0000","last_peered":"2024-05-10T04:51:33.166259+0000","last_clean":"2024-05-10T04:51:33.166259+0000","last_became_active":"2024-05-10T04:51:33.157104+0000","last_became_peered":"2024-05-10T04:51:33.157104+0000","last_unstale":"2024-05-10T04:51:33.166259+0000","last_undegraded":"2024-05-10T04:51:33.166259+0000","last_fullsized":"2024-05-10T04:51:33.166259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:49.507207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.150229+0000","last_change":"2024-05-10T04:51:32.556253+0000","last_active":"2024-05-10T04:51:33.150229+0000","last_peered":"2024-05-10T04:51:33.150229+0000","last_clean":"2024-05-10T04:51:33.150229+0000","last_became_active":"2024-05-10T04:51:32.555971+0000","last_became_peered":"2024-05-10T04:51:32.555971+0000","last_unstale":"2024-05-10T04:51:33.150229+0000","last_undegraded":"2024-05-10T04:51:33.150229+0000","last_fullsized":"2024-05-10T04:51:33.150229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:53:39.259816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162171+0000","last_change":"2024-05-10T04:51:33.153847+0000","last_active":"2024-05-10T04:51:33.162171+0000","last_peered":"2024-05-10T04:51:33.162171+0000","last_clean":"2024-05-10T04:51:33.162171+0000","last_became_active":"2024-05-10T04:51:33.153576+0000","last_became_peered":"2024-05-10T04:51:33.153576+0000","last_unstale":"2024-05-10T04:51:33.162171+0000","last_undegraded":"2024-05-10T04:51:33.162171+0000","last_fullsized":"2024-05-10T04:51:33.162171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:22.566748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.140563+0000","last_change":"2024-05-10T04:51:32.562261+0000","last_active":"2024-05-10T04:51:33.140563+0000","last_peered":"2024-05-10T04:51:33.140563+0000","last_clean":"2024-05-10T04:51:33.140563+0000","last_became_active":"2024-05-10T04:51:32.561949+0000","last_became_peered":"2024-05-10T04:51:32.561949+0000","last_unstale":"2024-05-10T04:51:33.140563+0000","last_undegraded":"2024-05-10T04:51:33.140563+0000","last_fullsized":"2024-05-10T04:51:33.140563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:21.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162848+0000","last_change":"2024-05-10T04:51:33.158719+0000","last_active":"2024-05-10T04:51:33.162848+0000","last_peered":"2024-05-10T04:51:33.162848+0000","last_clean":"2024-05-10T04:51:33.162848+0000","last_became_active":"2024-05-10T04:51:33.157935+0000","last_became_peered":"2024-05-10T04:51:33.157935+0000","last_unstale":"2024-05-10T04:51:33.162848+0000","last_undegraded":"2024-05-10T04:51:33.162848+0000","last_fullsized":"2024-05-10T04:51:33.162848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:21.431928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.153652+0000","last_change":"2024-05-10T04:51:32.559856+0000","last_active":"2024-05-10T04:51:33.153652+0000","last_peered":"2024-05-10T04:51:33.153652+0000","last_clean":"2024-05-10T04:51:33.153652+0000","last_became_active":"2024-05-10T04:51:32.559575+0000","last_became_peered":"2024-05-10T04:51:32.559575+0000","last_unstale":"2024-05-10T04:51:33.153652+0000","last_undegraded":"2024-05-10T04:51:33.153652+0000","last_fullsized":"2024-05-10T04:51:33.153652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:47.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.165065+0000","last_change":"2024-05-10T04:51:33.157702+0000","last_active":"2024-05-10T04:51:33.165065+0000","last_peered":"2024-05-10T04:51:33.165065+0000","last_clean":"2024-05-10T04:51:33.165065+0000","last_became_active":"2024-05-10T04:51:33.157488+0000","last_became_peered":"2024-05-10T04:51:33.157488+0000","last_unstale":"2024-05-10T04:51:33.165065+0000","last_undegraded":"2024-05-10T04:51:33.165065+0000","last_fullsized":"2024-05-10T04:51:33.165065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:50:32.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.140789+0000","last_change":"2024-05-10T04:51:32.568035+0000","last_active":"2024-05-10T04:51:33.140789+0000","last_peered":"2024-05-10T04:51:33.140789+0000","last_clean":"2024-05-10T04:51:33.140789+0000","last_became_active":"2024-05-10T04:51:32.567737+0000","last_became_peered":"2024-05-10T04:51:32.567737+0000","last_unstale":"2024-05-10T04:51:33.140789+0000","last_undegraded":"2024-05-10T04:51:33.140789+0000","last_fullsized":"2024-05-10T04:51:33.140789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:28.440834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.173831+0000","last_change":"2024-05-10T04:51:33.165945+0000","last_active":"2024-05-10T04:51:33.173831+0000","last_peered":"2024-05-10T04:51:33.173831+0000","last_clean":"2024-05-10T04:51:33.173831+0000","last_became_active":"2024-05-10T04:51:33.162780+0000","last_became_peered":"2024-05-10T04:51:33.162780+0000","last_unstale":"2024-05-10T04:51:33.173831+0000","last_undegraded":"2024-05-10T04:51:33.173831+0000","last_fullsized":"2024-05-10T04:51:33.173831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:49.507207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.131912+0000","last_change":"2024-05-10T04:51:32.568499+0000","last_active":"2024-05-10T04:51:33.131912+0000","last_peered":"2024-05-10T04:51:33.131912+0000","last_clean":"2024-05-10T04:51:33.131912+0000","last_became_active":"2024-05-10T04:51:32.568151+0000","last_became_peered":"2024-05-10T04:51:32.568151+0000","last_unstale":"2024-05-10T04:51:33.131912+0000","last_undegraded":"2024-05-10T04:51:33.131912+0000","last_fullsized":"2024-05-10T04:51:33.131912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:05:10.901243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.151746+0000","last_change":"2024-05-10T04:51:33.141481+0000","last_active":"2024-05-10T04:51:33.151746+0000","last_peered":"2024-05-10T04:51:33.151746+0000","last_clean":"2024-05-10T04:51:33.151746+0000","last_became_active":"2024-05-10T04:51:33.141171+0000","last_became_peered":"2024-05-10T04:51:33.141171+0000","last_unstale":"2024-05-10T04:51:33.151746+0000","last_undegraded":"2024-05-10T04:51:33.151746+0000","last_fullsized":"2024-05-10T04:51:33.151746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:58:18.941872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.129820+0000","last_change":"2024-05-10T04:51:32.562544+0000","last_active":"2024-05-10T04:51:33.129820+0000","last_peered":"2024-05-10T04:51:33.129820+0000","last_clean":"2024-05-10T04:51:33.129820+0000","last_became_active":"2024-05-10T04:51:32.558080+0000","last_became_peered":"2024-05-10T04:51:32.558080+0000","last_unstale":"2024-05-10T04:51:33.129820+0000","last_undegraded":"2024-05-10T04:51:33.129820+0000","last_fullsized":"2024-05-10T04:51:33.129820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:01.074466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.161720+0000","last_change":"2024-05-10T04:51:33.158643+0000","last_active":"2024-05-10T04:51:33.161720+0000","last_peered":"2024-05-10T04:51:33.161720+0000","last_clean":"2024-05-10T04:51:33.161720+0000","last_became_active":"2024-05-10T04:51:33.157476+0000","last_became_peered":"2024-05-10T04:51:33.157476+0000","last_unstale":"2024-05-10T04:51:33.161720+0000","last_undegraded":"2024-05-10T04:51:33.161720+0000","last_fullsized":"2024-05-10T04:51:33.161720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:28.154722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.142191+0000","last_change":"2024-05-10T04:51:32.567486+0000","last_active":"2024-05-10T04:51:33.142191+0000","last_peered":"2024-05-10T04:51:33.142191+0000","last_clean":"2024-05-10T04:51:33.142191+0000","last_became_active":"2024-05-10T04:51:32.566869+0000","last_became_peered":"2024-05-10T04:51:32.566869+0000","last_unstale":"2024-05-10T04:51:33.142191+0000","last_undegraded":"2024-05-10T04:51:33.142191+0000","last_fullsized":"2024-05-10T04:51:33.142191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:12.611451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:51:32.554994+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:51:32.554994+0000","last_peered":"2024-05-10T04:51:32.554994+0000","last_clean":"2024-05-10T04:51:32.554994+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:51:32.554994+0000","last_undegraded":"2024-05-10T04:51:32.554994+0000","last_fullsized":"2024-05-10T04:51:32.554994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":740886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79700000000000004}]},{"osd":4,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.77300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.94599999999999995}]},{"osd":3,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.755}]},{"osd":7,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":152014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]},{"osd":2,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":740796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.754}]},{"osd":6,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":150498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.316},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.8520000000000003,"5min":5.8520000000000003,"15min":5.8520000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.438}]},{"osd":4,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":5.8090000000000002,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.754},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":5.6829999999999998,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.79700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":152014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.437},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.751}]},{"osd":6,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.81899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":150532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.629}]},{"osd":1,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0670000000000002,"5min":5.0670000000000002,"15min":5.0670000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.871}]},{"osd":3,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.753}]},{"osd":5,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":1.036},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.90400000000000003}]},{"osd":7,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":1.008},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.92700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.748}]},{"osd":4,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.878}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:51:38.881 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:51:39.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.177+0000 7fb546400700 1 Processor -- start 2024-05-10T04:51:39.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.177+0000 7fb546400700 1 -- start start 2024-05-10T04:51:39.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.179+0000 7fb546400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb5400d2e60 0x7fb5401693d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.179+0000 7fb546400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5401627a0 con 0x7fb5400b60b0 2024-05-10T04:51:39.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.179+0000 7fb546400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54015f4e0 con 0x7fb540162c30 2024-05-10T04:51:39.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.179+0000 7fb546400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb540163040 con 0x7fb5400d2e60 2024-05-10T04:51:39.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.179+0000 7fb53ea00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb5400b60b0 0x7fb5400d2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41962/0 (socket says 172.21.15.82:41962) 2024-05-10T04:51:39.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.179+0000 7fb53ea00700 1 -- 172.21.15.82:0/714125500 learned_addr learned my addr 172.21.15.82:0/714125500 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:39.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.179+0000 7fb53fe00700 1 --2- 172.21.15.82:0/714125500 >> v2:172.21.15.129:3300/0 conn(0x7fb5400d2e60 0x7fb5401693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407130909 0 0) 0x7fb5401627a0 con 0x7fb5400b60b0 2024-05-10T04:51:39.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5240035b0 con 0x7fb5400b60b0 2024-05-10T04:51:39.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062010399 0 0) 0x7fb54015f4e0 con 0x7fb540162c30 2024-05-10T04:51:39.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5401627a0 con 0x7fb540162c30 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3273799022 0 0) 0x7fb5240035b0 con 0x7fb5400b60b0 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 >> v2:172.21.15.129:3300/0 conn(0x7fb5400d2e60 msgr2=0x7fb5401693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 --2- 172.21.15.82:0/714125500 >> v2:172.21.15.129:3300/0 conn(0x7fb5400d2e60 0x7fb5401693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 >> v1:172.21.15.129:6789/0 conn(0x7fb540162c30 legacy=0x7fb5400b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54015fa20 con 0x7fb5400b60b0 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fb52c001670 con 0x7fb5400b60b0 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 >> v1:172.21.15.82:6789/0 conn(0x7fb5400b60b0 legacy=0x7fb5400d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524003b90 0x7fb524003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb524004850 0x7fb524004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5240051f0 0x7fb52400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52400c160 con 0x7fb524004850 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52400c2d0 con 0x7fb524003b90 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52400c490 con 0x7fb5240051f0 2024-05-10T04:51:39.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53ea00700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb524004850 0x7fb524004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.180+0000 7fb53f400700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524003b90 0x7fb524003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53fe00700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5240051f0 0x7fb52400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53ea00700 1 -- 172.21.15.82:0/714125500 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5240051f0 msgr2=0x7fb52400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53ea00700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5240051f0 0x7fb52400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53ea00700 1 -- 172.21.15.82:0/714125500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524003b90 msgr2=0x7fb524003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53ea00700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524003b90 0x7fb524003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53ea00700 1 -- 172.21.15.82:0/714125500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5240035b0 con 0x7fb524004850 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53fe00700 1 -- 172.21.15.82:0/714125500 reap_dead start 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53ea00700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb524004850 0x7fb524004c60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb5240047d0 tx=0x7fb524005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a314709099852fbd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c007b90 con 0x7fb524004850 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c00cd20 con 0x7fb524004850 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.181+0000 7fb53e000700 1 -- 172.21.15.82:0/714125500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c005ba0 con 0x7fb524004850 2024-05-10T04:51:39.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.182+0000 7fb546400700 1 -- 172.21.15.82:0/714125500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb524004850 msgr2=0x7fb524004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.182+0000 7fb546400700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb524004850 0x7fb524004c60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb5240047d0 tx=0x7fb524005880 comp rx=0 tx=0).stop 2024-05-10T04:51:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.182+0000 7fb546400700 1 -- 172.21.15.82:0/714125500 shutdown_connections 2024-05-10T04:51:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.182+0000 7fb546400700 1 --2- 172.21.15.82:0/714125500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb524004850 0x7fb524004c60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.182+0000 7fb546400700 1 -- 172.21.15.82:0/714125500 >> 172.21.15.82:0/714125500 conn(0x7fb5400d0b80 msgr2=0x7fb5400d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.182+0000 7fb546400700 1 -- 172.21.15.82:0/714125500 shutdown_connections 2024-05-10T04:51:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.182+0000 7fb546400700 1 -- 172.21.15.82:0/714125500 wait complete. 2024-05-10T04:51:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.185+0000 7fb546400700 1 Processor -- start 2024-05-10T04:51:39.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.185+0000 7fb546400700 1 -- start start 2024-05-10T04:51:39.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb546400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524004850 0x7fb54015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb546400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5401f7cd0 0x7fb5401f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb546400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb540159150 0x7fb5400b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb546400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5401f4a30 con 0x7fb540159150 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb546400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400ab550 con 0x7fb524004850 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb546400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400cead0 con 0x7fb5401f7cd0 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb53fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb540159150 0x7fb5400b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb53fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb540159150 0x7fb5400b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54006/0 (socket says 172.21.15.82:54006) 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.187+0000 7fb53fe00700 1 -- 172.21.15.82:0/4207212493 learned_addr learned my addr 172.21.15.82:0/4207212493 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb53f400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524004850 0x7fb54015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb53ea00700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5401f7cd0 0x7fb5401f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb53fe00700 1 -- 172.21.15.82:0/4207212493 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5401f7cd0 msgr2=0x7fb5401f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb53fe00700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5401f7cd0 0x7fb5401f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb53fe00700 1 -- 172.21.15.82:0/4207212493 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524004850 msgr2=0x7fb54015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb53fe00700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524004850 0x7fb54015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb53fe00700 1 -- 172.21.15.82:0/4207212493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400cedb0 con 0x7fb540159150 2024-05-10T04:51:39.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb53fe00700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb540159150 0x7fb5400b7b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb540162040 tx=0x7fb538011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb537400700 1 -- 172.21.15.82:0/4207212493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800e040 con 0x7fb540159150 2024-05-10T04:51:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb537400700 1 -- 172.21.15.82:0/4207212493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53800f040 con 0x7fb540159150 2024-05-10T04:51:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5401f3cf0 con 0x7fb540159150 2024-05-10T04:51:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.188+0000 7fb537400700 1 -- 172.21.15.82:0/4207212493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800fdb0 con 0x7fb540159150 2024-05-10T04:51:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.189+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5401f39e0 con 0x7fb540159150 2024-05-10T04:51:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.189+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5400732b0 con 0x7fb540159150 2024-05-10T04:51:39.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.191+0000 7fb537400700 1 -- 172.21.15.82:0/4207212493 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb538022460 con 0x7fb540159150 2024-05-10T04:51:39.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.192+0000 7fb537400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb52006acc0 0x7fb52006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.192+0000 7fb537400700 1 -- 172.21.15.82:0/4207212493 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5380899f0 con 0x7fb540159150 2024-05-10T04:51:39.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.192+0000 7fb53f400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb52006acc0 0x7fb52006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.192+0000 7fb53f400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb52006acc0 0x7fb52006d1d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb530000c00 tx=0x7fb530009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:39.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.196+0000 7fb537400700 1 -- 172.21.15.82:0/4207212493 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb538054aa0 con 0x7fb540159150 2024-05-10T04:51:39.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.393+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb540162430 con 0x7fb52006acc0 2024-05-10T04:51:39.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.402+0000 7fb537400700 1 -- 172.21.15.82:0/4207212493 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289347 (secure 0 0 0) 0x7fb530005210 con 0x7fb52006acc0 2024-05-10T04:51:39.407 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:39.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb52006acc0 msgr2=0x7fb52006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb52006acc0 0x7fb52006d1d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb530000c00 tx=0x7fb530009040 comp rx=0 tx=0).stop 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb540159150 msgr2=0x7fb5400b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb540159150 0x7fb5400b7b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb540162040 tx=0x7fb538011f80 comp rx=0 tx=0).stop 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 shutdown_connections 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb52006acc0 0x7fb52006d1d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb540159150 0x7fb5400b7b60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb524004850 0x7fb54015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 --2- 172.21.15.82:0/4207212493 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5401f7cd0 0x7fb5401f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 >> 172.21.15.82:0/4207212493 conn(0x7fb5400d0b80 msgr2=0x7fb5400d39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 shutdown_connections 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.406+0000 7fb546400700 1 -- 172.21.15.82:0/4207212493 wait complete. 2024-05-10T04:51:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:51:39.434 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-05-10T04:51:38.986097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220448,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754272,"statfs":{"total":773094113280,"available":772868374528,"internally_reserved":0,"allocated":4333568,"data_stored":2388884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.444891"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159921+0000","last_change":"2024-05-10T04:51:33.151427+0000","last_active":"2024-05-10T04:51:33.159921+0000","last_peered":"2024-05-10T04:51:33.159921+0000","last_clean":"2024-05-10T04:51:33.159921+0000","last_became_active":"2024-05-10T04:51:33.150956+0000","last_became_peered":"2024-05-10T04:51:33.150956+0000","last_unstale":"2024-05-10T04:51:33.159921+0000","last_undegraded":"2024-05-10T04:51:33.159921+0000","last_fullsized":"2024-05-10T04:51:33.159921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:38:48.192168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.173849+0000","last_change":"2024-05-10T04:51:33.169485+0000","last_active":"2024-05-10T04:51:33.173849+0000","last_peered":"2024-05-10T04:51:33.173849+0000","last_clean":"2024-05-10T04:51:33.173849+0000","last_became_active":"2024-05-10T04:51:33.162870+0000","last_became_peered":"2024-05-10T04:51:33.162870+0000","last_unstale":"2024-05-10T04:51:33.173849+0000","last_undegraded":"2024-05-10T04:51:33.173849+0000","last_fullsized":"2024-05-10T04:51:33.173849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:28.154722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168450+0000","last_change":"2024-05-10T04:51:33.166727+0000","last_active":"2024-05-10T04:51:33.168450+0000","last_peered":"2024-05-10T04:51:33.168450+0000","last_clean":"2024-05-10T04:51:33.168450+0000","last_became_active":"2024-05-10T04:51:33.166419+0000","last_became_peered":"2024-05-10T04:51:33.166419+0000","last_unstale":"2024-05-10T04:51:33.168450+0000","last_undegraded":"2024-05-10T04:51:33.168450+0000","last_fullsized":"2024-05-10T04:51:33.168450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:21:54.544038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167395+0000","last_change":"2024-05-10T04:51:33.161609+0000","last_active":"2024-05-10T04:51:33.167395+0000","last_peered":"2024-05-10T04:51:33.167395+0000","last_clean":"2024-05-10T04:51:33.167395+0000","last_became_active":"2024-05-10T04:51:33.161277+0000","last_became_peered":"2024-05-10T04:51:33.161277+0000","last_unstale":"2024-05-10T04:51:33.167395+0000","last_undegraded":"2024-05-10T04:51:33.167395+0000","last_fullsized":"2024-05-10T04:51:33.167395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:57.993718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.174125+0000","last_change":"2024-05-10T04:51:33.171166+0000","last_active":"2024-05-10T04:51:33.174125+0000","last_peered":"2024-05-10T04:51:33.174125+0000","last_clean":"2024-05-10T04:51:33.174125+0000","last_became_active":"2024-05-10T04:51:33.170908+0000","last_became_peered":"2024-05-10T04:51:33.170908+0000","last_unstale":"2024-05-10T04:51:33.174125+0000","last_undegraded":"2024-05-10T04:51:33.174125+0000","last_fullsized":"2024-05-10T04:51:33.174125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:27.441656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.169421+0000","last_change":"2024-05-10T04:51:33.152215+0000","last_active":"2024-05-10T04:51:33.169421+0000","last_peered":"2024-05-10T04:51:33.169421+0000","last_clean":"2024-05-10T04:51:33.169421+0000","last_became_active":"2024-05-10T04:51:33.150812+0000","last_became_peered":"2024-05-10T04:51:33.150812+0000","last_unstale":"2024-05-10T04:51:33.169421+0000","last_undegraded":"2024-05-10T04:51:33.169421+0000","last_fullsized":"2024-05-10T04:51:33.169421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:15.474173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.160170+0000","last_change":"2024-05-10T04:51:33.150885+0000","last_active":"2024-05-10T04:51:33.160170+0000","last_peered":"2024-05-10T04:51:33.160170+0000","last_clean":"2024-05-10T04:51:33.160170+0000","last_became_active":"2024-05-10T04:51:33.150512+0000","last_became_peered":"2024-05-10T04:51:33.150512+0000","last_unstale":"2024-05-10T04:51:33.160170+0000","last_undegraded":"2024-05-10T04:51:33.160170+0000","last_fullsized":"2024-05-10T04:51:33.160170+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:34:12.132883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.161599+0000","last_change":"2024-05-10T04:51:33.155024+0000","last_active":"2024-05-10T04:51:33.161599+0000","last_peered":"2024-05-10T04:51:33.161599+0000","last_clean":"2024-05-10T04:51:33.161599+0000","last_became_active":"2024-05-10T04:51:33.154803+0000","last_became_peered":"2024-05-10T04:51:33.154803+0000","last_unstale":"2024-05-10T04:51:33.161599+0000","last_undegraded":"2024-05-10T04:51:33.161599+0000","last_fullsized":"2024-05-10T04:51:33.161599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:21:54.544038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163112+0000","last_change":"2024-05-10T04:51:33.154908+0000","last_active":"2024-05-10T04:51:33.163112+0000","last_peered":"2024-05-10T04:51:33.163112+0000","last_clean":"2024-05-10T04:51:33.163112+0000","last_became_active":"2024-05-10T04:51:33.152109+0000","last_became_peered":"2024-05-10T04:51:33.152109+0000","last_unstale":"2024-05-10T04:51:33.163112+0000","last_undegraded":"2024-05-10T04:51:33.163112+0000","last_fullsized":"2024-05-10T04:51:33.163112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:13.620010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.151317+0000","last_change":"2024-05-10T04:51:33.148400+0000","last_active":"2024-05-10T04:51:33.151317+0000","last_peered":"2024-05-10T04:51:33.151317+0000","last_clean":"2024-05-10T04:51:33.151317+0000","last_became_active":"2024-05-10T04:51:33.147569+0000","last_became_peered":"2024-05-10T04:51:33.147569+0000","last_unstale":"2024-05-10T04:51:33.151317+0000","last_undegraded":"2024-05-10T04:51:33.151317+0000","last_fullsized":"2024-05-10T04:51:33.151317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:28.154722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158001+0000","last_change":"2024-05-10T04:51:33.148285+0000","last_active":"2024-05-10T04:51:33.158001+0000","last_peered":"2024-05-10T04:51:33.158001+0000","last_clean":"2024-05-10T04:51:33.158001+0000","last_became_active":"2024-05-10T04:51:33.147983+0000","last_became_peered":"2024-05-10T04:51:33.147983+0000","last_unstale":"2024-05-10T04:51:33.158001+0000","last_undegraded":"2024-05-10T04:51:33.158001+0000","last_fullsized":"2024-05-10T04:51:33.158001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:07.739150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.152806+0000","last_change":"2024-05-10T04:51:33.148467+0000","last_active":"2024-05-10T04:51:33.152806+0000","last_peered":"2024-05-10T04:51:33.152806+0000","last_clean":"2024-05-10T04:51:33.152806+0000","last_became_active":"2024-05-10T04:51:33.148153+0000","last_became_peered":"2024-05-10T04:51:33.148153+0000","last_unstale":"2024-05-10T04:51:33.152806+0000","last_undegraded":"2024-05-10T04:51:33.152806+0000","last_fullsized":"2024-05-10T04:51:33.152806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:07:02.361391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163707+0000","last_change":"2024-05-10T04:51:33.154990+0000","last_active":"2024-05-10T04:51:33.163707+0000","last_peered":"2024-05-10T04:51:33.163707+0000","last_clean":"2024-05-10T04:51:33.163707+0000","last_became_active":"2024-05-10T04:51:33.152725+0000","last_became_peered":"2024-05-10T04:51:33.152725+0000","last_unstale":"2024-05-10T04:51:33.163707+0000","last_undegraded":"2024-05-10T04:51:33.163707+0000","last_fullsized":"2024-05-10T04:51:33.163707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:13.620010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.169432+0000","last_change":"2024-05-10T04:51:33.153093+0000","last_active":"2024-05-10T04:51:33.169432+0000","last_peered":"2024-05-10T04:51:33.169432+0000","last_clean":"2024-05-10T04:51:33.169432+0000","last_became_active":"2024-05-10T04:51:33.152770+0000","last_became_peered":"2024-05-10T04:51:33.152770+0000","last_unstale":"2024-05-10T04:51:33.169432+0000","last_undegraded":"2024-05-10T04:51:33.169432+0000","last_fullsized":"2024-05-10T04:51:33.169432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:21:54.544038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166127+0000","last_change":"2024-05-10T04:51:33.155839+0000","last_active":"2024-05-10T04:51:33.166127+0000","last_peered":"2024-05-10T04:51:33.166127+0000","last_clean":"2024-05-10T04:51:33.166127+0000","last_became_active":"2024-05-10T04:51:33.155462+0000","last_became_peered":"2024-05-10T04:51:33.155462+0000","last_unstale":"2024-05-10T04:51:33.166127+0000","last_undegraded":"2024-05-10T04:51:33.166127+0000","last_fullsized":"2024-05-10T04:51:33.166127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:14.683857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.155582+0000","last_change":"2024-05-10T04:51:33.141405+0000","last_active":"2024-05-10T04:51:33.155582+0000","last_peered":"2024-05-10T04:51:33.155582+0000","last_clean":"2024-05-10T04:51:33.155582+0000","last_became_active":"2024-05-10T04:51:33.141068+0000","last_became_peered":"2024-05-10T04:51:33.141068+0000","last_unstale":"2024-05-10T04:51:33.155582+0000","last_undegraded":"2024-05-10T04:51:33.155582+0000","last_fullsized":"2024-05-10T04:51:33.155582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:14.683857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.157966+0000","last_change":"2024-05-10T04:51:33.146394+0000","last_active":"2024-05-10T04:51:33.157966+0000","last_peered":"2024-05-10T04:51:33.157966+0000","last_clean":"2024-05-10T04:51:33.157966+0000","last_became_active":"2024-05-10T04:51:33.146056+0000","last_became_peered":"2024-05-10T04:51:33.146056+0000","last_unstale":"2024-05-10T04:51:33.157966+0000","last_undegraded":"2024-05-10T04:51:33.157966+0000","last_fullsized":"2024-05-10T04:51:33.157966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:07:02.361391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.171581+0000","last_change":"2024-05-10T04:51:33.162475+0000","last_active":"2024-05-10T04:51:33.171581+0000","last_peered":"2024-05-10T04:51:33.171581+0000","last_clean":"2024-05-10T04:51:33.171581+0000","last_became_active":"2024-05-10T04:51:33.149752+0000","last_became_peered":"2024-05-10T04:51:33.149752+0000","last_unstale":"2024-05-10T04:51:33.171581+0000","last_undegraded":"2024-05-10T04:51:33.171581+0000","last_fullsized":"2024-05-10T04:51:33.171581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:34:01.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.169345+0000","last_change":"2024-05-10T04:51:33.152570+0000","last_active":"2024-05-10T04:51:33.169345+0000","last_peered":"2024-05-10T04:51:33.169345+0000","last_clean":"2024-05-10T04:51:33.169345+0000","last_became_active":"2024-05-10T04:51:33.150705+0000","last_became_peered":"2024-05-10T04:51:33.150705+0000","last_unstale":"2024-05-10T04:51:33.169345+0000","last_undegraded":"2024-05-10T04:51:33.169345+0000","last_fullsized":"2024-05-10T04:51:33.169345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:14.683857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167840+0000","last_change":"2024-05-10T04:51:33.158621+0000","last_active":"2024-05-10T04:51:33.167840+0000","last_peered":"2024-05-10T04:51:33.167840+0000","last_clean":"2024-05-10T04:51:33.167840+0000","last_became_active":"2024-05-10T04:51:33.158338+0000","last_became_peered":"2024-05-10T04:51:33.158338+0000","last_unstale":"2024-05-10T04:51:33.167840+0000","last_undegraded":"2024-05-10T04:51:33.167840+0000","last_fullsized":"2024-05-10T04:51:33.167840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:32:08.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163859+0000","last_change":"2024-05-10T04:51:33.158913+0000","last_active":"2024-05-10T04:51:33.163859+0000","last_peered":"2024-05-10T04:51:33.163859+0000","last_clean":"2024-05-10T04:51:33.163859+0000","last_became_active":"2024-05-10T04:51:33.158469+0000","last_became_peered":"2024-05-10T04:51:33.158469+0000","last_unstale":"2024-05-10T04:51:33.163859+0000","last_undegraded":"2024-05-10T04:51:33.163859+0000","last_fullsized":"2024-05-10T04:51:33.163859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:34.610114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163264+0000","last_change":"2024-05-10T04:51:33.155791+0000","last_active":"2024-05-10T04:51:33.163264+0000","last_peered":"2024-05-10T04:51:33.163264+0000","last_clean":"2024-05-10T04:51:33.163264+0000","last_became_active":"2024-05-10T04:51:33.144155+0000","last_became_peered":"2024-05-10T04:51:33.144155+0000","last_unstale":"2024-05-10T04:51:33.163264+0000","last_undegraded":"2024-05-10T04:51:33.163264+0000","last_fullsized":"2024-05-10T04:51:33.163264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:32:08.325397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167680+0000","last_change":"2024-05-10T04:51:33.161103+0000","last_active":"2024-05-10T04:51:33.167680+0000","last_peered":"2024-05-10T04:51:33.167680+0000","last_clean":"2024-05-10T04:51:33.167680+0000","last_became_active":"2024-05-10T04:51:33.160848+0000","last_became_peered":"2024-05-10T04:51:33.160848+0000","last_unstale":"2024-05-10T04:51:33.167680+0000","last_undegraded":"2024-05-10T04:51:33.167680+0000","last_fullsized":"2024-05-10T04:51:33.167680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:34.610114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166271+0000","last_change":"2024-05-10T04:51:33.157534+0000","last_active":"2024-05-10T04:51:33.166271+0000","last_peered":"2024-05-10T04:51:33.166271+0000","last_clean":"2024-05-10T04:51:33.166271+0000","last_became_active":"2024-05-10T04:51:33.156269+0000","last_became_peered":"2024-05-10T04:51:33.156269+0000","last_unstale":"2024-05-10T04:51:33.166271+0000","last_undegraded":"2024-05-10T04:51:33.166271+0000","last_fullsized":"2024-05-10T04:51:33.166271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:03:42.513724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167744+0000","last_change":"2024-05-10T04:51:33.162822+0000","last_active":"2024-05-10T04:51:33.167744+0000","last_peered":"2024-05-10T04:51:33.167744+0000","last_clean":"2024-05-10T04:51:33.167744+0000","last_became_active":"2024-05-10T04:51:33.162534+0000","last_became_peered":"2024-05-10T04:51:33.162534+0000","last_unstale":"2024-05-10T04:51:33.167744+0000","last_undegraded":"2024-05-10T04:51:33.167744+0000","last_fullsized":"2024-05-10T04:51:33.167744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:38:48.192168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.144597+0000","last_change":"2024-05-10T04:51:33.138367+0000","last_active":"2024-05-10T04:51:33.144597+0000","last_peered":"2024-05-10T04:51:33.144597+0000","last_clean":"2024-05-10T04:51:33.144597+0000","last_became_active":"2024-05-10T04:51:33.138088+0000","last_became_peered":"2024-05-10T04:51:33.138088+0000","last_unstale":"2024-05-10T04:51:33.144597+0000","last_undegraded":"2024-05-10T04:51:33.144597+0000","last_fullsized":"2024-05-10T04:51:33.144597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:38:43.707977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168411+0000","last_change":"2024-05-10T04:51:33.163203+0000","last_active":"2024-05-10T04:51:33.168411+0000","last_peered":"2024-05-10T04:51:33.168411+0000","last_clean":"2024-05-10T04:51:33.168411+0000","last_became_active":"2024-05-10T04:51:33.160180+0000","last_became_peered":"2024-05-10T04:51:33.160180+0000","last_unstale":"2024-05-10T04:51:33.168411+0000","last_undegraded":"2024-05-10T04:51:33.168411+0000","last_fullsized":"2024-05-10T04:51:33.168411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:22.784368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166942+0000","last_change":"2024-05-10T04:51:33.160848+0000","last_active":"2024-05-10T04:51:33.166942+0000","last_peered":"2024-05-10T04:51:33.166942+0000","last_clean":"2024-05-10T04:51:33.166942+0000","last_became_active":"2024-05-10T04:51:33.160588+0000","last_became_peered":"2024-05-10T04:51:33.160588+0000","last_unstale":"2024-05-10T04:51:33.166942+0000","last_undegraded":"2024-05-10T04:51:33.166942+0000","last_fullsized":"2024-05-10T04:51:33.166942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:47.329908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.154116+0000","last_change":"2024-05-10T04:51:33.146005+0000","last_active":"2024-05-10T04:51:33.154116+0000","last_peered":"2024-05-10T04:51:33.154116+0000","last_clean":"2024-05-10T04:51:33.154116+0000","last_became_active":"2024-05-10T04:51:33.145547+0000","last_became_peered":"2024-05-10T04:51:33.145547+0000","last_unstale":"2024-05-10T04:51:33.154116+0000","last_undegraded":"2024-05-10T04:51:33.154116+0000","last_fullsized":"2024-05-10T04:51:33.154116+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:03.842436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158424+0000","last_change":"2024-05-10T04:51:33.144451+0000","last_active":"2024-05-10T04:51:33.158424+0000","last_peered":"2024-05-10T04:51:33.158424+0000","last_clean":"2024-05-10T04:51:33.158424+0000","last_became_active":"2024-05-10T04:51:33.144066+0000","last_became_peered":"2024-05-10T04:51:33.144066+0000","last_unstale":"2024-05-10T04:51:33.158424+0000","last_undegraded":"2024-05-10T04:51:33.158424+0000","last_fullsized":"2024-05-10T04:51:33.158424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:49.507207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162467+0000","last_change":"2024-05-10T04:51:33.157547+0000","last_active":"2024-05-10T04:51:33.162467+0000","last_peered":"2024-05-10T04:51:33.162467+0000","last_clean":"2024-05-10T04:51:33.162467+0000","last_became_active":"2024-05-10T04:51:33.156793+0000","last_became_peered":"2024-05-10T04:51:33.156793+0000","last_unstale":"2024-05-10T04:51:33.162467+0000","last_undegraded":"2024-05-10T04:51:33.162467+0000","last_fullsized":"2024-05-10T04:51:33.162467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:57.993718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158711+0000","last_change":"2024-05-10T04:51:33.144599+0000","last_active":"2024-05-10T04:51:33.158711+0000","last_peered":"2024-05-10T04:51:33.158711+0000","last_clean":"2024-05-10T04:51:33.158711+0000","last_became_active":"2024-05-10T04:51:33.144243+0000","last_became_peered":"2024-05-10T04:51:33.144243+0000","last_unstale":"2024-05-10T04:51:33.158711+0000","last_undegraded":"2024-05-10T04:51:33.158711+0000","last_fullsized":"2024-05-10T04:51:33.158711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:38:43.707977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167506+0000","last_change":"2024-05-10T04:51:33.163411+0000","last_active":"2024-05-10T04:51:33.167506+0000","last_peered":"2024-05-10T04:51:33.167506+0000","last_clean":"2024-05-10T04:51:33.167506+0000","last_became_active":"2024-05-10T04:51:33.161002+0000","last_became_peered":"2024-05-10T04:51:33.161002+0000","last_unstale":"2024-05-10T04:51:33.167506+0000","last_undegraded":"2024-05-10T04:51:33.167506+0000","last_fullsized":"2024-05-10T04:51:33.167506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:02.083025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167021+0000","last_change":"2024-05-10T04:51:32.571442+0000","last_active":"2024-05-10T04:51:33.167021+0000","last_peered":"2024-05-10T04:51:33.167021+0000","last_clean":"2024-05-10T04:51:33.167021+0000","last_became_active":"2024-05-10T04:51:32.571115+0000","last_became_peered":"2024-05-10T04:51:32.571115+0000","last_unstale":"2024-05-10T04:51:33.167021+0000","last_undegraded":"2024-05-10T04:51:33.167021+0000","last_fullsized":"2024-05-10T04:51:33.167021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:52.083841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159903+0000","last_change":"2024-05-10T04:51:33.149893+0000","last_active":"2024-05-10T04:51:33.159903+0000","last_peered":"2024-05-10T04:51:33.159903+0000","last_clean":"2024-05-10T04:51:33.159903+0000","last_became_active":"2024-05-10T04:51:33.146652+0000","last_became_peered":"2024-05-10T04:51:33.146652+0000","last_unstale":"2024-05-10T04:51:33.159903+0000","last_undegraded":"2024-05-10T04:51:33.159903+0000","last_fullsized":"2024-05-10T04:51:33.159903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:22.784368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.164546+0000","last_change":"2024-05-10T04:51:32.561378+0000","last_active":"2024-05-10T04:51:33.164546+0000","last_peered":"2024-05-10T04:51:33.164546+0000","last_clean":"2024-05-10T04:51:33.164546+0000","last_became_active":"2024-05-10T04:51:32.561105+0000","last_became_peered":"2024-05-10T04:51:32.561105+0000","last_unstale":"2024-05-10T04:51:33.164546+0000","last_undegraded":"2024-05-10T04:51:33.164546+0000","last_fullsized":"2024-05-10T04:51:33.164546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:19:50.178207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163747+0000","last_change":"2024-05-10T04:51:33.155425+0000","last_active":"2024-05-10T04:51:33.163747+0000","last_peered":"2024-05-10T04:51:33.163747+0000","last_clean":"2024-05-10T04:51:33.163747+0000","last_became_active":"2024-05-10T04:51:33.150118+0000","last_became_peered":"2024-05-10T04:51:33.150118+0000","last_unstale":"2024-05-10T04:51:33.163747+0000","last_undegraded":"2024-05-10T04:51:33.163747+0000","last_fullsized":"2024-05-10T04:51:33.163747+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:12.784029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.171763+0000","last_change":"2024-05-10T04:51:32.570170+0000","last_active":"2024-05-10T04:51:33.171763+0000","last_peered":"2024-05-10T04:51:33.171763+0000","last_clean":"2024-05-10T04:51:33.171763+0000","last_became_active":"2024-05-10T04:51:32.569866+0000","last_became_peered":"2024-05-10T04:51:32.569866+0000","last_unstale":"2024-05-10T04:51:33.171763+0000","last_undegraded":"2024-05-10T04:51:33.171763+0000","last_fullsized":"2024-05-10T04:51:33.171763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:12.611451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168459+0000","last_change":"2024-05-10T04:51:33.165989+0000","last_active":"2024-05-10T04:51:33.168459+0000","last_peered":"2024-05-10T04:51:33.168459+0000","last_clean":"2024-05-10T04:51:33.168459+0000","last_became_active":"2024-05-10T04:51:33.159406+0000","last_became_peered":"2024-05-10T04:51:33.159406+0000","last_unstale":"2024-05-10T04:51:33.168459+0000","last_undegraded":"2024-05-10T04:51:33.168459+0000","last_fullsized":"2024-05-10T04:51:33.168459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:47.329908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159153+0000","last_change":"2024-05-10T04:51:32.566262+0000","last_active":"2024-05-10T04:51:33.159153+0000","last_peered":"2024-05-10T04:51:33.159153+0000","last_clean":"2024-05-10T04:51:33.159153+0000","last_became_active":"2024-05-10T04:51:32.565767+0000","last_became_peered":"2024-05-10T04:51:32.565767+0000","last_unstale":"2024-05-10T04:51:33.159153+0000","last_undegraded":"2024-05-10T04:51:33.159153+0000","last_fullsized":"2024-05-10T04:51:33.159153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:33:19.494459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.161687+0000","last_change":"2024-05-10T04:51:33.158542+0000","last_active":"2024-05-10T04:51:33.161687+0000","last_peered":"2024-05-10T04:51:33.161687+0000","last_clean":"2024-05-10T04:51:33.161687+0000","last_became_active":"2024-05-10T04:51:33.158196+0000","last_became_peered":"2024-05-10T04:51:33.158196+0000","last_unstale":"2024-05-10T04:51:33.161687+0000","last_undegraded":"2024-05-10T04:51:33.161687+0000","last_fullsized":"2024-05-10T04:51:33.161687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:03:42.513724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.170112+0000","last_change":"2024-05-10T04:51:32.565265+0000","last_active":"2024-05-10T04:51:33.170112+0000","last_peered":"2024-05-10T04:51:33.170112+0000","last_clean":"2024-05-10T04:51:33.170112+0000","last_became_active":"2024-05-10T04:51:32.564964+0000","last_became_peered":"2024-05-10T04:51:32.564964+0000","last_unstale":"2024-05-10T04:51:33.170112+0000","last_undegraded":"2024-05-10T04:51:33.170112+0000","last_fullsized":"2024-05-10T04:51:33.170112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:53:39.259816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167013+0000","last_change":"2024-05-10T04:51:33.164318+0000","last_active":"2024-05-10T04:51:33.167013+0000","last_peered":"2024-05-10T04:51:33.167013+0000","last_clean":"2024-05-10T04:51:33.167013+0000","last_became_active":"2024-05-10T04:51:33.164015+0000","last_became_peered":"2024-05-10T04:51:33.164015+0000","last_unstale":"2024-05-10T04:51:33.167013+0000","last_undegraded":"2024-05-10T04:51:33.167013+0000","last_fullsized":"2024-05-10T04:51:33.167013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:22.784368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.170087+0000","last_change":"2024-05-10T04:51:32.566066+0000","last_active":"2024-05-10T04:51:33.170087+0000","last_peered":"2024-05-10T04:51:33.170087+0000","last_clean":"2024-05-10T04:51:33.170087+0000","last_became_active":"2024-05-10T04:51:32.565776+0000","last_became_peered":"2024-05-10T04:51:32.565776+0000","last_unstale":"2024-05-10T04:51:33.170087+0000","last_undegraded":"2024-05-10T04:51:33.170087+0000","last_fullsized":"2024-05-10T04:51:33.170087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:47.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.157859+0000","last_change":"2024-05-10T04:51:33.146922+0000","last_active":"2024-05-10T04:51:33.157859+0000","last_peered":"2024-05-10T04:51:33.157859+0000","last_clean":"2024-05-10T04:51:33.157859+0000","last_became_active":"2024-05-10T04:51:33.146482+0000","last_became_peered":"2024-05-10T04:51:33.146482+0000","last_unstale":"2024-05-10T04:51:33.157859+0000","last_undegraded":"2024-05-10T04:51:33.157859+0000","last_fullsized":"2024-05-10T04:51:33.157859+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:53.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.129681+0000","last_change":"2024-05-10T04:51:32.555121+0000","last_active":"2024-05-10T04:51:33.129681+0000","last_peered":"2024-05-10T04:51:33.129681+0000","last_clean":"2024-05-10T04:51:33.129681+0000","last_became_active":"2024-05-10T04:51:32.554838+0000","last_became_peered":"2024-05-10T04:51:32.554838+0000","last_unstale":"2024-05-10T04:51:33.129681+0000","last_undegraded":"2024-05-10T04:51:33.129681+0000","last_fullsized":"2024-05-10T04:51:33.129681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:58:17.933313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167311+0000","last_change":"2024-05-10T04:51:33.161253+0000","last_active":"2024-05-10T04:51:33.167311+0000","last_peered":"2024-05-10T04:51:33.167311+0000","last_clean":"2024-05-10T04:51:33.167311+0000","last_became_active":"2024-05-10T04:51:33.160132+0000","last_became_peered":"2024-05-10T04:51:33.160132+0000","last_unstale":"2024-05-10T04:51:33.167311+0000","last_undegraded":"2024-05-10T04:51:33.167311+0000","last_fullsized":"2024-05-10T04:51:33.167311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:27:56.587168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.132604+0000","last_change":"2024-05-10T04:51:32.566522+0000","last_active":"2024-05-10T04:51:33.132604+0000","last_peered":"2024-05-10T04:51:33.132604+0000","last_clean":"2024-05-10T04:51:33.132604+0000","last_became_active":"2024-05-10T04:51:32.565421+0000","last_became_peered":"2024-05-10T04:51:32.565421+0000","last_unstale":"2024-05-10T04:51:33.132604+0000","last_undegraded":"2024-05-10T04:51:33.132604+0000","last_fullsized":"2024-05-10T04:51:33.132604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:34:37.876663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159549+0000","last_change":"2024-05-10T04:51:33.148694+0000","last_active":"2024-05-10T04:51:33.159549+0000","last_peered":"2024-05-10T04:51:33.159549+0000","last_clean":"2024-05-10T04:51:33.159549+0000","last_became_active":"2024-05-10T04:51:33.148379+0000","last_became_peered":"2024-05-10T04:51:33.148379+0000","last_unstale":"2024-05-10T04:51:33.159549+0000","last_undegraded":"2024-05-10T04:51:33.159549+0000","last_fullsized":"2024-05-10T04:51:33.159549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:15.474173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.130440+0000","last_change":"2024-05-10T04:51:32.562908+0000","last_active":"2024-05-10T04:51:33.130440+0000","last_peered":"2024-05-10T04:51:33.130440+0000","last_clean":"2024-05-10T04:51:33.130440+0000","last_became_active":"2024-05-10T04:51:32.562637+0000","last_became_peered":"2024-05-10T04:51:32.562637+0000","last_unstale":"2024-05-10T04:51:33.130440+0000","last_undegraded":"2024-05-10T04:51:33.130440+0000","last_fullsized":"2024-05-10T04:51:33.130440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:50:31.051444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.171623+0000","last_change":"2024-05-10T04:51:33.163093+0000","last_active":"2024-05-10T04:51:33.171623+0000","last_peered":"2024-05-10T04:51:33.171623+0000","last_clean":"2024-05-10T04:51:33.171623+0000","last_became_active":"2024-05-10T04:51:33.162795+0000","last_became_peered":"2024-05-10T04:51:33.162795+0000","last_unstale":"2024-05-10T04:51:33.171623+0000","last_undegraded":"2024-05-10T04:51:33.171623+0000","last_fullsized":"2024-05-10T04:51:33.171623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:07:02.361391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.150128+0000","last_change":"2024-05-10T04:51:32.558292+0000","last_active":"2024-05-10T04:51:33.150128+0000","last_peered":"2024-05-10T04:51:33.150128+0000","last_clean":"2024-05-10T04:51:33.150128+0000","last_became_active":"2024-05-10T04:51:32.556956+0000","last_became_peered":"2024-05-10T04:51:32.556956+0000","last_unstale":"2024-05-10T04:51:33.150128+0000","last_undegraded":"2024-05-10T04:51:33.150128+0000","last_fullsized":"2024-05-10T04:51:33.150128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:05.557807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.144658+0000","last_change":"2024-05-10T04:51:33.139868+0000","last_active":"2024-05-10T04:51:33.144658+0000","last_peered":"2024-05-10T04:51:33.144658+0000","last_clean":"2024-05-10T04:51:33.144658+0000","last_became_active":"2024-05-10T04:51:33.139604+0000","last_became_peered":"2024-05-10T04:51:33.139604+0000","last_unstale":"2024-05-10T04:51:33.144658+0000","last_undegraded":"2024-05-10T04:51:33.144658+0000","last_fullsized":"2024-05-10T04:51:33.144658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:03:42.513724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.165458+0000","last_change":"2024-05-10T04:51:32.564236+0000","last_active":"2024-05-10T04:51:33.165458+0000","last_peered":"2024-05-10T04:51:33.165458+0000","last_clean":"2024-05-10T04:51:33.165458+0000","last_became_active":"2024-05-10T04:51:32.563926+0000","last_became_peered":"2024-05-10T04:51:32.563926+0000","last_unstale":"2024-05-10T04:51:33.165458+0000","last_undegraded":"2024-05-10T04:51:33.165458+0000","last_fullsized":"2024-05-10T04:51:33.165458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:12.611451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168464+0000","last_change":"2024-05-10T04:51:33.166728+0000","last_active":"2024-05-10T04:51:33.168464+0000","last_peered":"2024-05-10T04:51:33.168464+0000","last_clean":"2024-05-10T04:51:33.168464+0000","last_became_active":"2024-05-10T04:51:33.166431+0000","last_became_peered":"2024-05-10T04:51:33.166431+0000","last_unstale":"2024-05-10T04:51:33.168464+0000","last_undegraded":"2024-05-10T04:51:33.168464+0000","last_fullsized":"2024-05-10T04:51:33.168464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:07.739150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.179724+0000","last_change":"2024-05-10T04:51:32.570057+0000","last_active":"2024-05-10T04:51:33.179724+0000","last_peered":"2024-05-10T04:51:33.179724+0000","last_clean":"2024-05-10T04:51:33.179724+0000","last_became_active":"2024-05-10T04:51:32.569773+0000","last_became_peered":"2024-05-10T04:51:32.569773+0000","last_unstale":"2024-05-10T04:51:33.179724+0000","last_undegraded":"2024-05-10T04:51:33.179724+0000","last_fullsized":"2024-05-10T04:51:33.179724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:52.083841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.159940+0000","last_change":"2024-05-10T04:51:33.154519+0000","last_active":"2024-05-10T04:51:33.159940+0000","last_peered":"2024-05-10T04:51:33.159940+0000","last_clean":"2024-05-10T04:51:33.159940+0000","last_became_active":"2024-05-10T04:51:33.154245+0000","last_became_peered":"2024-05-10T04:51:33.154245+0000","last_unstale":"2024-05-10T04:51:33.159940+0000","last_undegraded":"2024-05-10T04:51:33.159940+0000","last_fullsized":"2024-05-10T04:51:33.159940+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:21.431928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162737+0000","last_change":"2024-05-10T04:51:32.564552+0000","last_active":"2024-05-10T04:51:33.162737+0000","last_peered":"2024-05-10T04:51:33.162737+0000","last_clean":"2024-05-10T04:51:33.162737+0000","last_became_active":"2024-05-10T04:51:32.564264+0000","last_became_peered":"2024-05-10T04:51:32.564264+0000","last_unstale":"2024-05-10T04:51:33.162737+0000","last_undegraded":"2024-05-10T04:51:33.162737+0000","last_fullsized":"2024-05-10T04:51:33.162737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:54:36.895126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.171941+0000","last_change":"2024-05-10T04:51:33.164771+0000","last_active":"2024-05-10T04:51:33.171941+0000","last_peered":"2024-05-10T04:51:33.171941+0000","last_clean":"2024-05-10T04:51:33.171941+0000","last_became_active":"2024-05-10T04:51:33.164227+0000","last_became_peered":"2024-05-10T04:51:33.164227+0000","last_unstale":"2024-05-10T04:51:33.171941+0000","last_undegraded":"2024-05-10T04:51:33.171941+0000","last_fullsized":"2024-05-10T04:51:33.171941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:07.739150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.140885+0000","last_change":"2024-05-10T04:51:32.564537+0000","last_active":"2024-05-10T04:51:33.140885+0000","last_peered":"2024-05-10T04:51:33.140885+0000","last_clean":"2024-05-10T04:51:33.140885+0000","last_became_active":"2024-05-10T04:51:32.564177+0000","last_became_peered":"2024-05-10T04:51:32.564177+0000","last_unstale":"2024-05-10T04:51:33.140885+0000","last_undegraded":"2024-05-10T04:51:33.140885+0000","last_fullsized":"2024-05-10T04:51:33.140885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:50:31.051444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158732+0000","last_change":"2024-05-10T04:51:33.144840+0000","last_active":"2024-05-10T04:51:33.158732+0000","last_peered":"2024-05-10T04:51:33.158732+0000","last_clean":"2024-05-10T04:51:33.158732+0000","last_became_active":"2024-05-10T04:51:33.144524+0000","last_became_peered":"2024-05-10T04:51:33.144524+0000","last_unstale":"2024-05-10T04:51:33.158732+0000","last_undegraded":"2024-05-10T04:51:33.158732+0000","last_fullsized":"2024-05-10T04:51:33.158732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:33:15.474173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.129785+0000","last_change":"2024-05-10T04:51:32.562815+0000","last_active":"2024-05-10T04:51:33.129785+0000","last_peered":"2024-05-10T04:51:33.129785+0000","last_clean":"2024-05-10T04:51:33.129785+0000","last_became_active":"2024-05-10T04:51:32.562362+0000","last_became_peered":"2024-05-10T04:51:32.562362+0000","last_unstale":"2024-05-10T04:51:33.129785+0000","last_undegraded":"2024-05-10T04:51:33.129785+0000","last_fullsized":"2024-05-10T04:51:33.129785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:21.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.153814+0000","last_change":"2024-05-10T04:51:33.149475+0000","last_active":"2024-05-10T04:51:33.153814+0000","last_peered":"2024-05-10T04:51:33.153814+0000","last_clean":"2024-05-10T04:51:33.153814+0000","last_became_active":"2024-05-10T04:51:33.149124+0000","last_became_peered":"2024-05-10T04:51:33.149124+0000","last_unstale":"2024-05-10T04:51:33.153814+0000","last_undegraded":"2024-05-10T04:51:33.153814+0000","last_fullsized":"2024-05-10T04:51:33.153814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:21:47.329908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.180026+0000","last_change":"2024-05-10T04:51:32.570251+0000","last_active":"2024-05-10T04:51:33.180026+0000","last_peered":"2024-05-10T04:51:33.180026+0000","last_clean":"2024-05-10T04:51:33.180026+0000","last_became_active":"2024-05-10T04:51:32.569912+0000","last_became_peered":"2024-05-10T04:51:32.569912+0000","last_unstale":"2024-05-10T04:51:33.180026+0000","last_undegraded":"2024-05-10T04:51:33.180026+0000","last_fullsized":"2024-05-10T04:51:33.180026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:33.601555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.163527+0000","last_change":"2024-05-10T04:51:33.156001+0000","last_active":"2024-05-10T04:51:33.163527+0000","last_peered":"2024-05-10T04:51:33.163527+0000","last_clean":"2024-05-10T04:51:33.163527+0000","last_became_active":"2024-05-10T04:51:33.154367+0000","last_became_peered":"2024-05-10T04:51:33.154367+0000","last_unstale":"2024-05-10T04:51:33.163527+0000","last_undegraded":"2024-05-10T04:51:33.163527+0000","last_fullsized":"2024-05-10T04:51:33.163527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:27.441656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.170132+0000","last_change":"2024-05-10T04:51:32.566132+0000","last_active":"2024-05-10T04:51:33.170132+0000","last_peered":"2024-05-10T04:51:33.170132+0000","last_clean":"2024-05-10T04:51:33.170132+0000","last_became_active":"2024-05-10T04:51:32.565832+0000","last_became_peered":"2024-05-10T04:51:32.565832+0000","last_unstale":"2024-05-10T04:51:33.170132+0000","last_undegraded":"2024-05-10T04:51:33.170132+0000","last_fullsized":"2024-05-10T04:51:33.170132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:20:18.461147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166929+0000","last_change":"2024-05-10T04:51:33.161025+0000","last_active":"2024-05-10T04:51:33.166929+0000","last_peered":"2024-05-10T04:51:33.166929+0000","last_clean":"2024-05-10T04:51:33.166929+0000","last_became_active":"2024-05-10T04:51:33.159994+0000","last_became_peered":"2024-05-10T04:51:33.159994+0000","last_unstale":"2024-05-10T04:51:33.166929+0000","last_undegraded":"2024-05-10T04:51:33.166929+0000","last_fullsized":"2024-05-10T04:51:33.166929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:34:01.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162917+0000","last_change":"2024-05-10T04:51:32.566726+0000","last_active":"2024-05-10T04:51:33.162917+0000","last_peered":"2024-05-10T04:51:33.162917+0000","last_clean":"2024-05-10T04:51:33.162917+0000","last_became_active":"2024-05-10T04:51:32.566404+0000","last_became_peered":"2024-05-10T04:51:32.566404+0000","last_unstale":"2024-05-10T04:51:33.162917+0000","last_undegraded":"2024-05-10T04:51:33.162917+0000","last_fullsized":"2024-05-10T04:51:33.162917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:19:50.178207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167270+0000","last_change":"2024-05-10T04:51:33.160950+0000","last_active":"2024-05-10T04:51:33.167270+0000","last_peered":"2024-05-10T04:51:33.167270+0000","last_clean":"2024-05-10T04:51:33.167270+0000","last_became_active":"2024-05-10T04:51:33.160785+0000","last_became_peered":"2024-05-10T04:51:33.160785+0000","last_unstale":"2024-05-10T04:51:33.167270+0000","last_undegraded":"2024-05-10T04:51:33.167270+0000","last_fullsized":"2024-05-10T04:51:33.167270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:07.953438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.164996+0000","last_change":"2024-05-10T04:51:32.562931+0000","last_active":"2024-05-10T04:51:33.164996+0000","last_peered":"2024-05-10T04:51:33.164996+0000","last_clean":"2024-05-10T04:51:33.164996+0000","last_became_active":"2024-05-10T04:51:32.562610+0000","last_became_peered":"2024-05-10T04:51:32.562610+0000","last_unstale":"2024-05-10T04:51:33.164996+0000","last_undegraded":"2024-05-10T04:51:33.164996+0000","last_fullsized":"2024-05-10T04:51:33.164996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:01:21.723243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.167871+0000","last_change":"2024-05-10T04:51:33.160807+0000","last_active":"2024-05-10T04:51:33.167871+0000","last_peered":"2024-05-10T04:51:33.167871+0000","last_clean":"2024-05-10T04:51:33.167871+0000","last_became_active":"2024-05-10T04:51:33.160524+0000","last_became_peered":"2024-05-10T04:51:33.160524+0000","last_unstale":"2024-05-10T04:51:33.167871+0000","last_undegraded":"2024-05-10T04:51:33.167871+0000","last_fullsized":"2024-05-10T04:51:33.167871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:53.092401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.134261+0000","last_change":"2024-05-10T04:51:32.569232+0000","last_active":"2024-05-10T04:51:33.134261+0000","last_peered":"2024-05-10T04:51:33.134261+0000","last_clean":"2024-05-10T04:51:33.134261+0000","last_became_active":"2024-05-10T04:51:32.568909+0000","last_became_peered":"2024-05-10T04:51:32.568909+0000","last_unstale":"2024-05-10T04:51:33.134261+0000","last_undegraded":"2024-05-10T04:51:33.134261+0000","last_fullsized":"2024-05-10T04:51:33.134261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:33:19.494459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.158992+0000","last_change":"2024-05-10T04:51:33.151567+0000","last_active":"2024-05-10T04:51:33.158992+0000","last_peered":"2024-05-10T04:51:33.158992+0000","last_clean":"2024-05-10T04:51:33.158992+0000","last_became_active":"2024-05-10T04:51:33.151259+0000","last_became_peered":"2024-05-10T04:51:33.151259+0000","last_unstale":"2024-05-10T04:51:33.158992+0000","last_undegraded":"2024-05-10T04:51:33.158992+0000","last_fullsized":"2024-05-10T04:51:33.158992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:03.842436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.169116+0000","last_change":"2024-05-10T04:51:32.559781+0000","last_active":"2024-05-10T04:51:33.169116+0000","last_peered":"2024-05-10T04:51:33.169116+0000","last_clean":"2024-05-10T04:51:33.169116+0000","last_became_active":"2024-05-10T04:51:32.559514+0000","last_became_peered":"2024-05-10T04:51:32.559514+0000","last_unstale":"2024-05-10T04:51:33.169116+0000","last_undegraded":"2024-05-10T04:51:33.169116+0000","last_fullsized":"2024-05-10T04:51:33.169116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:33:19.494459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.168446+0000","last_change":"2024-05-10T04:51:33.165548+0000","last_active":"2024-05-10T04:51:33.168446+0000","last_peered":"2024-05-10T04:51:33.168446+0000","last_clean":"2024-05-10T04:51:33.168446+0000","last_became_active":"2024-05-10T04:51:33.160996+0000","last_became_peered":"2024-05-10T04:51:33.160996+0000","last_unstale":"2024-05-10T04:51:33.168446+0000","last_undegraded":"2024-05-10T04:51:33.168446+0000","last_fullsized":"2024-05-10T04:51:33.168446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:34.610114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.143274+0000","last_change":"2024-05-10T04:51:32.565063+0000","last_active":"2024-05-10T04:51:33.143274+0000","last_peered":"2024-05-10T04:51:33.143274+0000","last_clean":"2024-05-10T04:51:33.143274+0000","last_became_active":"2024-05-10T04:51:32.564678+0000","last_became_peered":"2024-05-10T04:51:32.564678+0000","last_unstale":"2024-05-10T04:51:33.143274+0000","last_undegraded":"2024-05-10T04:51:33.143274+0000","last_fullsized":"2024-05-10T04:51:33.143274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:33.601555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.164944+0000","last_change":"2024-05-10T04:51:33.156515+0000","last_active":"2024-05-10T04:51:33.164944+0000","last_peered":"2024-05-10T04:51:33.164944+0000","last_clean":"2024-05-10T04:51:33.164944+0000","last_became_active":"2024-05-10T04:51:33.156278+0000","last_became_peered":"2024-05-10T04:51:33.156278+0000","last_unstale":"2024-05-10T04:51:33.164944+0000","last_undegraded":"2024-05-10T04:51:33.164944+0000","last_fullsized":"2024-05-10T04:51:33.164944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:18:31.463323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.131802+0000","last_change":"2024-05-10T04:51:32.568412+0000","last_active":"2024-05-10T04:51:33.131802+0000","last_peered":"2024-05-10T04:51:33.131802+0000","last_clean":"2024-05-10T04:51:33.131802+0000","last_became_active":"2024-05-10T04:51:32.567696+0000","last_became_peered":"2024-05-10T04:51:32.567696+0000","last_unstale":"2024-05-10T04:51:33.131802+0000","last_undegraded":"2024-05-10T04:51:33.131802+0000","last_fullsized":"2024-05-10T04:51:33.131802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:00:51.934015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.160192+0000","last_change":"2024-05-10T04:51:33.150718+0000","last_active":"2024-05-10T04:51:33.160192+0000","last_peered":"2024-05-10T04:51:33.160192+0000","last_clean":"2024-05-10T04:51:33.160192+0000","last_became_active":"2024-05-10T04:51:33.150409+0000","last_became_peered":"2024-05-10T04:51:33.150409+0000","last_unstale":"2024-05-10T04:51:33.160192+0000","last_undegraded":"2024-05-10T04:51:33.160192+0000","last_fullsized":"2024-05-10T04:51:33.160192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:34:01.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.139457+0000","last_change":"2024-05-10T04:51:32.561515+0000","last_active":"2024-05-10T04:51:33.139457+0000","last_peered":"2024-05-10T04:51:33.139457+0000","last_clean":"2024-05-10T04:51:33.139457+0000","last_became_active":"2024-05-10T04:51:32.561191+0000","last_became_peered":"2024-05-10T04:51:32.561191+0000","last_unstale":"2024-05-10T04:51:33.139457+0000","last_undegraded":"2024-05-10T04:51:33.139457+0000","last_fullsized":"2024-05-10T04:51:33.139457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:24:52.083841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.170597+0000","last_change":"2024-05-10T04:51:33.167263+0000","last_active":"2024-05-10T04:51:33.170597+0000","last_peered":"2024-05-10T04:51:33.170597+0000","last_clean":"2024-05-10T04:51:33.170597+0000","last_became_active":"2024-05-10T04:51:33.167007+0000","last_became_peered":"2024-05-10T04:51:33.167007+0000","last_unstale":"2024-05-10T04:51:33.170597+0000","last_undegraded":"2024-05-10T04:51:33.170597+0000","last_fullsized":"2024-05-10T04:51:33.170597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:58:18.941872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.165682+0000","last_change":"2024-05-10T04:51:32.568282+0000","last_active":"2024-05-10T04:51:33.165682+0000","last_peered":"2024-05-10T04:51:33.165682+0000","last_clean":"2024-05-10T04:51:33.165682+0000","last_became_active":"2024-05-10T04:51:32.566265+0000","last_became_peered":"2024-05-10T04:51:32.566265+0000","last_unstale":"2024-05-10T04:51:33.165682+0000","last_undegraded":"2024-05-10T04:51:33.165682+0000","last_fullsized":"2024-05-10T04:51:33.165682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:50:54.150448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.166259+0000","last_change":"2024-05-10T04:51:33.157956+0000","last_active":"2024-05-10T04:51:33.166259+0000","last_peered":"2024-05-10T04:51:33.166259+0000","last_clean":"2024-05-10T04:51:33.166259+0000","last_became_active":"2024-05-10T04:51:33.157104+0000","last_became_peered":"2024-05-10T04:51:33.157104+0000","last_unstale":"2024-05-10T04:51:33.166259+0000","last_undegraded":"2024-05-10T04:51:33.166259+0000","last_fullsized":"2024-05-10T04:51:33.166259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:49.507207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.150229+0000","last_change":"2024-05-10T04:51:32.556253+0000","last_active":"2024-05-10T04:51:33.150229+0000","last_peered":"2024-05-10T04:51:33.150229+0000","last_clean":"2024-05-10T04:51:33.150229+0000","last_became_active":"2024-05-10T04:51:32.555971+0000","last_became_peered":"2024-05-10T04:51:32.555971+0000","last_unstale":"2024-05-10T04:51:33.150229+0000","last_undegraded":"2024-05-10T04:51:33.150229+0000","last_fullsized":"2024-05-10T04:51:33.150229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:53:39.259816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162171+0000","last_change":"2024-05-10T04:51:33.153847+0000","last_active":"2024-05-10T04:51:33.162171+0000","last_peered":"2024-05-10T04:51:33.162171+0000","last_clean":"2024-05-10T04:51:33.162171+0000","last_became_active":"2024-05-10T04:51:33.153576+0000","last_became_peered":"2024-05-10T04:51:33.153576+0000","last_unstale":"2024-05-10T04:51:33.162171+0000","last_undegraded":"2024-05-10T04:51:33.162171+0000","last_fullsized":"2024-05-10T04:51:33.162171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:22.566748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.140563+0000","last_change":"2024-05-10T04:51:32.562261+0000","last_active":"2024-05-10T04:51:33.140563+0000","last_peered":"2024-05-10T04:51:33.140563+0000","last_clean":"2024-05-10T04:51:33.140563+0000","last_became_active":"2024-05-10T04:51:32.561949+0000","last_became_peered":"2024-05-10T04:51:32.561949+0000","last_unstale":"2024-05-10T04:51:33.140563+0000","last_undegraded":"2024-05-10T04:51:33.140563+0000","last_fullsized":"2024-05-10T04:51:33.140563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:21.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.162848+0000","last_change":"2024-05-10T04:51:33.158719+0000","last_active":"2024-05-10T04:51:33.162848+0000","last_peered":"2024-05-10T04:51:33.162848+0000","last_clean":"2024-05-10T04:51:33.162848+0000","last_became_active":"2024-05-10T04:51:33.157935+0000","last_became_peered":"2024-05-10T04:51:33.157935+0000","last_unstale":"2024-05-10T04:51:33.162848+0000","last_undegraded":"2024-05-10T04:51:33.162848+0000","last_fullsized":"2024-05-10T04:51:33.162848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:21.431928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.153652+0000","last_change":"2024-05-10T04:51:32.559856+0000","last_active":"2024-05-10T04:51:33.153652+0000","last_peered":"2024-05-10T04:51:33.153652+0000","last_clean":"2024-05-10T04:51:33.153652+0000","last_became_active":"2024-05-10T04:51:32.559575+0000","last_became_peered":"2024-05-10T04:51:32.559575+0000","last_unstale":"2024-05-10T04:51:33.153652+0000","last_undegraded":"2024-05-10T04:51:33.153652+0000","last_fullsized":"2024-05-10T04:51:33.153652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:49:47.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.165065+0000","last_change":"2024-05-10T04:51:33.157702+0000","last_active":"2024-05-10T04:51:33.165065+0000","last_peered":"2024-05-10T04:51:33.165065+0000","last_clean":"2024-05-10T04:51:33.165065+0000","last_became_active":"2024-05-10T04:51:33.157488+0000","last_became_peered":"2024-05-10T04:51:33.157488+0000","last_unstale":"2024-05-10T04:51:33.165065+0000","last_undegraded":"2024-05-10T04:51:33.165065+0000","last_fullsized":"2024-05-10T04:51:33.165065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:50:32.060003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.140789+0000","last_change":"2024-05-10T04:51:32.568035+0000","last_active":"2024-05-10T04:51:33.140789+0000","last_peered":"2024-05-10T04:51:33.140789+0000","last_clean":"2024-05-10T04:51:33.140789+0000","last_became_active":"2024-05-10T04:51:32.567737+0000","last_became_peered":"2024-05-10T04:51:32.567737+0000","last_unstale":"2024-05-10T04:51:33.140789+0000","last_undegraded":"2024-05-10T04:51:33.140789+0000","last_fullsized":"2024-05-10T04:51:33.140789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:28.440834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.173831+0000","last_change":"2024-05-10T04:51:33.165945+0000","last_active":"2024-05-10T04:51:33.173831+0000","last_peered":"2024-05-10T04:51:33.173831+0000","last_clean":"2024-05-10T04:51:33.173831+0000","last_became_active":"2024-05-10T04:51:33.162780+0000","last_became_peered":"2024-05-10T04:51:33.162780+0000","last_unstale":"2024-05-10T04:51:33.173831+0000","last_undegraded":"2024-05-10T04:51:33.173831+0000","last_fullsized":"2024-05-10T04:51:33.173831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:34:49.507207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.131912+0000","last_change":"2024-05-10T04:51:32.568499+0000","last_active":"2024-05-10T04:51:33.131912+0000","last_peered":"2024-05-10T04:51:33.131912+0000","last_clean":"2024-05-10T04:51:33.131912+0000","last_became_active":"2024-05-10T04:51:32.568151+0000","last_became_peered":"2024-05-10T04:51:32.568151+0000","last_unstale":"2024-05-10T04:51:33.131912+0000","last_undegraded":"2024-05-10T04:51:33.131912+0000","last_fullsized":"2024-05-10T04:51:33.131912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:05:10.901243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.151746+0000","last_change":"2024-05-10T04:51:33.141481+0000","last_active":"2024-05-10T04:51:33.151746+0000","last_peered":"2024-05-10T04:51:33.151746+0000","last_clean":"2024-05-10T04:51:33.151746+0000","last_became_active":"2024-05-10T04:51:33.141171+0000","last_became_peered":"2024-05-10T04:51:33.141171+0000","last_unstale":"2024-05-10T04:51:33.151746+0000","last_undegraded":"2024-05-10T04:51:33.151746+0000","last_fullsized":"2024-05-10T04:51:33.151746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:58:18.941872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.129820+0000","last_change":"2024-05-10T04:51:32.562544+0000","last_active":"2024-05-10T04:51:33.129820+0000","last_peered":"2024-05-10T04:51:33.129820+0000","last_clean":"2024-05-10T04:51:33.129820+0000","last_became_active":"2024-05-10T04:51:32.558080+0000","last_became_peered":"2024-05-10T04:51:32.558080+0000","last_unstale":"2024-05-10T04:51:33.129820+0000","last_undegraded":"2024-05-10T04:51:33.129820+0000","last_fullsized":"2024-05-10T04:51:33.129820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:23:01.074466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.161720+0000","last_change":"2024-05-10T04:51:33.158643+0000","last_active":"2024-05-10T04:51:33.161720+0000","last_peered":"2024-05-10T04:51:33.161720+0000","last_clean":"2024-05-10T04:51:33.161720+0000","last_became_active":"2024-05-10T04:51:33.157476+0000","last_became_peered":"2024-05-10T04:51:33.157476+0000","last_unstale":"2024-05-10T04:51:33.161720+0000","last_undegraded":"2024-05-10T04:51:33.161720+0000","last_fullsized":"2024-05-10T04:51:33.161720+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:32.533332+0000","last_clean_scrub_stamp":"2024-05-10T04:51:32.533332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:28.154722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-10T04:51:33.142191+0000","last_change":"2024-05-10T04:51:32.567486+0000","last_active":"2024-05-10T04:51:33.142191+0000","last_peered":"2024-05-10T04:51:33.142191+0000","last_clean":"2024-05-10T04:51:33.142191+0000","last_became_active":"2024-05-10T04:51:32.566869+0000","last_became_peered":"2024-05-10T04:51:32.566869+0000","last_unstale":"2024-05-10T04:51:33.142191+0000","last_undegraded":"2024-05-10T04:51:33.142191+0000","last_fullsized":"2024-05-10T04:51:33.142191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:31.524773+0000","last_clean_scrub_stamp":"2024-05-10T04:51:31.524773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:12.611451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-10T04:51:32.554994+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:51:32.554994+0000","last_peered":"2024-05-10T04:51:32.554994+0000","last_clean":"2024-05-10T04:51:32.554994+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:51:32.554994+0000","last_undegraded":"2024-05-10T04:51:32.554994+0000","last_fullsized":"2024-05-10T04:51:32.554994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":740886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79700000000000004}]},{"osd":4,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri May 10 04:51:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.77300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.94599999999999995}]},{"osd":3,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.755}]},{"osd":7,"last update":"Fri May 10 04:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":152014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]},{"osd":2,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":740796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.754}]},{"osd":6,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri May 10 04:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":150498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":5.266,"5min":5.266,"15min":5.266},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.8140000000000001,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.316},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.8520000000000003,"5min":5.8520000000000003,"15min":5.8520000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.438}]},{"osd":4,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.7320000000000002,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":5.8090000000000002,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.754},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.8149999999999999,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":5.6829999999999998,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.79700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":152014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.437},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.751}]},{"osd":6,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.81899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":150532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.629}]},{"osd":1,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.0670000000000002,"5min":5.0670000000000002,"15min":5.0670000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.871}]},{"osd":3,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.753}]},{"osd":5,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":1.036},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.90400000000000003}]},{"osd":7,"last update":"Fri May 10 04:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":1.008},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.92700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.748}]},{"osd":4,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri May 10 04:51:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.878}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:51:39.439 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-10T04:51:39.439 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-10T04:51:39.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.746+0000 7f9841200700 1 Processor -- start 2024-05-10T04:51:39.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.746+0000 7f9841200700 1 -- start start 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.748+0000 7f9841200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b98e0 0x7f983c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.748+0000 7f9841200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f983c0b6230 0x7f983c0d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.748+0000 7f9841200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c0d0ed0 con 0x7f983c0d0ac0 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.748+0000 7f9841200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c0d2e50 con 0x7f983c0b6230 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.748+0000 7f9841200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0d3130 con 0x7f983c0b98e0 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.748+0000 7f9833e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f983c0b6230 0x7f983c0d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.748+0000 7f9833e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f983c0b6230 0x7f983c0d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54014/0 (socket says 172.21.15.82:54014) 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.748+0000 7f9833e00700 1 -- 172.21.15.82:0/271601270 learned_addr learned my addr 172.21.15.82:0/271601270 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f983b400700 1 --2- 172.21.15.82:0/271601270 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b98e0 0x7f983c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f9833e00700 1 -- 172.21.15.82:0/271601270 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b98e0 msgr2=0x7f983c0d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f9833e00700 1 --2- 172.21.15.82:0/271601270 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b98e0 0x7f983c0d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f9833e00700 1 -- 172.21.15.82:0/271601270 >> v1:172.21.15.129:6789/0 conn(0x7f983c0d0ac0 legacy=0x7f983c15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f9833e00700 1 -- 172.21.15.82:0/271601270 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c0d3410 con 0x7f983c0b6230 2024-05-10T04:51:39.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f9833e00700 1 --2- 172.21.15.82:0/271601270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0b6230 0x7f983c0d0580 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f98240098f0 tx=0x7f9824009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1da16d162ed051 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:39.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f983aa00700 1 -- 172.21.15.82:0/271601270 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982400b8a0 con 0x7f983c0b6230 2024-05-10T04:51:39.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f983aa00700 1 -- 172.21.15.82:0/271601270 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982400ba00 con 0x7f983c0b6230 2024-05-10T04:51:39.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.749+0000 7f983aa00700 1 -- 172.21.15.82:0/271601270 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982400bd90 con 0x7f983c0b6230 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.750+0000 7f9841200700 1 -- 172.21.15.82:0/271601270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0b6230 msgr2=0x7f983c0d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.750+0000 7f9841200700 1 --2- 172.21.15.82:0/271601270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0b6230 0x7f983c0d0580 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f98240098f0 tx=0x7f9824009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.750+0000 7f9841200700 1 -- 172.21.15.82:0/271601270 shutdown_connections 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.750+0000 7f9841200700 1 --2- 172.21.15.82:0/271601270 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b98e0 0x7f983c0d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.750+0000 7f9841200700 1 --2- 172.21.15.82:0/271601270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0b6230 0x7f983c0d0580 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.750+0000 7f9841200700 1 -- 172.21.15.82:0/271601270 >> 172.21.15.82:0/271601270 conn(0x7f983c0676c0 msgr2=0x7f983c06c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.750+0000 7f9841200700 1 -- 172.21.15.82:0/271601270 shutdown_connections 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.750+0000 7f9841200700 1 -- 172.21.15.82:0/271601270 wait complete. 2024-05-10T04:51:39.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.752+0000 7f9841200700 1 Processor -- start 2024-05-10T04:51:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.753+0000 7f9841200700 1 -- start start 2024-05-10T04:51:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f9841200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b6230 0x7f983c1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f9841200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0b98e0 0x7f983c0c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f9841200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0d0ac0 0x7f983c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f9841200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c148df0 con 0x7f983c0d0ac0 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f9841200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c149220 con 0x7f983c0b98e0 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f9841200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c159210 con 0x7f983c0b6230 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f983be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0d0ac0 0x7f983c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f983be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0d0ac0 0x7f983c15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54028/0 (socket says 172.21.15.82:54028) 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.754+0000 7f983be00700 1 -- 172.21.15.82:0/1225949012 learned_addr learned my addr 172.21.15.82:0/1225949012 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f9833e00700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0b98e0 0x7f983c0c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f983b400700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b6230 0x7f983c1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f983be00700 1 -- 172.21.15.82:0/1225949012 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b6230 msgr2=0x7f983c1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f983be00700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b6230 0x7f983c1488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f983be00700 1 -- 172.21.15.82:0/1225949012 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0b98e0 msgr2=0x7f983c0c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f983be00700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0b98e0 0x7f983c0c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f983be00700 1 -- 172.21.15.82:0/1225949012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9824009550 con 0x7f983c0d0ac0 2024-05-10T04:51:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f983be00700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0d0ac0 0x7f983c15a500 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f983400cbf0 tx=0x7f98340021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f9833400700 1 -- 172.21.15.82:0/1225949012 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834003c00 con 0x7f983c0d0ac0 2024-05-10T04:51:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f9833400700 1 -- 172.21.15.82:0/1225949012 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9834003d60 con 0x7f983c0d0ac0 2024-05-10T04:51:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c15a070 con 0x7f983c0d0ac0 2024-05-10T04:51:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.755+0000 7f9833400700 1 -- 172.21.15.82:0/1225949012 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400ab80 con 0x7f983c0d0ac0 2024-05-10T04:51:39.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.756+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c0c9dd0 con 0x7f983c0d0ac0 2024-05-10T04:51:39.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.756+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c074af0 con 0x7f983c0d0ac0 2024-05-10T04:51:39.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.758+0000 7f9833400700 1 -- 172.21.15.82:0/1225949012 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f983400ace0 con 0x7f983c0d0ac0 2024-05-10T04:51:39.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.758+0000 7f9833400700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f981806ac90 0x7f981806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:39.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.759+0000 7f9833400700 1 -- 172.21.15.82:0/1225949012 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9834089400 con 0x7f983c0d0ac0 2024-05-10T04:51:39.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.759+0000 7f983b400700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f981806ac90 0x7f981806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:39.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.759+0000 7f983b400700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f981806ac90 0x7f981806d1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f982c00b9b0 tx=0x7f982c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:39.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:39.764+0000 7f9833400700 1 -- 172.21.15.82:0/1225949012 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9834054550 con 0x7f983c0d0ac0 2024-05-10T04:51:40.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.047+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f983c0d4630 con 0x7f983c0d0ac0 2024-05-10T04:51:40.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.052+0000 7f9833400700 1 -- 172.21.15.82:0/1225949012 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9834057b70 con 0x7f983c0d0ac0 2024-05-10T04:51:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f981806ac90 msgr2=0x7f981806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f981806ac90 0x7f981806d1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f982c00b9b0 tx=0x7f982c008040 comp rx=0 tx=0).stop 2024-05-10T04:51:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0d0ac0 msgr2=0x7f983c15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0d0ac0 0x7f983c15a500 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f983400cbf0 tx=0x7f98340021c0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 shutdown_connections 2024-05-10T04:51:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f981806ac90 0x7f981806d1a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f983c0d0ac0 0x7f983c15a500 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f983c0b6230 0x7f983c1488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 --2- 172.21.15.82:0/1225949012 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0b98e0 0x7f983c0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 >> 172.21.15.82:0/1225949012 conn(0x7f983c0676c0 msgr2=0x7f983c1e6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:40.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 shutdown_connections 2024-05-10T04:51:40.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.054+0000 7f9841200700 1 -- 172.21.15.82:0/1225949012 wait complete. 2024-05-10T04:51:40.057 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2024-05-10T04:51:40.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.342+0000 7f2de5c00700 1 Processor -- start 2024-05-10T04:51:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.342+0000 7f2de5c00700 1 -- start start 2024-05-10T04:51:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2de5c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2de00b31c0 0x7f2de00b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2de5c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2de00d04a0 0x7f2de006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2de5c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de006b8e0 con 0x7f2de0070640 2024-05-10T04:51:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2de5c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de006acd0 con 0x7f2de00b31c0 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2de5c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de006afb0 con 0x7f2de00d04a0 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2dde000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2de00b31c0 0x7f2de00b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2dde000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2de00b31c0 0x7f2de00b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54044/0 (socket says 172.21.15.82:54044) 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2dde000700 1 -- 172.21.15.82:0/3966189571 learned_addr learned my addr 172.21.15.82:0/3966189571 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2ddf400700 1 --2- 172.21.15.82:0/3966189571 >> v2:172.21.15.129:3300/0 conn(0x7f2de00d04a0 0x7f2de006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2dde000700 1 -- 172.21.15.82:0/3966189571 >> v2:172.21.15.129:3300/0 conn(0x7f2de00d04a0 msgr2=0x7f2de006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2dde000700 1 --2- 172.21.15.82:0/3966189571 >> v2:172.21.15.129:3300/0 conn(0x7f2de00d04a0 0x7f2de006e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2dde000700 1 -- 172.21.15.82:0/3966189571 >> v1:172.21.15.129:6789/0 conn(0x7f2de0070640 legacy=0x7f2de00cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.344+0000 7f2dde000700 1 -- 172.21.15.82:0/3966189571 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de006b290 con 0x7f2de00b31c0 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.345+0000 7f2dde000700 1 --2- 172.21.15.82:0/3966189571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00b31c0 0x7f2de00b5ed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2de00cb110 tx=0x7f2dcc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1cf973d409d964 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.345+0000 7f2ddd600700 1 -- 172.21.15.82:0/3966189571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00b870 con 0x7f2de00b31c0 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.345+0000 7f2ddd600700 1 -- 172.21.15.82:0/3966189571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc00b9d0 con 0x7f2de00b31c0 2024-05-10T04:51:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.345+0000 7f2ddd600700 1 -- 172.21.15.82:0/3966189571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00bd60 con 0x7f2de00b31c0 2024-05-10T04:51:40.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.346+0000 7f2de5c00700 1 -- 172.21.15.82:0/3966189571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00b31c0 msgr2=0x7f2de00b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:40.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.346+0000 7f2de5c00700 1 --2- 172.21.15.82:0/3966189571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00b31c0 0x7f2de00b5ed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2de00cb110 tx=0x7f2dcc009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.346+0000 7f2de5c00700 1 -- 172.21.15.82:0/3966189571 shutdown_connections 2024-05-10T04:51:40.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.346+0000 7f2de5c00700 1 --2- 172.21.15.82:0/3966189571 >> v2:172.21.15.129:3300/0 conn(0x7f2de00d04a0 0x7f2de006e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.346+0000 7f2de5c00700 1 --2- 172.21.15.82:0/3966189571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00b31c0 0x7f2de00b5ed0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.346+0000 7f2de5c00700 1 -- 172.21.15.82:0/3966189571 >> 172.21.15.82:0/3966189571 conn(0x7f2de00b26a0 msgr2=0x7f2de00b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:40.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.346+0000 7f2de5c00700 1 -- 172.21.15.82:0/3966189571 shutdown_connections 2024-05-10T04:51:40.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.346+0000 7f2de5c00700 1 -- 172.21.15.82:0/3966189571 wait complete. 2024-05-10T04:51:40.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.348+0000 7f2de5c00700 1 Processor -- start 2024-05-10T04:51:40.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.348+0000 7f2de5c00700 1 -- start start 2024-05-10T04:51:40.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2de5c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2de0070640 0x7f2de015d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:40.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2de5c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2de00b31c0 0x7f2de015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2de5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00d04a0 0x7f2de00c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2de5c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de015d770 con 0x7f2de00d04a0 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2de5c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de015f5c0 con 0x7f2de0070640 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2de5c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00c4660 con 0x7f2de00b31c0 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00d04a0 0x7f2de00c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00d04a0 0x7f2de00c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54060/0 (socket says 172.21.15.82:54060) 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddf400700 1 -- 172.21.15.82:0/2894712999 learned_addr learned my addr 172.21.15.82:0/2894712999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddea00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2de0070640 0x7f2de015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2dde000700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2de00b31c0 0x7f2de015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddf400700 1 -- 172.21.15.82:0/2894712999 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2de00b31c0 msgr2=0x7f2de015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddf400700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2de00b31c0 0x7f2de015eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddf400700 1 -- 172.21.15.82:0/2894712999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2de0070640 msgr2=0x7f2de015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddf400700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2de0070640 0x7f2de015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.350+0000 7f2ddf400700 1 -- 172.21.15.82:0/2894712999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc009550 con 0x7f2de00d04a0 2024-05-10T04:51:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.351+0000 7f2ddf400700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00d04a0 0x7f2de00c6c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8007d40 tx=0x7f2dd800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.351+0000 7f2dd6a00700 1 -- 172.21.15.82:0/2894712999 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800ede0 con 0x7f2de00d04a0 2024-05-10T04:51:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.351+0000 7f2dd6a00700 1 -- 172.21.15.82:0/2894712999 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd8014420 con 0x7f2de00d04a0 2024-05-10T04:51:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.351+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de01f81d0 con 0x7f2de00d04a0 2024-05-10T04:51:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.351+0000 7f2dd6a00700 1 -- 172.21.15.82:0/2894712999 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80147d0 con 0x7f2de00d04a0 2024-05-10T04:51:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.351+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de00c4b90 con 0x7f2de00d04a0 2024-05-10T04:51:40.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.352+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de0074af0 con 0x7f2de00d04a0 2024-05-10T04:51:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.353+0000 7f2dd6a00700 1 -- 172.21.15.82:0/2894712999 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2dd8014930 con 0x7f2de00d04a0 2024-05-10T04:51:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.354+0000 7f2dd6a00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2dc006ac90 0x7f2dc006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:40.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.354+0000 7f2dd6a00700 1 -- 172.21.15.82:0/2894712999 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dd8089b50 con 0x7f2de00d04a0 2024-05-10T04:51:40.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.354+0000 7f2ddea00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2dc006ac90 0x7f2dc006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:40.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.355+0000 7f2ddea00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2dc006ac90 0x7f2dc006d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0000f60 tx=0x7f2dd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:40.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.359+0000 7f2dd6a00700 1 -- 172.21.15.82:0/2894712999 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2dd8054c00 con 0x7f2de00d04a0 2024-05-10T04:51:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.607+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2de015f080 con 0x7f2de00d04a0 2024-05-10T04:51:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.608+0000 7f2dd6a00700 1 -- 172.21.15.82:0/2894712999 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f2dd8058220 con 0x7f2de00d04a0 2024-05-10T04:51:40.609 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:40.609 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:51:36.561071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6836/3440576054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3440576054},{"type":"v1","addr":"172.21.15.82:6836","nonce":3440576054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:51:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2dc006ac90 msgr2=0x7f2dc006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2dc006ac90 0x7f2dc006d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0000f60 tx=0x7f2dd0009040 comp rx=0 tx=0).stop 2024-05-10T04:51:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00d04a0 msgr2=0x7f2de00c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00d04a0 0x7f2de00c6c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8007d40 tx=0x7f2dd800e3c0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 shutdown_connections 2024-05-10T04:51:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2dc006ac90 0x7f2dc006d1a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2de00d04a0 0x7f2de00c6c90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2de0070640 0x7f2de015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 --2- 172.21.15.82:0/2894712999 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2de00b31c0 0x7f2de015eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.610+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 >> 172.21.15.82:0/2894712999 conn(0x7f2de00b26a0 msgr2=0x7f2de00cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.611+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 shutdown_connections 2024-05-10T04:51:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:40.611+0000 7f2de5c00700 1 -- 172.21.15.82:0/2894712999 wait complete. 2024-05-10T04:51:40.613 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-05-10T04:51:41.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:51:33.124469+0000', 'modified': '2024-05-10T04:51:36.561071+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5067}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5067': {'gid': 5067, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.82:6836/3440576054', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 3440576054}, {'type': 'v1', 'addr': '172.21.15.82:6836', 'nonce': 3440576054}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T04:51:41.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T04:51:41.040 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-10T04:51:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.309+0000 7f9ca3800700 1 Processor -- start 2024-05-10T04:51:41.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.309+0000 7f9ca3800700 1 -- start start 2024-05-10T04:51:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9ca3800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9ca3800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f9c9c06b340 0x7f9c9c161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9ca3800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c0b20e0 con 0x7f9c9c0b6270 2024-05-10T04:51:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9ca3800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0b13c0 con 0x7f9c9c06b340 2024-05-10T04:51:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9ca3800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0ceab0 con 0x7f9c9c0cb0e0 2024-05-10T04:51:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9ca0e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9c9be00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f9c9c0b6270 0x7f9c9c06ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:60280/0 (socket says 172.21.15.82:60280) 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9c9be00700 1 -- 172.21.15.82:0/3996204587 learned_addr learned my addr 172.21.15.82:0/3996204587 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.311+0000 7f9ca1800700 1 --2- 172.21.15.82:0/3996204587 >> v2:172.21.15.129:3300/0 conn(0x7f9c9c06b340 0x7f9c9c161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.312+0000 7f9c9b400700 1 -- 172.21.15.82:0/3996204587 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454421677 0 0) 0x7f9c9c0b20e0 con 0x7f9c9c0b6270 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.312+0000 7f9c9b400700 1 -- 172.21.15.82:0/3996204587 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c840035b0 con 0x7f9c9c0b6270 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.312+0000 7f9ca1800700 1 -- 172.21.15.82:0/3996204587 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 msgr2=0x7f9c9c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.312+0000 7f9ca1800700 1 --2- 172.21.15.82:0/3996204587 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.312+0000 7f9ca1800700 1 -- 172.21.15.82:0/3996204587 >> v1:172.21.15.129:6789/0 conn(0x7f9c9c0b6270 legacy=0x7f9c9c06ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.312+0000 7f9ca1800700 1 -- 172.21.15.82:0/3996204587 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c15e8b0 con 0x7f9c9c06b340 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.312+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/3996204587 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.312+0000 7f9ca1800700 1 --2- 172.21.15.82:0/3996204587 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c06b340 0x7f9c9c161fc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009d90 tx=0x7f9c9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50c699ef7a2f672f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9c9b400700 1 -- 172.21.15.82:0/3996204587 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9400e070 con 0x7f9c9c06b340 2024-05-10T04:51:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9c9b400700 1 -- 172.21.15.82:0/3996204587 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9400bb20 con 0x7f9c9c06b340 2024-05-10T04:51:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9c9b400700 1 -- 172.21.15.82:0/3996204587 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94012430 con 0x7f9c9c06b340 2024-05-10T04:51:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9ca3800700 1 -- 172.21.15.82:0/3996204587 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c06b340 msgr2=0x7f9c9c161fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9ca3800700 1 --2- 172.21.15.82:0/3996204587 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c06b340 0x7f9c9c161fc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009d90 tx=0x7f9c9400b330 comp rx=0 tx=0).stop 2024-05-10T04:51:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9ca3800700 1 -- 172.21.15.82:0/3996204587 shutdown_connections 2024-05-10T04:51:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9ca3800700 1 --2- 172.21.15.82:0/3996204587 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c06b340 0x7f9c9c161fc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9ca3800700 1 --2- 172.21.15.82:0/3996204587 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9ca3800700 1 -- 172.21.15.82:0/3996204587 >> 172.21.15.82:0/3996204587 conn(0x7f9c9c0d0a90 msgr2=0x7f9c9c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9ca3800700 1 -- 172.21.15.82:0/3996204587 shutdown_connections 2024-05-10T04:51:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.313+0000 7f9ca3800700 1 -- 172.21.15.82:0/3996204587 wait complete. 2024-05-10T04:51:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.316+0000 7f9ca3800700 1 Processor -- start 2024-05-10T04:51:41.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.316+0000 7f9ca3800700 1 -- start start 2024-05-10T04:51:41.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.317+0000 7f9ca3800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c9c0b6270 0x7f9c9c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.317+0000 7f9ca3800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.317+0000 7f9ca3800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c0cbcf0 0x7f9c9c0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.317+0000 7f9ca3800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0af2b0 con 0x7f9c9c0b6270 2024-05-10T04:51:41.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.317+0000 7f9ca3800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0c88a0 con 0x7f9c9c0cbcf0 2024-05-10T04:51:41.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.317+0000 7f9ca3800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0ca280 con 0x7f9c9c0cb0e0 2024-05-10T04:51:41.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c9c0b6270 0x7f9c9c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c9c0b6270 0x7f9c9c0c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54070/0 (socket says 172.21.15.82:54070) 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 -- 172.21.15.82:0/13301628 learned_addr learned my addr 172.21.15.82:0/13301628 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9c9be00700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca1800700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c0cbcf0 0x7f9c9c0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 -- 172.21.15.82:0/13301628 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 msgr2=0x7f9c9c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 -- 172.21.15.82:0/13301628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c0cbcf0 msgr2=0x7f9c9c0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c0cbcf0 0x7f9c9c0cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 -- 172.21.15.82:0/13301628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c900094a0 con 0x7f9c9c0b6270 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.318+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c9c0b6270 0x7f9c9c0c9d40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000ebb0 tx=0x7f9c9000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.319+0000 7f9c98c00700 1 -- 172.21.15.82:0/13301628 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000c7f0 con 0x7f9c9c0b6270 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.319+0000 7f9c98c00700 1 -- 172.21.15.82:0/13301628 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9000c950 con 0x7f9c9c0b6270 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.319+0000 7f9c98c00700 1 -- 172.21.15.82:0/13301628 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000cce0 con 0x7f9c9c0b6270 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.319+0000 7f9ca3800700 1 -- 172.21.15.82:0/13301628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c94009a70 con 0x7f9c9c0b6270 2024-05-10T04:51:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.319+0000 7f9ca3800700 1 -- 172.21.15.82:0/13301628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c0c8af0 con 0x7f9c9c0b6270 2024-05-10T04:51:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.321+0000 7f9c98c00700 1 -- 172.21.15.82:0/13301628 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c90013470 con 0x7f9c9c0b6270 2024-05-10T04:51:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.322+0000 7f9c98c00700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c7c06ac90 0x7f9c7c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.322+0000 7f9c98c00700 1 -- 172.21.15.82:0/13301628 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c90089290 con 0x7f9c9c0b6270 2024-05-10T04:51:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.322+0000 7f9c9be00700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c7c06ac90 0x7f9c7c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.323+0000 7f9c9be00700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c7c06ac90 0x7f9c7c06d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c88000f60 tx=0x7f9c88007e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.324+0000 7f9cbb71fb80 1 Processor -- start 2024-05-10T04:51:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.324+0000 7f9cbb71fb80 1 -- start start 2024-05-10T04:51:41.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.325+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a70e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.325+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a6e4860 0x56521a6e7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.325+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a72d6a0 0x56521a72dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.325+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56521a60e250 con 0x56521a5ad5f0 2024-05-10T04:51:41.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x56521a60ba50 con 0x56521a6e4860 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x56521a607340 con 0x56521a72d6a0 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a70e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a70e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54086/0 (socket says 172.21.15.82:54086) 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 -- 172.21.15.82:0/1354341284 learned_addr learned my addr 172.21.15.82:0/1354341284 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca1800700 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a72d6a0 0x56521a72dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9c9be00700 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a6e4860 0x56521a6e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 -- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a72d6a0 msgr2=0x56521a72dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a72d6a0 0x56521a72dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 -- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a6e4860 msgr2=0x56521a6e7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a6e4860 0x56521a6e7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 -- 172.21.15.82:0/1354341284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56521a3fa790 con 0x56521a5ad5f0 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9c9be00700 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a6e4860 0x56521a6e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a70e960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9c900877e0 tx=0x7f9c90057b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445f492305f959d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.326+0000 7f9c8d600700 1 -- 172.21.15.82:0/1354341284 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900890c0 con 0x56521a5ad5f0 2024-05-10T04:51:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9c8d600700 1 -- 172.21.15.82:0/1354341284 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9005a030 con 0x56521a5ad5f0 2024-05-10T04:51:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9c8d600700 1 -- 172.21.15.82:0/1354341284 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90058130 con 0x56521a5ad5f0 2024-05-10T04:51:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1354341284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 msgr2=0x56521a70e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a70e960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9c900877e0 tx=0x7f9c90057b10 comp rx=0 tx=0).stop 2024-05-10T04:51:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1354341284 shutdown_connections 2024-05-10T04:51:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a72d6a0 0x56521a72dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a70e960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/1354341284 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a6e4860 0x56521a6e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.327+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1354341284 >> 172.21.15.82:0/1354341284 conn(0x56521a651cf0 msgr2=0x56521a72c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.328+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1354341284 shutdown_connections 2024-05-10T04:51:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.328+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1354341284 wait complete. 2024-05-10T04:51:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.329+0000 7f9cbb71fb80 1 -- start start 2024-05-10T04:51:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.329+0000 7f9cbb71fb80 1 Processor -- start 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.330+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a732e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.330+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a733380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.330+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a711930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.330+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56521a5a3490 con 0x56521a6e4860 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.330+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x56521a5a3130 con 0x56521a72d6a0 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.330+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x56521a3fb390 con 0x56521a5ad5f0 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9cbb71fb80 10 client.0 _ll_register_callbacks cb 0x56521a40e5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a733380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a733380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54102/0 (socket says 172.21.15.82:54102) 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 -- 172.21.15.82:0/3083756054 learned_addr learned my addr 172.21.15.82:0/3083756054 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a732e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 -- 172.21.15.82:0/3083756054 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 msgr2=0x56521a732e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a732e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 -- 172.21.15.82:0/3083756054 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 msgr2=0x56521a711930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a711930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 -- 172.21.15.82:0/3083756054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c0c8af0 con 0x56521a6e4860 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a732e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c9be00700 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a733380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0b6a90 tx=0x7f9c88001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c5b3f74040123e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.331+0000 7f9c82000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9c82000700 1 -- 172.21.15.82:0/3083756054 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88005af0 con 0x56521a6e4860 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9c82000700 1 -- 172.21.15.82:0/3083756054 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c88005c50 con 0x56521a6e4860 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/3083756054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56521a6d9630 con 0x56521a6e4860 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9c82000700 1 -- 172.21.15.82:0/3083756054 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c88005e10 con 0x56521a6e4860 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 10 client.5241 fetch_fsmap learned FSMap version 16 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/3083756054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56521a4e70a0 con 0x56521a6e4860 2024-05-10T04:51:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9c82000700 1 -- 172.21.15.82:0/3083756054 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56521a6d9630 con 0x56521a6e4860 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9c82000700 1 -- 172.21.15.82:0/3083756054 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9c880016d0 con 0x56521a6e4860 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 10 client.5241 fetch_fsmap finished waiting for FSMap version 16 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 10 client.5241 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 20 client.5241 populate_metadata read hostname 'smithi082' 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] conn(0x56521a712360 0x56521a70fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 4 client.5241 mds_command: new command op to 5067 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.332+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/3083756054 --> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56521a440040 con 0x56521a712360 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.333+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] conn(0x56521a712360 0x56521a70fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.333+0000 7f9c82000700 10 client.5241 ms_handle_connect on v2:172.21.15.82:6834/3440576054 2024-05-10T04:51:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.333+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] conn(0x56521a712360 0x56521a70fa60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7066fc0f30f7dd7 server_cookie=54a3ca55c7e3dc47 in_seq=0 out_seq=0 2024-05-10T04:51:41.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9c82000700 1 -- 172.21.15.82:0/3083756054 <== mds.0 v2:172.21.15.82:6834/3440576054 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56521a440040 con 0x56521a712360 2024-05-10T04:51:41.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9c82000700 10 client.5241 handle_command_reply: tid=0 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 client.5241 shutdown 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/3083756054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 msgr2=0x56521a733380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a733380 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0b6a90 tx=0x7f9c88001150 comp rx=0 tx=0).stop 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/3083756054 shutdown_connections 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a711930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a732e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] conn(0x56521a712360 0x56521a70fa60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/3083756054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a733380 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9c82000700 0 client.5241 ms_handle_reset on v2:172.21.15.82:6834/3440576054 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/3083756054 >> 172.21.15.82:0/3083756054 conn(0x56521a651cf0 msgr2=0x56521a730080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/3083756054 shutdown_connections 2024-05-10T04:51:41.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.334+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/3083756054 wait complete. 2024-05-10T04:51:41.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.335+0000 7f9cbb71fb80 20 client.5241 trim_cache size 0 max 16384 2024-05-10T04:51:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.353+0000 7f9cbb71fb80 1 Processor -- start 2024-05-10T04:51:41.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.354+0000 7f9cbb71fb80 1 -- start start 2024-05-10T04:51:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.355+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a713c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.355+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a6e4860 0x56521a714140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.355+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a6e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.355+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56521a712be0 con 0x56521a5ad5f0 2024-05-10T04:51:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.355+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x56521a6db000 con 0x56521a72d6a0 2024-05-10T04:51:41.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.355+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x56521a6da8a0 con 0x56521a6e4860 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.355+0000 7f9ca0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a713c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a713c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54106/0 (socket says 172.21.15.82:54106) 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca0e00700 1 -- 172.21.15.82:0/1521946801 learned_addr learned my addr 172.21.15.82:0/1521946801 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca0e00700 1 -- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a6e4860 msgr2=0x56521a714140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9c9be00700 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a6e4860 0x56521a714140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca1800700 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a6e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a6e4860 0x56521a714140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca0e00700 1 -- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 msgr2=0x56521a6e0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a6e0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca0e00700 1 -- 172.21.15.82:0/1521946801 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56521a5cd690 con 0x56521a5ad5f0 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9c9be00700 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a6e4860 0x56521a714140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca1800700 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a6e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a713c00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9c900580c0 tx=0x7f9c9001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a467f1d636cf1fb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9c8e000700 1 -- 172.21.15.82:0/1521946801 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90087040 con 0x56521a5ad5f0 2024-05-10T04:51:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9c8e000700 1 -- 172.21.15.82:0/1521946801 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9005bfe0 con 0x56521a5ad5f0 2024-05-10T04:51:41.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.356+0000 7f9c8e000700 1 -- 172.21.15.82:0/1521946801 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90087730 con 0x56521a5ad5f0 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1521946801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 msgr2=0x56521a713c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a713c00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9c900580c0 tx=0x7f9c9001d000 comp rx=0 tx=0).stop 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1521946801 shutdown_connections 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a6e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a5ad5f0 0x56521a713c00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/1521946801 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a6e4860 0x56521a714140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1521946801 >> 172.21.15.82:0/1521946801 conn(0x56521a651cf0 msgr2=0x56521a7132a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1521946801 shutdown_connections 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.357+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/1521946801 wait complete. 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.358+0000 7f9cbb71fb80 1 -- start start 2024-05-10T04:51:41.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.358+0000 7f9cbb71fb80 1 Processor -- start 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a70b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a72c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9cbb71fb80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a731610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56521a72c660 con 0x56521a6e4860 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x56521a732330 con 0x56521a72d6a0 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9cbb71fb80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x56521a70b710 con 0x56521a5ad5f0 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9cbb71fb80 10 client.0 _ll_register_callbacks cb 0x7f9c880147f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9c9be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a72c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9c9be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a72c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54116/0 (socket says 172.21.15.82:54116) 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9c9be00700 1 -- 172.21.15.82:0/2273662813 learned_addr learned my addr 172.21.15.82:0/2273662813 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.360+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a70b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9ca1800700 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a731610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c9be00700 1 -- 172.21.15.82:0/2273662813 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 msgr2=0x56521a70b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c9be00700 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a70b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c9be00700 1 -- 172.21.15.82:0/2273662813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 msgr2=0x56521a731610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c9be00700 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a731610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c9be00700 1 -- 172.21.15.82:0/2273662813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56521a3fa790 con 0x56521a6e4860 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c9be00700 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a72c120 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x56521a6e7360 tx=0x7f9c88015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729dac6c50d11aad server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c82000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c82000700 1 -- 172.21.15.82:0/2273662813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88001690 con 0x56521a6e4860 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c82000700 1 -- 172.21.15.82:0/2273662813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c880017f0 con 0x56521a6e4860 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/2273662813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56521a72b410 con 0x56521a6e4860 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9c82000700 1 -- 172.21.15.82:0/2273662813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c88021480 con 0x56521a6e4860 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9cbb71fb80 10 client.5247 fetch_fsmap learned FSMap version 16 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.361+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/2273662813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56521a45b1d0 con 0x56521a6e4860 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9c82000700 1 -- 172.21.15.82:0/2273662813 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56521a72b410 con 0x56521a6e4860 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9c82000700 1 -- 172.21.15.82:0/2273662813 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9c880215e0 con 0x56521a6e4860 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9cbb71fb80 10 client.5247 fetch_fsmap finished waiting for FSMap version 16 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9cbb71fb80 10 client.5247 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9cbb71fb80 20 client.5247 populate_metadata read hostname 'smithi082' 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] conn(0x56521a713cd0 0x56521a7140e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9cbb71fb80 4 client.5247 mds_command: new command op to 5067 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/2273662813 --> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f9c9005a030 con 0x56521a713cd0 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] conn(0x56521a713cd0 0x56521a7140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.362+0000 7f9ca0e00700 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] conn(0x56521a713cd0 0x56521a7140e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14fcbaade495577a server_cookie=c22e495dd0f2376 in_seq=0 out_seq=0 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9c82000700 10 client.5247 ms_handle_connect on v2:172.21.15.82:6834/3440576054 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9c82000700 1 -- 172.21.15.82:0/2273662813 <== mds.0 v2:172.21.15.82:6834/3440576054 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f9c9005a030 con 0x56521a713cd0 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9c82000700 10 client.5247 handle_command_reply: tid=0 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 client.5247 shutdown 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/2273662813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 msgr2=0x56521a72c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a72c120 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x56521a6e7360 tx=0x7f9c88015000 comp rx=0 tx=0).stop 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/2273662813 shutdown_connections 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x56521a72d6a0 0x56521a731610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x56521a5ad5f0 0x56521a70b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.82:6834/3440576054,v1:172.21.15.82:6836/3440576054] conn(0x56521a713cd0 0x56521a7140e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 --2- 172.21.15.82:0/2273662813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56521a6e4860 0x56521a72c120 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9c82000700 0 client.5247 ms_handle_reset on v2:172.21.15.82:6834/3440576054 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/2273662813 >> 172.21.15.82:0/2273662813 conn(0x56521a651cf0 msgr2=0x56521a6e27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/2273662813 shutdown_connections 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 1 -- 172.21.15.82:0/2273662813 wait complete. 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.363+0000 7f9cbb71fb80 20 client.5247 trim_cache size 0 max 16384 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c7bb1514-6d11-4350-825d-a52cfeee72e9", 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5067, 2024-05-10T04:51:41.369 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-10T04:51:41.370 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-10T04:51:41.370 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-10T04:51:41.370 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 8.2365973550000007, 2024-05-10T04:51:41.370 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 16, 2024-05-10T04:51:41.370 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 35, 2024-05-10T04:51:41.370 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 35, 2024-05-10T04:51:41.370 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 17.901628605999999 2024-05-10T04:51:41.370 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 -- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c7c06ac90 msgr2=0x7f9c7c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c7c06ac90 0x7f9c7c06d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c88000f60 tx=0x7f9c88007e00 comp rx=0 tx=0).stop 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 -- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c9c0b6270 msgr2=0x7f9c9c0c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c9c0b6270 0x7f9c9c0c9d40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000ebb0 tx=0x7f9c9000eec0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 -- 172.21.15.82:0/13301628 shutdown_connections 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f9c7c06ac90 0x7f9c7c06d1a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9c9c0cbcf0 0x7f9c9c0cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c9c0b6270 0x7f9c9c0c9d40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 --2- 172.21.15.82:0/13301628 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9c9c0cb0e0 0x7f9c9c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 -- 172.21.15.82:0/13301628 >> 172.21.15.82:0/13301628 conn(0x7f9c9c0d0a90 msgr2=0x7f9c9c15e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 -- 172.21.15.82:0/13301628 shutdown_connections 2024-05-10T04:51:41.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.364+0000 7f9ca3800700 1 -- 172.21.15.82:0/13301628 wait complete. 2024-05-10T04:51:41.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:51:41.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.657+0000 7f21fbe00700 1 Processor -- start 2024-05-10T04:51:41.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.658+0000 7f21fbe00700 1 -- start start 2024-05-10T04:51:41.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.659+0000 7f21fbe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21fc0b2ca0 0x7f21fc0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.659+0000 7f21fbe00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc15e350 0x7f21fc0d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.659+0000 7f21fbe00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21fc161e40 con 0x7f21fc15df40 2024-05-10T04:51:41.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.659+0000 7f21fbe00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21fc162120 con 0x7f21fc0b2ca0 2024-05-10T04:51:41.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.659+0000 7f21fbe00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc162400 con 0x7f21fc15e350 2024-05-10T04:51:41.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21faa00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21fc0b2ca0 0x7f21fc0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21faa00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21fc0b2ca0 0x7f21fc0cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54132/0 (socket says 172.21.15.82:54132) 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21f3e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f21fc15df40 0x7f21fc0d03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41968/0 (socket says 172.21.15.82:41968) 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21faa00700 1 -- 172.21.15.82:0/94810263 learned_addr learned my addr 172.21.15.82:0/94810263 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21faa00700 1 -- 172.21.15.82:0/94810263 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc15e350 msgr2=0x7f21fc0d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21fb400700 1 --2- 172.21.15.82:0/94810263 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc15e350 0x7f21fc0d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21faa00700 1 --2- 172.21.15.82:0/94810263 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc15e350 0x7f21fc0d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21faa00700 1 -- 172.21.15.82:0/94810263 >> v1:172.21.15.82:6789/0 conn(0x7f21fc15df40 legacy=0x7f21fc0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21faa00700 1 -- 172.21.15.82:0/94810263 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc1626e0 con 0x7f21fc0b2ca0 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21fa000700 1 -- 172.21.15.82:0/94810263 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146422712 0 0) 0x7f21fc161e40 con 0x7f21fc15df40 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21fb400700 1 --2- 172.21.15.82:0/94810263 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc15e350 0x7f21fc0d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.660+0000 7f21faa00700 1 --2- 172.21.15.82:0/94810263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc0b2ca0 0x7f21fc0cf150 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0098f0 tx=0x7f21ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8463313b081753 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.661+0000 7f21fa000700 1 -- 172.21.15.82:0/94810263 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00b8a0 con 0x7f21fc0b2ca0 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.661+0000 7f21fa000700 1 -- 172.21.15.82:0/94810263 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00ba00 con 0x7f21fc0b2ca0 2024-05-10T04:51:41.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.661+0000 7f21fa000700 1 -- 172.21.15.82:0/94810263 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00bd90 con 0x7f21fc0b2ca0 2024-05-10T04:51:41.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.661+0000 7f21fbe00700 1 -- 172.21.15.82:0/94810263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc0b2ca0 msgr2=0x7f21fc0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.661+0000 7f21fbe00700 1 --2- 172.21.15.82:0/94810263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc0b2ca0 0x7f21fc0cf150 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0098f0 tx=0x7f21ec009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:41.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.662+0000 7f21fbe00700 1 -- 172.21.15.82:0/94810263 shutdown_connections 2024-05-10T04:51:41.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.662+0000 7f21fbe00700 1 --2- 172.21.15.82:0/94810263 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc15e350 0x7f21fc0d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.662+0000 7f21fbe00700 1 --2- 172.21.15.82:0/94810263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc0b2ca0 0x7f21fc0cf150 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.662+0000 7f21fbe00700 1 -- 172.21.15.82:0/94810263 >> 172.21.15.82:0/94810263 conn(0x7f21fc067600 msgr2=0x7f21fc06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:41.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.662+0000 7f21fbe00700 1 -- 172.21.15.82:0/94810263 shutdown_connections 2024-05-10T04:51:41.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.662+0000 7f21fbe00700 1 -- 172.21.15.82:0/94810263 wait complete. 2024-05-10T04:51:41.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.664+0000 7f21fbe00700 1 Processor -- start 2024-05-10T04:51:41.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.664+0000 7f21fbe00700 1 -- start start 2024-05-10T04:51:41.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21fbe00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc0b2ca0 0x7f21fc1eb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15df40 0x7f21fc156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21fbe00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21fc15e350 0x7f21fc0d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21fbe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc1e9a70 con 0x7f21fc15df40 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21fbe00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc157420 con 0x7f21fc15e350 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21fbe00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc1eb960 con 0x7f21fc0b2ca0 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21f3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15df40 0x7f21fc156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21f3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15df40 0x7f21fc156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54140/0 (socket says 172.21.15.82:54140) 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21f3e00700 1 -- 172.21.15.82:0/3791291374 learned_addr learned my addr 172.21.15.82:0/3791291374 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21faa00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc0b2ca0 0x7f21fc1eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.666+0000 7f21fb400700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21fc15e350 0x7f21fc0d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f3e00700 1 -- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc0b2ca0 msgr2=0x7f21fc1eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f3e00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc0b2ca0 0x7f21fc1eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f3e00700 1 -- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21fc15e350 msgr2=0x7f21fc0d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f3e00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21fc15e350 0x7f21fc0d2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f3e00700 1 -- 172.21.15.82:0/3791291374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec009550 con 0x7f21fc15df40 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21fb400700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21fc15e350 0x7f21fc0d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f3e00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15df40 0x7f21fc156a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c460 tx=0x7f21e400c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f2a00700 1 -- 172.21.15.82:0/3791291374 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4004c80 con 0x7f21fc15df40 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f2a00700 1 -- 172.21.15.82:0/3791291374 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4004e00 con 0x7f21fc15df40 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21f2a00700 1 -- 172.21.15.82:0/3791291374 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4007310 con 0x7f21fc15df40 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21fc155d00 con 0x7f21fc15df40 2024-05-10T04:51:41.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.667+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21fc157950 con 0x7f21fc15df40 2024-05-10T04:51:41.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.668+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21fc158560 con 0x7f21fc15df40 2024-05-10T04:51:41.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.669+0000 7f21f2a00700 1 -- 172.21.15.82:0/3791291374 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21e4007470 con 0x7f21fc15df40 2024-05-10T04:51:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.670+0000 7f21f2a00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f21d806ac90 0x7f21d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.670+0000 7f21f2a00700 1 -- 172.21.15.82:0/3791291374 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21e4088e80 con 0x7f21fc15df40 2024-05-10T04:51:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.671+0000 7f21faa00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f21d806ac90 0x7f21d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:41.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.671+0000 7f21faa00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f21d806ac90 0x7f21d806d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f21ec014040 tx=0x7f21ec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.675+0000 7f21f2a00700 1 -- 172.21.15.82:0/3791291374 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f21e4053f30 con 0x7f21fc15df40 2024-05-10T04:51:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.926+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f21fc155d00 con 0x7f21fc15df40 2024-05-10T04:51:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.927+0000 7f21f2a00700 1 -- 172.21.15.82:0/3791291374 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f21fc155d00 con 0x7f21fc15df40 2024-05-10T04:51:41.928 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T04:51:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f21d806ac90 msgr2=0x7f21d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f21d806ac90 0x7f21d806d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f21ec014040 tx=0x7f21ec008030 comp rx=0 tx=0).stop 2024-05-10T04:51:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15df40 msgr2=0x7f21fc156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15df40 0x7f21fc156a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c460 tx=0x7f21e400c770 comp rx=0 tx=0).stop 2024-05-10T04:51:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 shutdown_connections 2024-05-10T04:51:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f21d806ac90 0x7f21d806d1a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f21fc15e350 0x7f21fc0d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f21fc0b2ca0 0x7f21fc1eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 --2- 172.21.15.82:0/3791291374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21fc15df40 0x7f21fc156a40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 >> 172.21.15.82:0/3791291374 conn(0x7f21fc067600 msgr2=0x7f21fc0b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 shutdown_connections 2024-05-10T04:51:41.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:41.929+0000 7f21fbe00700 1 -- 172.21.15.82:0/3791291374 wait complete. 2024-05-10T04:51:41.956 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T04:51:41.956 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:51:41.956 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-05-10T04:51:41.956 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T04:51:41.956 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T04:51:41.956 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T04:51:41.956 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-10T04:51:41.957 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:51:41.957 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:51:41.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:41.957 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-05-10T04:51:42.002 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:51:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:51:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:51:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:51:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-10T04:51:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42421sec preferred_lft 42421sec 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-10T04:51:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 32:ba:43:a6:a3:e3 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ac3d:f6ff:fec4:7947/64 scope link 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 32:ba:43:a6:a3:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::30ba:43ff:fea6:a3e3/64 scope link 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 62:12:6f:28:ea:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::6012:6fff:fe28:ea1b/64 scope link 2024-05-10T04:51:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:51:42.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:42.005 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:51:42.109 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-10T04:51:42.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:42.112 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-05-10T04:51:42.160 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-05-10T04:51:42.160 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:51:42.160 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:51:42.160 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:51:42.160 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:51:42.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:42.161 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2024-05-10T04:51:42.161 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-10T04:51:42.161 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:51:42.161 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:51:42.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:51:42.162 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-10T04:51:42.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:42.323 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T04:51:42.368 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T04:51:42.368 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T04:51:42.369 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:51:42.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:42.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-05-10T04:51:42.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:51:42.477 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T04:51:42.532 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:51:42.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:51:42.533 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:51:42.635 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-10T04:51:42.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:42.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T04:51:42.861 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T04:51:42.861 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T04:51:42.862 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:51:42.882 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T04:51:42.882 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T04:51:42.883 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:51:42.883 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:51:42.883 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:51:42.916 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-10T04:51:42.916 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-10T04:51:42.916 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-10T04:51:42.916 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.129:3300,172.21.15.129:3301" 2024-05-10T04:51:42.916 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-10T04:51:42.916 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790" 2024-05-10T04:51:42.916 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.129:6789,172.21.15.129:6790:/ 2024-05-10T04:51:42.916 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c7bb1514-6d11-4350-825d-a52cfeee72e9" will pass to kernel 2024-05-10T04:51:42.918 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:51:42.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:42.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:51:43.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:43.003 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:51:43.122 INFO:teuthology.orchestra.run.smithi082.stdout:client5143 2024-05-10T04:51:43.123 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:51:43.123 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:51:43.184 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-10T04:51:43.184 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-05-10T04:51:43.184 DEBUG:teuthology.orchestra.run.smithi082:> os.mkdir("/home/ubuntu/cephtest/mnt.0/testdir") 2024-05-10T04:51:43.185 DEBUG:teuthology.orchestra.run.smithi082:> fd = os.open("/home/ubuntu/cephtest/mnt.0/testdir", os.O_RDONLY) 2024-05-10T04:51:43.185 DEBUG:teuthology.orchestra.run.smithi082:> os.fchmod(fd, 0o777) 2024-05-10T04:51:43.185 DEBUG:teuthology.orchestra.run.smithi082:> os.fsync(fd) 2024-05-10T04:51:43.185 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-05-10T04:51:43.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.826+0000 7f4182400700 1 Processor -- start 2024-05-10T04:51:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.826+0000 7f4182400700 1 -- start start 2024-05-10T04:51:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.828+0000 7f4182400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f417c0af330 0x7f417c0b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.828+0000 7f4182400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f417c0c6db0 0x7f417c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.828+0000 7f4182400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c0b1a40 con 0x7f417c0b5970 2024-05-10T04:51:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.828+0000 7f4182400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c15eb20 con 0x7f417c0c6db0 2024-05-10T04:51:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.828+0000 7f4182400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c06bc40 con 0x7f417c0af330 2024-05-10T04:51:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.828+0000 7f417be00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f417c0c6db0 0x7f417c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.828+0000 7f417b400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f417c0b5970 0x7f417c15e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41980/0 (socket says 172.21.15.82:41980) 2024-05-10T04:51:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.828+0000 7f417b400700 1 -- 172.21.15.82:0/1754668963 learned_addr learned my addr 172.21.15.82:0/1754668963 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:43.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f4173e00700 1 --2- 172.21.15.82:0/1754668963 >> v2:172.21.15.129:3300/0 conn(0x7f417c0af330 0x7f417c0b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:43.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f417be00700 1 -- 172.21.15.82:0/1754668963 >> v2:172.21.15.129:3300/0 conn(0x7f417c0af330 msgr2=0x7f417c0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f417be00700 1 --2- 172.21.15.82:0/1754668963 >> v2:172.21.15.129:3300/0 conn(0x7f417c0af330 0x7f417c0b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f417be00700 1 -- 172.21.15.82:0/1754668963 >> v1:172.21.15.82:6789/0 conn(0x7f417c0b5970 legacy=0x7f417c15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f417be00700 1 -- 172.21.15.82:0/1754668963 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c0afe40 con 0x7f417c0c6db0 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f417be00700 1 --2- 172.21.15.82:0/1754668963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c0b1500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f417c0b32a0 tx=0x7f417400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72d3a90980da85a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f417aa00700 1 -- 172.21.15.82:0/1754668963 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417400e070 con 0x7f417c0c6db0 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f417aa00700 1 -- 172.21.15.82:0/1754668963 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417400bbd0 con 0x7f417c0c6db0 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.829+0000 7f417aa00700 1 -- 172.21.15.82:0/1754668963 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174012430 con 0x7f417c0c6db0 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.830+0000 7f4182400700 1 -- 172.21.15.82:0/1754668963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 msgr2=0x7f417c0b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.830+0000 7f4182400700 1 --2- 172.21.15.82:0/1754668963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c0b1500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f417c0b32a0 tx=0x7f417400b330 comp rx=0 tx=0).stop 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.830+0000 7f4182400700 1 -- 172.21.15.82:0/1754668963 shutdown_connections 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.830+0000 7f4182400700 1 --2- 172.21.15.82:0/1754668963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c0b1500 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.830+0000 7f4182400700 1 --2- 172.21.15.82:0/1754668963 >> v2:172.21.15.129:3300/0 conn(0x7f417c0af330 0x7f417c0b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.830+0000 7f4182400700 1 -- 172.21.15.82:0/1754668963 >> 172.21.15.82:0/1754668963 conn(0x7f417c099a70 msgr2=0x7f417c0b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.830+0000 7f4182400700 1 -- 172.21.15.82:0/1754668963 shutdown_connections 2024-05-10T04:51:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.830+0000 7f4182400700 1 -- 172.21.15.82:0/1754668963 wait complete. 2024-05-10T04:51:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.833+0000 7f4182400700 1 Processor -- start 2024-05-10T04:51:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.833+0000 7f4182400700 1 -- start start 2024-05-10T04:51:43.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4182400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f417c0af330 0x7f417c1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4182400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4182400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c1597e0 0x7f417c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4182400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c151b20 con 0x7f417c0c6db0 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4182400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0d0700 con 0x7f417c1597e0 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4182400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0cde90 con 0x7f417c0af330 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4173e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4173e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c15f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54156/0 (socket says 172.21.15.82:54156) 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.834+0000 7f4173e00700 1 -- 172.21.15.82:0/1191349468 learned_addr learned my addr 172.21.15.82:0/1191349468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173e00700 1 -- 172.21.15.82:0/1191349468 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f417c0af330 msgr2=0x7f417c1515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173e00700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f417c0af330 0x7f417c1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f417be00700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c1597e0 0x7f417c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173e00700 1 -- 172.21.15.82:0/1191349468 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c1597e0 msgr2=0x7f417c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173e00700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c1597e0 0x7f417c159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173e00700 1 -- 172.21.15.82:0/1191349468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174009a70 con 0x7f417c0c6db0 2024-05-10T04:51:43.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173e00700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c15f3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f416400d800 tx=0x7f416400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:43.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173400700 1 -- 172.21.15.82:0/1191349468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41640125f0 con 0x7f417c0c6db0 2024-05-10T04:51:43.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173400700 1 -- 172.21.15.82:0/1191349468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164012750 con 0x7f417c0c6db0 2024-05-10T04:51:43.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c0ce0d0 con 0x7f417c0c6db0 2024-05-10T04:51:43.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.835+0000 7f4173400700 1 -- 172.21.15.82:0/1191349468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164012b00 con 0x7f417c0c6db0 2024-05-10T04:51:43.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.836+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c15a180 con 0x7f417c0c6db0 2024-05-10T04:51:43.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.837+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c067760 con 0x7f417c0c6db0 2024-05-10T04:51:43.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.838+0000 7f4173400700 1 -- 172.21.15.82:0/1191349468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4164012c60 con 0x7f417c0c6db0 2024-05-10T04:51:43.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.838+0000 7f4173400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f415806ac90 0x7f415806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:43.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.838+0000 7f4173400700 1 -- 172.21.15.82:0/1191349468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4164089600 con 0x7f417c0c6db0 2024-05-10T04:51:43.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.839+0000 7f417b400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f415806ac90 0x7f415806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:43.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.839+0000 7f417b400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f415806ac90 0x7f415806d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f417c0b2fa0 tx=0x7f416c007ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:43.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:43.843+0000 7f4173400700 1 -- 172.21.15.82:0/1191349468 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f41640546b0 con 0x7f417c0c6db0 2024-05-10T04:51:44.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.088+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f417c074af0 con 0x7f417c0c6db0 2024-05-10T04:51:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.089+0000 7f4173400700 1 -- 172.21.15.82:0/1191349468 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f4164057cd0 con 0x7f417c0c6db0 2024-05-10T04:51:44.090 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:44.090 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:51:36.561071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6836/3440576054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3440576054},{"type":"v1","addr":"172.21.15.82:6836","nonce":3440576054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:51:44.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f415806ac90 msgr2=0x7f415806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f415806ac90 0x7f415806d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f417c0b2fa0 tx=0x7f416c007ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 msgr2=0x7f417c15f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c15f3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f416400d800 tx=0x7f416400dbc0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 shutdown_connections 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f415806ac90 0x7f415806d1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c1597e0 0x7f417c159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f417c0af330 0x7f417c1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 --2- 172.21.15.82:0/1191349468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f417c0c6db0 0x7f417c15f3c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 >> 172.21.15.82:0/1191349468 conn(0x7f417c099a70 msgr2=0x7f417c0b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 shutdown_connections 2024-05-10T04:51:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.091+0000 7f4182400700 1 -- 172.21.15.82:0/1191349468 wait complete. 2024-05-10T04:51:44.094 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-05-10T04:51:44.120 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-05-10T04:51:44.419 INFO:teuthology.orchestra.run.smithi082.stdout:{"message":"","return_code":0} 2024-05-10T04:51:44.419 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-10T04:51:44.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:44.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.683+0000 7f26c7c00700 1 Processor -- start 2024-05-10T04:51:44.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.683+0000 7f26c7c00700 1 -- start start 2024-05-10T04:51:44.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c7c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c0162c30 0x7f26c00b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c7c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26c00d2e60 0x7f26c015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c7c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c01627a0 con 0x7f26c00b5ee0 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c7c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c0163040 con 0x7f26c00d2e60 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c7c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c015fa20 con 0x7f26c0162c30 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c5c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26c00d2e60 0x7f26c015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c5c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26c00d2e60 0x7f26c015e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54164/0 (socket says 172.21.15.82:54164) 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c5c00700 1 -- 172.21.15.82:0/1659869557 learned_addr learned my addr 172.21.15.82:0/1659869557 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26bfe00700 1 --1- 172.21.15.82:0/1659869557 >> v1:172.21.15.82:6789/0 conn(0x7f26c00b5ee0 0x7f26c00d2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41994/0 (socket says 172.21.15.82:41994) 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.685+0000 7f26c5200700 1 --2- 172.21.15.82:0/1659869557 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c0162c30 0x7f26c00b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26c5c00700 1 -- 172.21.15.82:0/1659869557 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c0162c30 msgr2=0x7f26c00b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26c5c00700 1 --2- 172.21.15.82:0/1659869557 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c0162c30 0x7f26c00b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26c5c00700 1 -- 172.21.15.82:0/1659869557 >> v1:172.21.15.82:6789/0 conn(0x7f26c00b5ee0 legacy=0x7f26c00d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26c5c00700 1 -- 172.21.15.82:0/1659869557 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c00b62f0 con 0x7f26c00d2e60 2024-05-10T04:51:44.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26bf400700 1 -- 172.21.15.82:0/1659869557 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631583124 0 0) 0x7f26c01627a0 con 0x7f26c00b5ee0 2024-05-10T04:51:44.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26c5c00700 1 --2- 172.21.15.82:0/1659869557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c00d2e60 0x7f26c015e4d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009e50 tx=0x7f26b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebdfbb8babbe6ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:44.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26bf400700 1 -- 172.21.15.82:0/1659869557 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800e070 con 0x7f26c00d2e60 2024-05-10T04:51:44.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26bf400700 1 -- 172.21.15.82:0/1659869557 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b800b9c0 con 0x7f26c00d2e60 2024-05-10T04:51:44.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.686+0000 7f26bf400700 1 -- 172.21.15.82:0/1659869557 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800bd70 con 0x7f26c00d2e60 2024-05-10T04:51:44.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.687+0000 7f26c7c00700 1 -- 172.21.15.82:0/1659869557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c00d2e60 msgr2=0x7f26c015e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.687+0000 7f26c7c00700 1 --2- 172.21.15.82:0/1659869557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c00d2e60 0x7f26c015e4d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009e50 tx=0x7f26b800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:44.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.687+0000 7f26c7c00700 1 -- 172.21.15.82:0/1659869557 shutdown_connections 2024-05-10T04:51:44.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.687+0000 7f26c7c00700 1 --2- 172.21.15.82:0/1659869557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c00d2e60 0x7f26c015e4d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.687+0000 7f26c7c00700 1 --2- 172.21.15.82:0/1659869557 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c0162c30 0x7f26c00b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.687+0000 7f26c7c00700 1 -- 172.21.15.82:0/1659869557 >> 172.21.15.82:0/1659869557 conn(0x7f26c00d0b80 msgr2=0x7f26c00d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:44.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.687+0000 7f26c7c00700 1 -- 172.21.15.82:0/1659869557 shutdown_connections 2024-05-10T04:51:44.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.687+0000 7f26c7c00700 1 -- 172.21.15.82:0/1659869557 wait complete. 2024-05-10T04:51:44.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.689+0000 7f26c7c00700 1 Processor -- start 2024-05-10T04:51:44.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.689+0000 7f26c7c00700 1 -- start start 2024-05-10T04:51:44.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c7c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26c00b5ee0 0x7f26c0158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c7c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c00d2e60 0x7f26c0147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c7c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c0162c30 0x7f26c00ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c7c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00cbcb0 con 0x7f26c0162c30 2024-05-10T04:51:44.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c7c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00ceb10 con 0x7f26c00b5ee0 2024-05-10T04:51:44.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c7c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c0157d80 con 0x7f26c00d2e60 2024-05-10T04:51:44.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c0162c30 0x7f26c00ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c0162c30 0x7f26c00ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54168/0 (socket says 172.21.15.82:54168) 2024-05-10T04:51:44.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c5c00700 1 -- 172.21.15.82:0/181746355 learned_addr learned my addr 172.21.15.82:0/181746355 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:44.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26bfe00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c00d2e60 0x7f26c0147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.691+0000 7f26c5200700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26c00b5ee0 0x7f26c0158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26c5c00700 1 -- 172.21.15.82:0/181746355 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c00d2e60 msgr2=0x7f26c0147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26c5c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c00d2e60 0x7f26c0147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26c5c00700 1 -- 172.21.15.82:0/181746355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26c00b5ee0 msgr2=0x7f26c0158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26c5c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26c00b5ee0 0x7f26c0158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26c5c00700 1 -- 172.21.15.82:0/181746355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8009b30 con 0x7f26c0162c30 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26c5c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c0162c30 0x7f26c00ce1a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f26b800b730 tx=0x7f26b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26bcc00700 1 -- 172.21.15.82:0/181746355 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8003e80 con 0x7f26c0162c30 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26bcc00700 1 -- 172.21.15.82:0/181746355 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b80092e0 con 0x7f26c0162c30 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c0157ff0 con 0x7f26c0162c30 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26bcc00700 1 -- 172.21.15.82:0/181746355 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b801b650 con 0x7f26c0162c30 2024-05-10T04:51:44.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.692+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c01585b0 con 0x7f26c0162c30 2024-05-10T04:51:44.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.694+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c00732b0 con 0x7f26c0162c30 2024-05-10T04:51:44.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.694+0000 7f26bcc00700 1 -- 172.21.15.82:0/181746355 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f26b801b7b0 con 0x7f26c0162c30 2024-05-10T04:51:44.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.695+0000 7f26bcc00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26a006acc0 0x7f26a006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.695+0000 7f26bcc00700 1 -- 172.21.15.82:0/181746355 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26b808a950 con 0x7f26c0162c30 2024-05-10T04:51:44.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.696+0000 7f26c5200700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26a006acc0 0x7f26a006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.696+0000 7f26c5200700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26a006acc0 0x7f26a006d1d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f26b400b9b0 tx=0x7f26b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:44.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.701+0000 7f26bcc00700 1 -- 172.21.15.82:0/181746355 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f26b8055b30 con 0x7f26c0162c30 2024-05-10T04:51:44.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.947+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26c0158740 con 0x7f26c0162c30 2024-05-10T04:51:44.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.948+0000 7f26bcc00700 1 -- 172.21.15.82:0/181746355 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f26b8059150 con 0x7f26c0162c30 2024-05-10T04:51:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:44.950 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:51:36.561071+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5067":{"gid":5067,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6836/3440576054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3440576054},{"type":"v1","addr":"172.21.15.82:6836","nonce":3440576054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:51:44.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26a006acc0 msgr2=0x7f26a006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26a006acc0 0x7f26a006d1d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f26b400b9b0 tx=0x7f26b4008040 comp rx=0 tx=0).stop 2024-05-10T04:51:44.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c0162c30 msgr2=0x7f26c00ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c0162c30 0x7f26c00ce1a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f26b800b730 tx=0x7f26b8004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 shutdown_connections 2024-05-10T04:51:44.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26a006acc0 0x7f26a006d1d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26c0162c30 0x7f26c00ce1a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26c00b5ee0 0x7f26c0158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 --2- 172.21.15.82:0/181746355 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26c00d2e60 0x7f26c0147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 >> 172.21.15.82:0/181746355 conn(0x7f26c00d0b80 msgr2=0x7f26c015cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:44.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 shutdown_connections 2024-05-10T04:51:44.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:44.951+0000 7f26c7c00700 1 -- 172.21.15.82:0/181746355 wait complete. 2024-05-10T04:51:44.955 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-05-10T04:51:44.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_log_pause 1 2024-05-10T04:51:45.264 INFO:teuthology.orchestra.run.smithi082.stdout:{"success":"mds_log_pause = '' "} 2024-05-10T04:51:45.264 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_log_pause = '' " } 2024-05-10T04:51:45.264 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-10T04:51:45.265 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-05-10T04:51:45.265 DEBUG:teuthology.orchestra.run.smithi082:> os.chdir("/home/ubuntu/cephtest/mnt.0/testdir") 2024-05-10T04:51:45.265 DEBUG:teuthology.orchestra.run.smithi082:> os.setgid(65534) 2024-05-10T04:51:45.265 DEBUG:teuthology.orchestra.run.smithi082:> os.setuid(65534) 2024-05-10T04:51:45.265 DEBUG:teuthology.orchestra.run.smithi082:> fd = os.open("testfile", os.O_CREAT | os.O_RDWR, 0o644) 2024-05-10T04:51:45.265 DEBUG:teuthology.orchestra.run.smithi082:> os.fchmod(fd, 0o640) 2024-05-10T04:51:45.265 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-05-10T04:51:45.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:51:45.584 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod 600 /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-05-10T04:51:55.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 2:0 2024-05-10T04:51:55.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.901+0000 7fce95000700 1 Processor -- start 2024-05-10T04:51:55.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.902+0000 7fce95000700 1 -- start start 2024-05-10T04:51:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.903+0000 7fce95000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fce90162bc0 0x7fce900b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.903+0000 7fce95000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce900b5bf0 0x7fce900b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.903+0000 7fce95000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9015f960 con 0x7fce900d2710 2024-05-10T04:51:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.903+0000 7fce95000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900b6540 con 0x7fce900b5bf0 2024-05-10T04:51:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.903+0000 7fce95000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9015f680 con 0x7fce90162bc0 2024-05-10T04:51:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce87e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce900b5bf0 0x7fce900b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce87e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce900b5bf0 0x7fce900b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56830/0 (socket says 172.21.15.82:56830) 2024-05-10T04:51:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce87e00700 1 -- 172.21.15.82:0/1155726495 learned_addr learned my addr 172.21.15.82:0/1155726495 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce8de00700 1 --2- 172.21.15.82:0/1155726495 >> v2:172.21.15.129:3300/0 conn(0x7fce90162bc0 0x7fce900b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce87e00700 1 -- 172.21.15.82:0/1155726495 >> v2:172.21.15.129:3300/0 conn(0x7fce90162bc0 msgr2=0x7fce900b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce87e00700 1 --2- 172.21.15.82:0/1155726495 >> v2:172.21.15.129:3300/0 conn(0x7fce90162bc0 0x7fce900b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce87e00700 1 -- 172.21.15.82:0/1155726495 >> v1:172.21.15.129:6789/0 conn(0x7fce900d2710 legacy=0x7fce900d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce87e00700 1 -- 172.21.15.82:0/1155726495 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce901620e0 con 0x7fce900b5bf0 2024-05-10T04:51:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.904+0000 7fce87e00700 1 --2- 172.21.15.82:0/1155726495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900b5bf0 0x7fce900b6000 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fce900d0790 tx=0x7fce78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a668a647a7595f0d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce8d400700 1 -- 172.21.15.82:0/1155726495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78005e30 con 0x7fce900b5bf0 2024-05-10T04:51:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce8d400700 1 -- 172.21.15.82:0/1155726495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78004030 con 0x7fce900b5bf0 2024-05-10T04:51:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce8d400700 1 -- 172.21.15.82:0/1155726495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780043e0 con 0x7fce900b5bf0 2024-05-10T04:51:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce95000700 1 -- 172.21.15.82:0/1155726495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900b5bf0 msgr2=0x7fce900b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce95000700 1 --2- 172.21.15.82:0/1155726495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900b5bf0 0x7fce900b6000 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fce900d0790 tx=0x7fce78009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce95000700 1 -- 172.21.15.82:0/1155726495 shutdown_connections 2024-05-10T04:51:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce95000700 1 --2- 172.21.15.82:0/1155726495 >> v2:172.21.15.129:3300/0 conn(0x7fce90162bc0 0x7fce900b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce95000700 1 --2- 172.21.15.82:0/1155726495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900b5bf0 0x7fce900b6000 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.905+0000 7fce95000700 1 -- 172.21.15.82:0/1155726495 >> 172.21.15.82:0/1155726495 conn(0x7fce900d0c30 msgr2=0x7fce900d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.906+0000 7fce95000700 1 -- 172.21.15.82:0/1155726495 shutdown_connections 2024-05-10T04:51:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.906+0000 7fce95000700 1 -- 172.21.15.82:0/1155726495 wait complete. 2024-05-10T04:51:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.908+0000 7fce95000700 1 Processor -- start 2024-05-10T04:51:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.908+0000 7fce95000700 1 -- start start 2024-05-10T04:51:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.909+0000 7fce95000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce900b5bf0 0x7fce900ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.909+0000 7fce95000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900d2710 0x7fce901f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.909+0000 7fce95000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce90162bc0 0x7fce900cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce95000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce901f5290 con 0x7fce900d2710 2024-05-10T04:51:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce95000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900cd4a0 con 0x7fce90162bc0 2024-05-10T04:51:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce95000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce900cd6f0 con 0x7fce900b5bf0 2024-05-10T04:51:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900d2710 0x7fce901f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900d2710 0x7fce901f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56838/0 (socket says 172.21.15.82:56838) 2024-05-10T04:51:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 -- 172.21.15.82:0/145509713 learned_addr learned my addr 172.21.15.82:0/145509713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce8de00700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce900b5bf0 0x7fce900ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce8e800700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce90162bc0 0x7fce900cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 -- 172.21.15.82:0/145509713 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce900b5bf0 msgr2=0x7fce900ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce900b5bf0 0x7fce900ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 -- 172.21.15.82:0/145509713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce90162bc0 msgr2=0x7fce900cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce90162bc0 0x7fce900cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 -- 172.21.15.82:0/145509713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78009500 con 0x7fce900d2710 2024-05-10T04:51:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.910+0000 7fce87e00700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900d2710 0x7fce901f4640 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fce78014040 tx=0x7fce78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.911+0000 7fce86000700 1 -- 172.21.15.82:0/145509713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78003d60 con 0x7fce900d2710 2024-05-10T04:51:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.911+0000 7fce86000700 1 -- 172.21.15.82:0/145509713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7801c420 con 0x7fce900d2710 2024-05-10T04:51:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.911+0000 7fce86000700 1 -- 172.21.15.82:0/145509713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7801c7d0 con 0x7fce900d2710 2024-05-10T04:51:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.911+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce900cd9d0 con 0x7fce900d2710 2024-05-10T04:51:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.911+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce900cdf90 con 0x7fce900d2710 2024-05-10T04:51:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.912+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce900ce5e0 con 0x7fce900d2710 2024-05-10T04:51:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.913+0000 7fce86000700 1 -- 172.21.15.82:0/145509713 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce7801c930 con 0x7fce900d2710 2024-05-10T04:51:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.914+0000 7fce86000700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6c06ac90 0x7fce6c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.914+0000 7fce86000700 1 -- 172.21.15.82:0/145509713 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce7808a490 con 0x7fce900d2710 2024-05-10T04:51:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.914+0000 7fce8de00700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6c06ac90 0x7fce6c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.915+0000 7fce8de00700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6c06ac90 0x7fce6c06d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fce80006b20 tx=0x7fce80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:55.919+0000 7fce86000700 1 -- 172.21.15.82:0/145509713 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fce78055660 con 0x7fce900d2710 2024-05-10T04:51:56.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.205+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "2:0"} v 0) v1 -- 0x7fce90074af0 con 0x7fce900d2710 2024-05-10T04:51:56.208 INFO:tasks.ceph.mon.a.smithi082.stderr:2024-05-10T04:51:56.206+0000 7fcf99200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T04:51:56.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.219+0000 7fce86000700 1 -- 172.21.15.82:0/145509713 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "2:0"}]=0 failed mds gid 5067 v17) v1 ==== 97+0+0 (secure 0 0 0) 0x7fce78058c80 con 0x7fce900d2710 2024-05-10T04:51:56.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6c06ac90 msgr2=0x7fce6c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6c06ac90 0x7fce6c06d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fce80006b20 tx=0x7fce80008040 comp rx=0 tx=0).stop 2024-05-10T04:51:56.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900d2710 msgr2=0x7fce901f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900d2710 0x7fce901f4640 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fce78014040 tx=0x7fce78004750 comp rx=0 tx=0).stop 2024-05-10T04:51:56.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 shutdown_connections 2024-05-10T04:51:56.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6c06ac90 0x7fce6c06d1a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce90162bc0 0x7fce900cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce900b5bf0 0x7fce900ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 --2- 172.21.15.82:0/145509713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce900d2710 0x7fce901f4640 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 >> 172.21.15.82:0/145509713 conn(0x7fce900d0c30 msgr2=0x7fce900b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 shutdown_connections 2024-05-10T04:51:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.222+0000 7fce95000700 1 -- 172.21.15.82:0/145509713 wait complete. 2024-05-10T04:51:56.225 INFO:teuthology.orchestra.run.smithi082.stderr:failed mds gid 5067 2024-05-10T04:51:56.229 INFO:tasks.ceph.mds.c.smithi082.stderr: -4127> 2024-05-10T04:51:34.144+0000 7f72fde00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:51:56.256 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:56.366 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2024-05-10T04:51:56.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.522+0000 7f02d1c00700 1 Processor -- start 2024-05-10T04:51:56.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.522+0000 7f02d1c00700 1 -- start start 2024-05-10T04:51:56.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02d1c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc0b9500 0x7f02cc161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02d1c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc162ef0 con 0x7f02cc0d3060 2024-05-10T04:51:56.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02d1c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc162930 con 0x7f02cc0b6020 2024-05-10T04:51:56.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02d1c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc162c10 con 0x7f02cc0b9500 2024-05-10T04:51:56.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02ca000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f02cc0d3060 0x7f02cc0b5910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52402/0 (socket says 172.21.15.82:52402) 2024-05-10T04:51:56.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02ca000700 1 -- 172.21.15.82:0/3262621900 learned_addr learned my addr 172.21.15.82:0/3262621900 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:51:56.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875102140 0 0) 0x7f02cc162ef0 con 0x7f02cc0d3060 2024-05-10T04:51:56.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b00035b0 con 0x7f02cc0d3060 2024-05-10T04:51:56.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.524+0000 7f02caa00700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc0b9500 0x7f02cc161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1384340618 0 0) 0x7f02b00035b0 con 0x7f02cc0d3060 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc0b9500 msgr2=0x7f02cc161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc0b9500 0x7f02cc161fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 >> v1:172.21.15.129:6789/0 conn(0x7f02cc0b6020 legacy=0x7f02cc0b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc0d2860 con 0x7f02cc0d3060 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f02b8001670 con 0x7f02cc0d3060 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 >> v1:172.21.15.82:6789/0 conn(0x7f02cc0d3060 legacy=0x7f02cc0b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc0b9500 0x7f02b0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0003fb0 0x7f02b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b0004d90 0x7f02b0005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc162c10 con 0x7f02b0004d90 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b000bcd0 con 0x7f02b0003fb0 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b000be90 con 0x7f02cc0b9500 2024-05-10T04:51:56.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02cb400700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b0004d90 0x7f02b0005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02ca000700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0003fb0 0x7f02b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.525+0000 7f02caa00700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc0b9500 0x7f02b0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02cb400700 1 -- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc0b9500 msgr2=0x7f02b0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02cb400700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc0b9500 0x7f02b0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02cb400700 1 -- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0003fb0 msgr2=0x7f02b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02cb400700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0003fb0 0x7f02b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02cb400700 1 -- 172.21.15.82:0/3262621900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00035b0 con 0x7f02b0004d90 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02cb400700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b0004d90 0x7f02b0005240 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c160 tx=0x7f02b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5cd203724e4752 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4001db0 con 0x7f02b0004d90 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c400cca0 con 0x7f02b0004d90 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.526+0000 7f02c9600700 1 -- 172.21.15.82:0/3262621900 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4003c40 con 0x7f02b0004d90 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.527+0000 7f02d1c00700 1 -- 172.21.15.82:0/3262621900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b0004d90 msgr2=0x7f02b0005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.527+0000 7f02d1c00700 1 --2- 172.21.15.82:0/3262621900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02b0004d90 0x7f02b0005240 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c160 tx=0x7f02b0005880 comp rx=0 tx=0).stop 2024-05-10T04:51:56.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.527+0000 7f02cb400700 1 -- 172.21.15.82:0/3262621900 reap_dead start 2024-05-10T04:51:56.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.527+0000 7f02d1c00700 1 -- 172.21.15.82:0/3262621900 shutdown_connections 2024-05-10T04:51:56.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.527+0000 7f02d1c00700 1 -- 172.21.15.82:0/3262621900 >> 172.21.15.82:0/3262621900 conn(0x7f02cc0d0af0 msgr2=0x7f02cc0d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:56.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.527+0000 7f02d1c00700 1 -- 172.21.15.82:0/3262621900 shutdown_connections 2024-05-10T04:51:56.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.527+0000 7f02d1c00700 1 -- 172.21.15.82:0/3262621900 wait complete. 2024-05-10T04:51:56.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.529+0000 7f02d1c00700 1 Processor -- start 2024-05-10T04:51:56.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.529+0000 7f02d1c00700 1 -- start start 2024-05-10T04:51:56.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02d1c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0004d90 0x7f02cc149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02d1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02cc15d620 0x7f02cc1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02d1c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc15da30 0x7f02cc158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02d1c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc14a760 con 0x7f02cc15d620 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02d1c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc1576c0 con 0x7f02b0004d90 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02d1c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc157410 con 0x7f02cc15da30 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02ca000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02cc15d620 0x7f02cc1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02ca000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02cc15d620 0x7f02cc1589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56868/0 (socket says 172.21.15.82:56868) 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02ca000700 1 -- 172.21.15.82:0/4043298561 learned_addr learned my addr 172.21.15.82:0/4043298561 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02caa00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0004d90 0x7f02cc149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02cb400700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc15da30 0x7f02cc158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02ca000700 1 -- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc15da30 msgr2=0x7f02cc158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02ca000700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc15da30 0x7f02cc158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02ca000700 1 -- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0004d90 msgr2=0x7f02cc149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02ca000700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0004d90 0x7f02cc149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02ca000700 1 -- 172.21.15.82:0/4043298561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc157910 con 0x7f02cc15d620 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.531+0000 7f02caa00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0004d90 0x7f02cc149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.532+0000 7f02ca000700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02cc15d620 0x7f02cc1589b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f02b8007290 tx=0x7f02b8007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.532+0000 7f02c2a00700 1 -- 172.21.15.82:0/4043298561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b800f850 con 0x7f02cc15d620 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.532+0000 7f02c2a00700 1 -- 172.21.15.82:0/4043298561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b800f9f0 con 0x7f02cc15d620 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.532+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc157bf0 con 0x7f02cc15d620 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.532+0000 7f02c2a00700 1 -- 172.21.15.82:0/4043298561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b800fda0 con 0x7f02cc15d620 2024-05-10T04:51:56.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.532+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc1581b0 con 0x7f02cc15d620 2024-05-10T04:51:56.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.533+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc0732b0 con 0x7f02cc15d620 2024-05-10T04:51:56.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.534+0000 7f02c2a00700 1 -- 172.21.15.82:0/4043298561 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f02b801d460 con 0x7f02cc15d620 2024-05-10T04:51:56.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.535+0000 7f02c2a00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f02ac06ac90 0x7f02ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.535+0000 7f02c2a00700 1 -- 172.21.15.82:0/4043298561 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f02b80894d0 con 0x7f02cc15d620 2024-05-10T04:51:56.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.535+0000 7f02caa00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f02ac06ac90 0x7f02ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.536+0000 7f02caa00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f02ac06ac90 0x7f02ac06d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009c60 tx=0x7f02bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:56.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.540+0000 7f02c2a00700 1 -- 172.21.15.82:0/4043298561 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f02b80545b0 con 0x7f02cc15d620 2024-05-10T04:51:56.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.793+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02cc074af0 con 0x7f02cc15d620 2024-05-10T04:51:56.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.793+0000 7f02c2a00700 1 -- 172.21.15.82:0/4043298561 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3984 (secure 0 0 0) 0x7f02b8057bd0 con 0x7f02cc15d620 2024-05-10T04:51:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:56.795 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:51:56.220732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4975},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4975":{"gid":4975,"name":"b","rank":0,"incarnation":18,"state":"up:replay","state_seq":1,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:51:56.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f02ac06ac90 msgr2=0x7f02ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f02ac06ac90 0x7f02ac06d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009c60 tx=0x7f02bc008040 comp rx=0 tx=0).stop 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02cc15d620 msgr2=0x7f02cc1589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02cc15d620 0x7f02cc1589b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f02b8007290 tx=0x7f02b8007650 comp rx=0 tx=0).stop 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 shutdown_connections 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f02ac06ac90 0x7f02ac06d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f02cc15da30 0x7f02cc158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f02b0004d90 0x7f02cc149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 --2- 172.21.15.82:0/4043298561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02cc15d620 0x7f02cc1589b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 >> 172.21.15.82:0/4043298561 conn(0x7f02cc0d0af0 msgr2=0x7f02cc160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 shutdown_connections 2024-05-10T04:51:56.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:56.796+0000 7f02d1c00700 1 -- 172.21.15.82:0/4043298561 wait complete. 2024-05-10T04:51:56.799 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2024-05-10T04:51:57.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:51:33.124469+0000', 'modified': '2024-05-10T04:51:56.220732+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4975}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4975': {'gid': 4975, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.129:6835/2037696235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6832', 'nonce': 2037696235}, {'type': 'v1', 'addr': '172.21.15.129:6835', 'nonce': 2037696235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T04:51:57.226 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4975:up:replay 2024-05-10T04:51:58.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:58.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.496+0000 7fc3e8c00700 1 Processor -- start 2024-05-10T04:51:58.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.496+0000 7fc3e8c00700 1 -- start start 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e8c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e4162c30 0x7fc3e40b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e8c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc3e40b5ee0 0x7fc3e40d2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e8c00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e41627a0 con 0x7fc3e40d2c90 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e8c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e4163040 con 0x7fc3e40b5ee0 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e8c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e415f4e0 con 0x7fc3e4162c30 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e1400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc3e40b5ee0 0x7fc3e40d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e1e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e4162c30 0x7fc3e40b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e1400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc3e40b5ee0 0x7fc3e40d2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:41262/0 (socket says 172.21.15.82:41262) 2024-05-10T04:51:58.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.498+0000 7fc3e1400700 1 -- 172.21.15.82:0/1545884009 learned_addr learned my addr 172.21.15.82:0/1545884009 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:58.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.499+0000 7fc3e1e00700 1 -- 172.21.15.82:0/1545884009 >> v2:172.21.15.129:3300/0 conn(0x7fc3e40b5ee0 msgr2=0x7fc3e40d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:58.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.499+0000 7fc3e1e00700 1 --2- 172.21.15.82:0/1545884009 >> v2:172.21.15.129:3300/0 conn(0x7fc3e40b5ee0 0x7fc3e40d2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.499+0000 7fc3e1e00700 1 -- 172.21.15.82:0/1545884009 >> v1:172.21.15.129:6789/0 conn(0x7fc3e40d2c90 legacy=0x7fc3e406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.499+0000 7fc3e1e00700 1 -- 172.21.15.82:0/1545884009 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e415fa20 con 0x7fc3e4162c30 2024-05-10T04:51:58.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.499+0000 7fc3e1400700 1 --2- 172.21.15.82:0/1545884009 >> v2:172.21.15.129:3300/0 conn(0x7fc3e40b5ee0 0x7fc3e40d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:58.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.499+0000 7fc3e1e00700 1 --2- 172.21.15.82:0/1545884009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e4162c30 0x7fc3e40b59a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009840 tx=0x7fc3d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a4c02d6dfa445d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e0a00700 1 -- 172.21.15.82:0/1545884009 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011830 con 0x7fc3e4162c30 2024-05-10T04:51:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e0a00700 1 -- 172.21.15.82:0/1545884009 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d4011990 con 0x7fc3e4162c30 2024-05-10T04:51:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e0a00700 1 -- 172.21.15.82:0/1545884009 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011d20 con 0x7fc3e4162c30 2024-05-10T04:51:58.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1545884009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e4162c30 msgr2=0x7fc3e40b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1545884009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e4162c30 0x7fc3e40b59a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009840 tx=0x7fc3d4009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1545884009 shutdown_connections 2024-05-10T04:51:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1545884009 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e4162c30 0x7fc3e40b59a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1545884009 >> v2:172.21.15.129:3300/0 conn(0x7fc3e40b5ee0 0x7fc3e40d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.500+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1545884009 >> 172.21.15.82:0/1545884009 conn(0x7fc3e40d0b80 msgr2=0x7fc3e40d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.501+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1545884009 shutdown_connections 2024-05-10T04:51:58.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.501+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1545884009 wait complete. 2024-05-10T04:51:58.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.503+0000 7fc3e8c00700 1 Processor -- start 2024-05-10T04:51:58.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.503+0000 7fc3e8c00700 1 -- start start 2024-05-10T04:51:58.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.504+0000 7fc3e8c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3e40b5ee0 0x7fc3e40ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.504+0000 7fc3e8c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e40d2c90 0x7fc3e41f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.504+0000 7fc3e8c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e4162c30 0x7fc3e4157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.504+0000 7fc3e8c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41f4dd0 con 0x7fc3e4162c30 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.504+0000 7fc3e8c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4156050 con 0x7fc3e40b5ee0 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.504+0000 7fc3e8c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4155da0 con 0x7fc3e40d2c90 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e4162c30 0x7fc3e4157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e4162c30 0x7fc3e4157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56878/0 (socket says 172.21.15.82:56878) 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 -- 172.21.15.82:0/1662973473 learned_addr learned my addr 172.21.15.82:0/1662973473 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e1e00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3e40b5ee0 0x7fc3e40ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e1400700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e40d2c90 0x7fc3e41f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 -- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e40d2c90 msgr2=0x7fc3e41f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e40d2c90 0x7fc3e41f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 -- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3e40b5ee0 msgr2=0x7fc3e40ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3e40b5ee0 0x7fc3e40ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 -- 172.21.15.82:0/1662973473 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d0009550 con 0x7fc3e4162c30 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e1400700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e40d2c90 0x7fc3e41f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e1e00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3e40b5ee0 0x7fc3e40ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.505+0000 7fc3e2800700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e4162c30 0x7fc3e4157340 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00cb50 tx=0x7fc3dc00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.506+0000 7fc3da000700 1 -- 172.21.15.82:0/1662973473 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc003c00 con 0x7fc3e4162c30 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.506+0000 7fc3da000700 1 -- 172.21.15.82:0/1662973473 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc003d60 con 0x7fc3e4162c30 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.506+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d40094a0 con 0x7fc3e4162c30 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.506+0000 7fc3da000700 1 -- 172.21.15.82:0/1662973473 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00ab70 con 0x7fc3e4162c30 2024-05-10T04:51:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.506+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e4156580 con 0x7fc3e4162c30 2024-05-10T04:51:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.507+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e40732b0 con 0x7fc3e4162c30 2024-05-10T04:51:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.508+0000 7fc3da000700 1 -- 172.21.15.82:0/1662973473 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3dc00acd0 con 0x7fc3e4162c30 2024-05-10T04:51:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.509+0000 7fc3da000700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc3c406ac90 0x7fc3c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.509+0000 7fc3da000700 1 -- 172.21.15.82:0/1662973473 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc3dc0894a0 con 0x7fc3e4162c30 2024-05-10T04:51:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.509+0000 7fc3e1e00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc3c406ac90 0x7fc3c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.510+0000 7fc3e1e00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc3c406ac90 0x7fc3c406d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009fd0 tx=0x7fc3d4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.514+0000 7fc3da000700 1 -- 172.21.15.82:0/1662973473 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc3dc054580 con 0x7fc3e4162c30 2024-05-10T04:51:58.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.761+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3e4074af0 con 0x7fc3e4162c30 2024-05-10T04:51:58.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.761+0000 7fc3da000700 1 -- 172.21.15.82:0/1662973473 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fc3dc057ba0 con 0x7fc3e4162c30 2024-05-10T04:51:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:51:58.763 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3738724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3738724499},{"type":"v1","addr":"172.21.15.82:6836","nonce":3738724499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:51:58.225197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4975},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4975":{"gid":4975,"name":"b","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc3c406ac90 msgr2=0x7fc3c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc3c406ac90 0x7fc3c406d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009fd0 tx=0x7fc3d4008030 comp rx=0 tx=0).stop 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e4162c30 msgr2=0x7fc3e4157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e4162c30 0x7fc3e4157340 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00cb50 tx=0x7fc3dc00cf10 comp rx=0 tx=0).stop 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 shutdown_connections 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc3c406ac90 0x7fc3c406d1a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e4162c30 0x7fc3e4157340 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc3e40b5ee0 0x7fc3e40ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 --2- 172.21.15.82:0/1662973473 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc3e40d2c90 0x7fc3e41f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 >> 172.21.15.82:0/1662973473 conn(0x7fc3e40d0b80 msgr2=0x7fc3e40d39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:58.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 shutdown_connections 2024-05-10T04:51:58.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:51:58.764+0000 7fc3e8c00700 1 -- 172.21.15.82:0/1662973473 wait complete. 2024-05-10T04:51:58.767 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 20 2024-05-10T04:51:59.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:51:33.124469+0000', 'modified': '2024-05-10T04:51:58.225197+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4975}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4975': {'gid': 4975, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:rejoin', 'state_seq': 11, 'addr': '172.21.15.129:6835/2037696235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6832', 'nonce': 2037696235}, {'type': 'v1', 'addr': '172.21.15.129:6835', 'nonce': 2037696235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T04:51:59.195 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4975:up:rejoin 2024-05-10T04:52:00.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:00.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.467+0000 7f5609600700 1 Processor -- start 2024-05-10T04:52:00.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.467+0000 7f5609600700 1 -- start start 2024-05-10T04:52:00.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.469+0000 7f5609600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f560415bfe0 0x7f560415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f5609600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f56040b5fa0 0x7f56041623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f5609600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5604162a70 con 0x7f5604161fb0 2024-05-10T04:52:00.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f5609600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560415c3f0 con 0x7f56040b5fa0 2024-05-10T04:52:00.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f5609600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5604162d50 con 0x7f560415bfe0 2024-05-10T04:52:00.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f55fa000700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5604161fb0 0x7f56040b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52406/0 (socket says 172.21.15.82:52406) 2024-05-10T04:52:00.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f55fa000700 1 -- 172.21.15.82:0/3301055018 learned_addr learned my addr 172.21.15.82:0/3301055018 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:00.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f5602a00700 1 --2- 172.21.15.82:0/3301055018 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f560415bfe0 0x7f560415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f5603400700 1 --2- 172.21.15.82:0/3301055018 >> v2:172.21.15.129:3300/0 conn(0x7f56040b5fa0 0x7f56041623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f5602000700 1 -- 172.21.15.82:0/3301055018 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815279231 0 0) 0x7f5604162a70 con 0x7f5604161fb0 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.470+0000 7f5602000700 1 -- 172.21.15.82:0/3301055018 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e80035b0 con 0x7f5604161fb0 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5602a00700 1 -- 172.21.15.82:0/3301055018 >> v2:172.21.15.129:3300/0 conn(0x7f56040b5fa0 msgr2=0x7f56041623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5602a00700 1 --2- 172.21.15.82:0/3301055018 >> v2:172.21.15.129:3300/0 conn(0x7f56040b5fa0 0x7f56041623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5602a00700 1 -- 172.21.15.82:0/3301055018 >> v1:172.21.15.82:6789/0 conn(0x7f5604161fb0 legacy=0x7f56040b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5602a00700 1 -- 172.21.15.82:0/3301055018 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560415ecf0 con 0x7f560415bfe0 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5603400700 1 --2- 172.21.15.82:0/3301055018 >> v2:172.21.15.129:3300/0 conn(0x7f56040b5fa0 0x7f56041623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5602a00700 1 --2- 172.21.15.82:0/3301055018 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f560415bfe0 0x7f560415f4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009d90 tx=0x7f55f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa02b8e3896897d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5602000700 1 -- 172.21.15.82:0/3301055018 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400e070 con 0x7f560415bfe0 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5602000700 1 -- 172.21.15.82:0/3301055018 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f400bb20 con 0x7f560415bfe0 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.471+0000 7f5602000700 1 -- 172.21.15.82:0/3301055018 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400be90 con 0x7f560415bfe0 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.472+0000 7f5609600700 1 -- 172.21.15.82:0/3301055018 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f560415bfe0 msgr2=0x7f560415f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.472+0000 7f5609600700 1 --2- 172.21.15.82:0/3301055018 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f560415bfe0 0x7f560415f4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009d90 tx=0x7f55f400b330 comp rx=0 tx=0).stop 2024-05-10T04:52:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.472+0000 7f5609600700 1 -- 172.21.15.82:0/3301055018 shutdown_connections 2024-05-10T04:52:00.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.472+0000 7f5609600700 1 --2- 172.21.15.82:0/3301055018 >> v2:172.21.15.129:3300/0 conn(0x7f56040b5fa0 0x7f56041623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.472+0000 7f5609600700 1 --2- 172.21.15.82:0/3301055018 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f560415bfe0 0x7f560415f4f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.472+0000 7f5609600700 1 -- 172.21.15.82:0/3301055018 >> 172.21.15.82:0/3301055018 conn(0x7f56040d0a70 msgr2=0x7f56040d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:00.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.472+0000 7f5609600700 1 -- 172.21.15.82:0/3301055018 shutdown_connections 2024-05-10T04:52:00.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.472+0000 7f5609600700 1 -- 172.21.15.82:0/3301055018 wait complete. 2024-05-10T04:52:00.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.474+0000 7f5609600700 1 Processor -- start 2024-05-10T04:52:00.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.475+0000 7f5609600700 1 -- start start 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f5609600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f560415bfe0 0x7f5604151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f5609600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5604161fb0 0x7f56040cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f5609600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f56040ce300 0x7f56040b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f5609600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56040cdee0 con 0x7f5604161fb0 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f5609600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56041f5480 con 0x7f560415bfe0 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f5609600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56040cd010 con 0x7f56040ce300 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f55fa000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5604161fb0 0x7f56040cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f55fa000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5604161fb0 0x7f56040cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56880/0 (socket says 172.21.15.82:56880) 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.476+0000 7f55fa000700 1 -- 172.21.15.82:0/4183750345 learned_addr learned my addr 172.21.15.82:0/4183750345 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:00.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f5602a00700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f560415bfe0 0x7f5604151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f5603400700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f56040ce300 0x7f56040b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fa000700 1 -- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f56040ce300 msgr2=0x7f56040b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fa000700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f56040ce300 0x7f56040b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fa000700 1 -- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f560415bfe0 msgr2=0x7f5604151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fa000700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f560415bfe0 0x7f5604151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fa000700 1 -- 172.21.15.82:0/4183750345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0094a0 con 0x7f5604161fb0 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f5602a00700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f560415bfe0 0x7f5604151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f5603400700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f56040ce300 0x7f56040b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fa000700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5604161fb0 0x7f56040cc530 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c460 tx=0x7f55ec00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fb400700 1 -- 172.21.15.82:0/4183750345 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec005d70 con 0x7f5604161fb0 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fb400700 1 -- 172.21.15.82:0/4183750345 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0070d0 con 0x7f5604161fb0 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f4009a70 con 0x7f5604161fb0 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f55fb400700 1 -- 172.21.15.82:0/4183750345 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec007480 con 0x7f5604161fb0 2024-05-10T04:52:00.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.477+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56040cd540 con 0x7f5604161fb0 2024-05-10T04:52:00.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.478+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560415f4f0 con 0x7f5604161fb0 2024-05-10T04:52:00.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.479+0000 7f55fb400700 1 -- 172.21.15.82:0/4183750345 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55ec0075e0 con 0x7f5604161fb0 2024-05-10T04:52:00.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.480+0000 7f55fb400700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f55e006acc0 0x7f55e006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.480+0000 7f55fb400700 1 -- 172.21.15.82:0/4183750345 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f55ec088980 con 0x7f5604161fb0 2024-05-10T04:52:00.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.481+0000 7f5602a00700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f55e006acc0 0x7f55e006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.481+0000 7f5602a00700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f55e006acc0 0x7f55e006d1d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55f4014040 tx=0x7f55f4011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:00.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.485+0000 7f55fb400700 1 -- 172.21.15.82:0/4183750345 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f55ec053a60 con 0x7f5604161fb0 2024-05-10T04:52:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.738+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5604074af0 con 0x7f5604161fb0 2024-05-10T04:52:00.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.739+0000 7f55fb400700 1 -- 172.21.15.82:0/4183750345 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f55ec017020 con 0x7f5604161fb0 2024-05-10T04:52:00.740 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:00.740 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3738724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3738724499},{"type":"v1","addr":"172.21.15.82:6836","nonce":3738724499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:52:00.229530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4975},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4975":{"gid":4975,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":13,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f55e006acc0 msgr2=0x7f55e006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f55e006acc0 0x7f55e006d1d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55f4014040 tx=0x7f55f4011000 comp rx=0 tx=0).stop 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5604161fb0 msgr2=0x7f56040cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5604161fb0 0x7f56040cc530 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c460 tx=0x7f55ec00c820 comp rx=0 tx=0).stop 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 shutdown_connections 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f55e006acc0 0x7f55e006d1d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f56040ce300 0x7f56040b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f560415bfe0 0x7f5604151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 --2- 172.21.15.82:0/4183750345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5604161fb0 0x7f56040cc530 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 >> 172.21.15.82:0/4183750345 conn(0x7f56040d0a70 msgr2=0x7f560415ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 shutdown_connections 2024-05-10T04:52:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:00.741+0000 7f5609600700 1 -- 172.21.15.82:0/4183750345 wait complete. 2024-05-10T04:52:00.744 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-05-10T04:52:01.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:51:33.124469+0000', 'modified': '2024-05-10T04:52:00.229530+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4975}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4975': {'gid': 4975, 'name': 'b', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.129:6835/2037696235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.129:6832', 'nonce': 2037696235}, {'type': 'v1', 'addr': '172.21.15.129:6835', 'nonce': 2037696235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T04:52:01.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T04:52:01.172 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T04:52:01.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.433+0000 7fa62d800700 1 Processor -- start 2024-05-10T04:52:01.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.433+0000 7fa62d800700 1 -- start start 2024-05-10T04:52:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.435+0000 7fa62d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6280b5fc0 0x7fa6280b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.435+0000 7fa62d800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa6281620e0 0x7fa6281624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.435+0000 7fa62d800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280d2730 con 0x7fa6280d3460 2024-05-10T04:52:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.435+0000 7fa62d800700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280b3720 con 0x7fa6281620e0 2024-05-10T04:52:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.435+0000 7fa62d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280d2fd0 con 0x7fa6280b5fc0 2024-05-10T04:52:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.435+0000 7fa626a00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa6280d3460 0x7fa6280b58b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52422/0 (socket says 172.21.15.82:52422) 2024-05-10T04:52:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.435+0000 7fa626a00700 1 -- 172.21.15.82:0/3134901447 learned_addr learned my addr 172.21.15.82:0/3134901447 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa61fe00700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6280b5fc0 0x7fa6280b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa627400700 1 --2- 172.21.15.82:0/3134901447 >> v2:172.21.15.129:3300/0 conn(0x7fa6281620e0 0x7fa6281624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210400551 0 0) 0x7fa6280d2730 con 0x7fa6280d3460 2024-05-10T04:52:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa60c0035b0 con 0x7fa6280d3460 2024-05-10T04:52:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3158095294 0 0) 0x7fa60c0035b0 con 0x7fa6280d3460 2024-05-10T04:52:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6280b5fc0 msgr2=0x7fa6280b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa6280b5fc0 0x7fa6280b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 >> v2:172.21.15.129:3300/0 conn(0x7fa6281620e0 msgr2=0x7fa6281624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 --2- 172.21.15.82:0/3134901447 >> v2:172.21.15.129:3300/0 conn(0x7fa6281620e0 0x7fa6281624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628162e10 con 0x7fa6280d3460 2024-05-10T04:52:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fa618001670 con 0x7fa6280d3460 2024-05-10T04:52:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 >> v1:172.21.15.82:6789/0 conn(0x7fa6280d3460 legacy=0x7fa6280b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c003a00 0x7fa60c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa60c004390 0x7fa60c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa60c004f20 0x7fa60c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b3720 con 0x7fa60c004f20 2024-05-10T04:52:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280d2fd0 con 0x7fa60c004390 2024-05-10T04:52:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.436+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c00bf50 con 0x7fa60c003a00 2024-05-10T04:52:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa627400700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa60c004f20 0x7fa60c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa61fe00700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa60c004390 0x7fa60c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa626a00700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c003a00 0x7fa60c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa627400700 1 -- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c003a00 msgr2=0x7fa60c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa627400700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c003a00 0x7fa60c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa627400700 1 -- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa60c004390 msgr2=0x7fa60c0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa627400700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa60c004390 0x7fa60c0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa627400700 1 -- 172.21.15.82:0/3134901447 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0035b0 con 0x7fa60c004f20 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa626a00700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c003a00 0x7fa60c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa627400700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa60c004f20 0x7fa60c00ba10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa6280ce430 tx=0x7fa60c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b17099a9ebdc54 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62000ebd0 con 0x7fa60c004f20 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62000f040 con 0x7fa60c004f20 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.437+0000 7fa626000700 1 -- 172.21.15.82:0/3134901447 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620014480 con 0x7fa60c004f20 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.438+0000 7fa62d800700 1 -- 172.21.15.82:0/3134901447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa60c004f20 msgr2=0x7fa60c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.438+0000 7fa62d800700 1 --2- 172.21.15.82:0/3134901447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa60c004f20 0x7fa60c00ba10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa6280ce430 tx=0x7fa60c005880 comp rx=0 tx=0).stop 2024-05-10T04:52:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.438+0000 7fa627400700 1 -- 172.21.15.82:0/3134901447 reap_dead start 2024-05-10T04:52:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.438+0000 7fa62d800700 1 -- 172.21.15.82:0/3134901447 shutdown_connections 2024-05-10T04:52:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.438+0000 7fa62d800700 1 -- 172.21.15.82:0/3134901447 >> 172.21.15.82:0/3134901447 conn(0x7fa6280d0a90 msgr2=0x7fa6280d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.438+0000 7fa62d800700 1 -- 172.21.15.82:0/3134901447 shutdown_connections 2024-05-10T04:52:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.438+0000 7fa62d800700 1 -- 172.21.15.82:0/3134901447 wait complete. 2024-05-10T04:52:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.441+0000 7fa62d800700 1 Processor -- start 2024-05-10T04:52:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.441+0000 7fa62d800700 1 -- start start 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.442+0000 7fa62d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c004f20 0x7fa62815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.442+0000 7fa62d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6281f4ed0 0x7fa6281f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.442+0000 7fa62d800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6281f52e0 0x7fa6280c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.442+0000 7fa62d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c8310 con 0x7fa6281f4ed0 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.442+0000 7fa62d800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281f5740 con 0x7fa6281f52e0 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.442+0000 7fa62d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281f49b0 con 0x7fa60c004f20 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.442+0000 7fa61fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6281f4ed0 0x7fa6281f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6281f4ed0 0x7fa6281f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56894/0 (socket says 172.21.15.82:56894) 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61fe00700 1 -- 172.21.15.82:0/1333315966 learned_addr learned my addr 172.21.15.82:0/1333315966 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa626a00700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c004f20 0x7fa62815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa627400700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6281f52e0 0x7fa6280c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61fe00700 1 -- 172.21.15.82:0/1333315966 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c004f20 msgr2=0x7fa62815a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61fe00700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c004f20 0x7fa62815a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61fe00700 1 -- 172.21.15.82:0/1333315966 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6281f52e0 msgr2=0x7fa6280c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61fe00700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6281f52e0 0x7fa6280c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61fe00700 1 -- 172.21.15.82:0/1333315966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280c79e0 con 0x7fa6281f4ed0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61fe00700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6281f4ed0 0x7fa6281f3ed0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa610011aa0 tx=0x7fa610011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.443+0000 7fa61ea00700 1 -- 172.21.15.82:0/1333315966 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000f980 con 0x7fa6281f4ed0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.444+0000 7fa61ea00700 1 -- 172.21.15.82:0/1333315966 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000fae0 con 0x7fa6281f4ed0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.444+0000 7fa62d800700 1 -- 172.21.15.82:0/1333315966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6280c7c50 con 0x7fa6281f4ed0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.444+0000 7fa61ea00700 1 -- 172.21.15.82:0/1333315966 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000fe90 con 0x7fa6281f4ed0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.444+0000 7fa62d800700 1 -- 172.21.15.82:0/1333315966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6281f4c00 con 0x7fa6281f4ed0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.446+0000 7fa61ea00700 1 -- 172.21.15.82:0/1333315966 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa610014440 con 0x7fa6281f4ed0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.447+0000 7fa61ea00700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa60406acc0 0x7fa60406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.447+0000 7fa61ea00700 1 -- 172.21.15.82:0/1333315966 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa610089be0 con 0x7fa6281f4ed0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.448+0000 7fa626a00700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa60406acc0 0x7fa60406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.448+0000 7fa626a00700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa60406acc0 0x7fa60406d1d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa618005b00 tx=0x7fa618009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.450+0000 7fa645678b80 1 Processor -- start 2024-05-10T04:52:01.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.450+0000 7fa645678b80 1 -- start start 2024-05-10T04:52:01.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa645678b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdb285f0 0x5594bdc89960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa645678b80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdc62310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa645678b80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdca86a0 0x5594bdca8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa645678b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bdb89250 con 0x5594bdb285f0 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa645678b80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bdb86a50 con 0x5594bdc5f860 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa645678b80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594bdb82340 con 0x5594bdca86a0 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa626a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdb285f0 0x5594bdc89960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa626a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdb285f0 0x5594bdc89960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56896/0 (socket says 172.21.15.82:56896) 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.451+0000 7fa626a00700 1 -- 172.21.15.82:0/2519787328 learned_addr learned my addr 172.21.15.82:0/2519787328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa627400700 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdca86a0 0x5594bdca8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa61fe00700 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdc62310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa626a00700 1 -- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdca86a0 msgr2=0x5594bdca8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa626a00700 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdca86a0 0x5594bdca8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa626a00700 1 -- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 msgr2=0x5594bdc62310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa626a00700 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdc62310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa626a00700 1 -- 172.21.15.82:0/2519787328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594bd975790 con 0x5594bdb285f0 2024-05-10T04:52:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa61fe00700 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdc62310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa626a00700 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdb285f0 0x5594bdc89960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa618004ca0 tx=0x7fa61800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d722345ab1cf51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa617400700 1 -- 172.21.15.82:0/2519787328 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618005790 con 0x5594bdb285f0 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa617400700 1 -- 172.21.15.82:0/2519787328 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6180106d0 con 0x5594bdb285f0 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.452+0000 7fa617400700 1 -- 172.21.15.82:0/2519787328 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618010a60 con 0x5594bdb285f0 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 -- 172.21.15.82:0/2519787328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdb285f0 msgr2=0x5594bdc89960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdb285f0 0x5594bdc89960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa618004ca0 tx=0x7fa61800e000 comp rx=0 tx=0).stop 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 -- 172.21.15.82:0/2519787328 shutdown_connections 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdca86a0 0x5594bdca8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdb285f0 0x5594bdc89960 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 --2- 172.21.15.82:0/2519787328 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdc62310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 -- 172.21.15.82:0/2519787328 >> 172.21.15.82:0/2519787328 conn(0x5594bdbcccf0 msgr2=0x5594bdca7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 -- 172.21.15.82:0/2519787328 shutdown_connections 2024-05-10T04:52:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.453+0000 7fa645678b80 1 -- 172.21.15.82:0/2519787328 wait complete. 2024-05-10T04:52:01.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.454+0000 7fa645678b80 1 -- start start 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.455+0000 7fa645678b80 1 Processor -- start 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa645678b80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 0x5594bdcade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa645678b80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdcae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa645678b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa645678b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bdb1e490 con 0x5594bdca86a0 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa645678b80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bdb1e130 con 0x5594bdc5f860 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa645678b80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594bd976390 con 0x5594bdb285f0 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa645678b80 10 client.0 _ll_register_callbacks cb 0x5594bd9895a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa627400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa627400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56904/0 (socket says 172.21.15.82:56904) 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa627400700 1 -- 172.21.15.82:0/3274361362 learned_addr learned my addr 172.21.15.82:0/3274361362 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa626a00700 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 0x5594bdcade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.456+0000 7fa61fe00700 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdcae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa627400700 1 -- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 msgr2=0x5594bdcade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa627400700 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 0x5594bdcade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa627400700 1 -- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 msgr2=0x5594bdcae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa627400700 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdcae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa627400700 1 -- 172.21.15.82:0/3274361362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61800f040 con 0x5594bdca86a0 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa61fe00700 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdcae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa627400700 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8c930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa620015000 tx=0x7fa620004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711f6eb448be19f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa60be00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa60be00700 1 -- 172.21.15.82:0/3274361362 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62000eca0 con 0x5594bdca86a0 2024-05-10T04:52:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa60be00700 1 -- 172.21.15.82:0/3274361362 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa62000ee00 con 0x5594bdca86a0 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.457+0000 7fa645678b80 1 -- 172.21.15.82:0/3274361362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594bdc54630 con 0x5594bdca86a0 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa60be00700 1 -- 172.21.15.82:0/3274361362 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa620003fa0 con 0x5594bdca86a0 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa645678b80 10 client.5313 fetch_fsmap learned FSMap version 22 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa645678b80 1 -- 172.21.15.82:0/3274361362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5594bda620a0 con 0x5594bdca86a0 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa60be00700 1 -- 172.21.15.82:0/3274361362 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594bdc54630 con 0x5594bdca86a0 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa60be00700 1 -- 172.21.15.82:0/3274361362 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa620004100 con 0x5594bdca86a0 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa645678b80 10 client.5313 fetch_fsmap finished waiting for FSMap version 22 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa645678b80 10 client.5313 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa645678b80 20 client.5313 populate_metadata read hostname 'smithi082' 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa645678b80 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] conn(0x5594bdc88960 0x5594bdc8d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa645678b80 4 client.5313 mds_command: new command op to 4975 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T04:52:01.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa645678b80 1 -- 172.21.15.82:0/3274361362 --> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594bd9bb040 con 0x5594bdc88960 2024-05-10T04:52:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.458+0000 7fa626a00700 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] conn(0x5594bdc88960 0x5594bdc8d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.459+0000 7fa60be00700 10 client.5313 ms_handle_connect on v2:172.21.15.129:6832/2037696235 2024-05-10T04:52:01.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.459+0000 7fa626a00700 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] conn(0x5594bdc88960 0x5594bdc8d360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3ab7ffeb239ac5 server_cookie=8b65c3b75e93d413 in_seq=0 out_seq=0 2024-05-10T04:52:01.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.460+0000 7fa60be00700 1 -- 172.21.15.82:0/3274361362 <== mds.0 v2:172.21.15.129:6832/2037696235 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5594bd9bb040 con 0x5594bdc88960 2024-05-10T04:52:01.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.460+0000 7fa60be00700 10 client.5313 handle_command_reply: tid=0 2024-05-10T04:52:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.460+0000 7fa645678b80 1 client.5313 shutdown 2024-05-10T04:52:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 -- 172.21.15.82:0/3274361362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 msgr2=0x5594bdc8c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8c930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa620015000 tx=0x7fa620004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 -- 172.21.15.82:0/3274361362 shutdown_connections 2024-05-10T04:52:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] conn(0x5594bdc88960 0x5594bdc8d360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8c930 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 0x5594bdcade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa60be00700 0 client.5313 ms_handle_reset on v2:172.21.15.129:6832/2037696235 2024-05-10T04:52:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 --2- 172.21.15.82:0/3274361362 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdc5f860 0x5594bdcae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 -- 172.21.15.82:0/3274361362 >> 172.21.15.82:0/3274361362 conn(0x5594bdbcccf0 msgr2=0x5594bdcab080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 -- 172.21.15.82:0/3274361362 shutdown_connections 2024-05-10T04:52:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 1 -- 172.21.15.82:0/3274361362 wait complete. 2024-05-10T04:52:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.461+0000 7fa645678b80 20 client.5313 trim_cache size 0 max 16384 2024-05-10T04:52:01.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.480+0000 7fa645678b80 1 Processor -- start 2024-05-10T04:52:01.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.480+0000 7fa645678b80 1 -- start start 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.481+0000 7fa645678b80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdb285f0 0x5594bdc8da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.481+0000 7fa645678b80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdc5f860 0x5594bdc8ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.481+0000 7fa645678b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.481+0000 7fa645678b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bdc55ed0 con 0x5594bdca86a0 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa645678b80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bdc89a00 con 0x5594bdb285f0 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa645678b80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594bdc56530 con 0x5594bdc5f860 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56920/0 (socket says 172.21.15.82:56920) 2024-05-10T04:52:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 -- 172.21.15.82:0/1396211970 learned_addr learned my addr 172.21.15.82:0/1396211970 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa61fe00700 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdc5f860 0x5594bdc8ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa626a00700 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdb285f0 0x5594bdc8da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 -- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdc5f860 msgr2=0x5594bdc8ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdc5f860 0x5594bdc8ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 -- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdb285f0 msgr2=0x5594bdc8da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdb285f0 0x5594bdc8da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 -- 172.21.15.82:0/1396211970 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594bdb48690 con 0x5594bdca86a0 2024-05-10T04:52:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa61fe00700 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdc5f860 0x5594bdc8ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.482+0000 7fa627400700 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8f110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa62000e8b0 tx=0x7fa620013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a892d2015be9f164 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa617e00700 1 -- 172.21.15.82:0/1396211970 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620039030 con 0x5594bdca86a0 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa617e00700 1 -- 172.21.15.82:0/1396211970 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62000eea0 con 0x5594bdca86a0 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa617e00700 1 -- 172.21.15.82:0/1396211970 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200041c0 con 0x5594bdca86a0 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa645678b80 1 -- 172.21.15.82:0/1396211970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 msgr2=0x5594bdc8f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa645678b80 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8f110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa62000e8b0 tx=0x7fa620013000 comp rx=0 tx=0).stop 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa645678b80 1 -- 172.21.15.82:0/1396211970 shutdown_connections 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa645678b80 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdca86a0 0x5594bdc8f110 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa645678b80 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdb285f0 0x5594bdc8da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa645678b80 1 --2- 172.21.15.82:0/1396211970 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdc5f860 0x5594bdc8ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa645678b80 1 -- 172.21.15.82:0/1396211970 >> 172.21.15.82:0/1396211970 conn(0x5594bdbcccf0 msgr2=0x5594bdc8fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.483+0000 7fa645678b80 1 -- 172.21.15.82:0/1396211970 shutdown_connections 2024-05-10T04:52:01.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.484+0000 7fa645678b80 1 -- 172.21.15.82:0/1396211970 wait complete. 2024-05-10T04:52:01.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.484+0000 7fa645678b80 1 -- start start 2024-05-10T04:52:01.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.485+0000 7fa645678b80 1 Processor -- start 2024-05-10T04:52:01.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa645678b80 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 0x5594bdc8b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa645678b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdc5f860 0x5594bdc8b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa645678b80 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdca86a0 0x5594bdc5c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa645678b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bdcacd10 con 0x5594bdc5f860 2024-05-10T04:52:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa645678b80 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bdc8e590 con 0x5594bdca86a0 2024-05-10T04:52:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa645678b80 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594bdcbfb90 con 0x5594bdb285f0 2024-05-10T04:52:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa645678b80 10 client.0 _ll_register_callbacks cb 0x7fa60c003740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:52:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa61fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdc5f860 0x5594bdc8b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa61fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdc5f860 0x5594bdc8b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56932/0 (socket says 172.21.15.82:56932) 2024-05-10T04:52:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.486+0000 7fa61fe00700 1 -- 172.21.15.82:0/4103369105 learned_addr learned my addr 172.21.15.82:0/4103369105 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa626a00700 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 0x5594bdc8b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa627400700 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdca86a0 0x5594bdc5c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa61fe00700 1 -- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 msgr2=0x5594bdc8b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa61fe00700 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 0x5594bdc8b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa61fe00700 1 -- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdca86a0 msgr2=0x5594bdc5c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa61fe00700 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdca86a0 0x5594bdc5c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa61fe00700 1 -- 172.21.15.82:0/4103369105 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594bda620a0 con 0x5594bdc5f860 2024-05-10T04:52:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa61fe00700 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdc5f860 0x5594bdc8b600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa610087fb0 tx=0x7fa6100592b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f25523e3a0d141 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa60be00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-10T04:52:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa60be00700 1 -- 172.21.15.82:0/4103369105 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610058130 con 0x5594bdc5f860 2024-05-10T04:52:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa60be00700 1 -- 172.21.15.82:0/4103369105 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa610060e30 con 0x5594bdc5f860 2024-05-10T04:52:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa645678b80 1 -- 172.21.15.82:0/4103369105 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6180106d0 con 0x5594bdc5f860 2024-05-10T04:52:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.487+0000 7fa60be00700 1 -- 172.21.15.82:0/4103369105 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6100609a0 con 0x5594bdc5f860 2024-05-10T04:52:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa645678b80 10 client.5319 fetch_fsmap learned FSMap version 22 2024-05-10T04:52:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa645678b80 1 -- 172.21.15.82:0/4103369105 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5594bd9d61d0 con 0x5594bdc5f860 2024-05-10T04:52:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa60be00700 1 -- 172.21.15.82:0/4103369105 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6180106d0 con 0x5594bdc5f860 2024-05-10T04:52:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa60be00700 1 -- 172.21.15.82:0/4103369105 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa610054830 con 0x5594bdc5f860 2024-05-10T04:52:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa645678b80 10 client.5319 fetch_fsmap finished waiting for FSMap version 22 2024-05-10T04:52:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa645678b80 10 client.5319 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:52:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa645678b80 20 client.5319 populate_metadata read hostname 'smithi082' 2024-05-10T04:52:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa645678b80 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] conn(0x5594bdc5cb60 0x5594bdc9cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa645678b80 4 client.5319 mds_command: new command op to 4975 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T04:52:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa645678b80 1 -- 172.21.15.82:0/4103369105 --> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5594bd9f70c0 con 0x5594bdc5cb60 2024-05-10T04:52:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.488+0000 7fa626a00700 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] conn(0x5594bdc5cb60 0x5594bdc9cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa626a00700 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] conn(0x5594bdc5cb60 0x5594bdc9cbb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58339e89690d9151 server_cookie=fcc5e80356f2b0ee in_seq=0 out_seq=0 2024-05-10T04:52:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa60be00700 10 client.5319 ms_handle_connect on v2:172.21.15.129:6832/2037696235 2024-05-10T04:52:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa60be00700 1 -- 172.21.15.82:0/4103369105 <== mds.0 v2:172.21.15.129:6832/2037696235 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5594bd9f70c0 con 0x5594bdc5cb60 2024-05-10T04:52:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa60be00700 10 client.5319 handle_command_reply: tid=0 2024-05-10T04:52:01.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 client.5319 shutdown 2024-05-10T04:52:01.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 -- 172.21.15.82:0/4103369105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdc5f860 msgr2=0x5594bdc8b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdc5f860 0x5594bdc8b600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa610087fb0 tx=0x7fa6100592b0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 -- 172.21.15.82:0/4103369105 shutdown_connections 2024-05-10T04:52:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:6832/2037696235,v1:172.21.15.129:6835/2037696235] conn(0x5594bdc5cb60 0x5594bdc9cbb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x5594bdca86a0 0x5594bdc5c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x5594bdb285f0 0x5594bdc8b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 --2- 172.21.15.82:0/4103369105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594bdc5f860 0x5594bdc8b600 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa645678b80 1 -- 172.21.15.82:0/4103369105 >> 172.21.15.82:0/4103369105 conn(0x5594bdbcccf0 msgr2=0x5594bdca77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.489+0000 7fa60be00700 0 client.5319 ms_handle_reset on v2:172.21.15.129:6832/2037696235 2024-05-10T04:52:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.490+0000 7fa645678b80 1 -- 172.21.15.82:0/4103369105 shutdown_connections 2024-05-10T04:52:01.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.490+0000 7fa645678b80 1 -- 172.21.15.82:0/4103369105 wait complete. 2024-05-10T04:52:01.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.490+0000 7fa645678b80 20 client.5319 trim_cache size 0 max 16384 2024-05-10T04:52:01.504 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:01.504 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c7bb1514-6d11-4350-825d-a52cfeee72e9", 2024-05-10T04:52:01.504 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4975, 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 5.2650898420000001, 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 22, 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 36, 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 36, 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 38.006050731999999 2024-05-10T04:52:01.505 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:01.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.490+0000 7fa62d800700 1 -- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa60406acc0 msgr2=0x7fa60406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.490+0000 7fa62d800700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa60406acc0 0x7fa60406d1d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa618005b00 tx=0x7fa618009040 comp rx=0 tx=0).stop 2024-05-10T04:52:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.490+0000 7fa62d800700 1 -- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6281f4ed0 msgr2=0x7fa6281f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.490+0000 7fa62d800700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6281f4ed0 0x7fa6281f3ed0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa610011aa0 tx=0x7fa610011e60 comp rx=0 tx=0).stop 2024-05-10T04:52:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.491+0000 7fa62d800700 1 -- 172.21.15.82:0/1333315966 shutdown_connections 2024-05-10T04:52:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.491+0000 7fa62d800700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa60406acc0 0x7fa60406d1d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.491+0000 7fa62d800700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa6281f52e0 0x7fa6280c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.491+0000 7fa62d800700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa60c004f20 0x7fa62815a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.491+0000 7fa62d800700 1 --2- 172.21.15.82:0/1333315966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa6281f4ed0 0x7fa6281f3ed0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.491+0000 7fa62d800700 1 -- 172.21.15.82:0/1333315966 >> 172.21.15.82:0/1333315966 conn(0x7fa6280d0a90 msgr2=0x7fa62815d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.491+0000 7fa62d800700 1 -- 172.21.15.82:0/1333315966 shutdown_connections 2024-05-10T04:52:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:01.491+0000 7fa62d800700 1 -- 172.21.15.82:0/1333315966 wait complete. 2024-05-10T04:52:01.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:01.516 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%a /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-05-10T04:52:01.562 INFO:teuthology.orchestra.run.smithi082.stdout:600 2024-05-10T04:52:01.563 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-10T04:52:01.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T04:52:01.651 DEBUG:teuthology.orchestra.run.smithi129:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-10T04:52:01.747 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-10T04:52:01.748 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:52:01.748 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:01.793 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:52:01.793 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:01.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:02.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.179+0000 7fc4b9a00700 1 Processor -- start 2024-05-10T04:52:02.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.179+0000 7fc4b9a00700 1 -- start start 2024-05-10T04:52:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.180+0000 7fc4b9a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b40b2ca0 0x7fc4b40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.180+0000 7fc4b9a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc4b415e350 0x7fc4b40d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.180+0000 7fc4b9a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b4161e40 con 0x7fc4b415df40 2024-05-10T04:52:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.180+0000 7fc4b9a00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b4162120 con 0x7fc4b415e350 2024-05-10T04:52:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.180+0000 7fc4b9a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b4162400 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b9000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc4b415e350 0x7fc4b40d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b3e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b40b2ca0 0x7fc4b40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b3e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b40b2ca0 0x7fc4b40cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:47226/0 (socket says 172.21.15.82:47226) 2024-05-10T04:52:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b9000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fc4b415e350 0x7fc4b40d24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:41340/0 (socket says 172.21.15.82:41340) 2024-05-10T04:52:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b3e00700 1 -- 172.21.15.82:0/3994040412 learned_addr learned my addr 172.21.15.82:0/3994040412 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b9000700 1 -- 172.21.15.82:0/3994040412 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b40b2ca0 msgr2=0x7fc4b40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b9000700 1 --2- 172.21.15.82:0/3994040412 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b40b2ca0 0x7fc4b40cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b9000700 1 -- 172.21.15.82:0/3994040412 >> v1:172.21.15.129:6789/0 conn(0x7fc4b415df40 legacy=0x7fc4b40d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.181+0000 7fc4b9000700 1 -- 172.21.15.82:0/3994040412 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b41626e0 con 0x7fc4b415e350 2024-05-10T04:52:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.182+0000 7fc4b9000700 1 --2- 172.21.15.82:0/3994040412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415e350 0x7fc4b40d24f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009d90 tx=0x7fc4ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d2f60796e1b13a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.182+0000 7fc4b3400700 1 -- 172.21.15.82:0/3994040412 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00e070 con 0x7fc4b415e350 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.182+0000 7fc4b3400700 1 -- 172.21.15.82:0/3994040412 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00bb20 con 0x7fc4b415e350 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.182+0000 7fc4b3400700 1 -- 172.21.15.82:0/3994040412 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac012430 con 0x7fc4b415e350 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.182+0000 7fc4b9a00700 1 -- 172.21.15.82:0/3994040412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415e350 msgr2=0x7fc4b40d24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.182+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/3994040412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415e350 0x7fc4b40d24f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009d90 tx=0x7fc4ac00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.183+0000 7fc4b9a00700 1 -- 172.21.15.82:0/3994040412 shutdown_connections 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.183+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/3994040412 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415e350 0x7fc4b40d24f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.183+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/3994040412 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b40b2ca0 0x7fc4b40cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.183+0000 7fc4b9a00700 1 -- 172.21.15.82:0/3994040412 >> 172.21.15.82:0/3994040412 conn(0x7fc4b4067600 msgr2=0x7fc4b406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.183+0000 7fc4b9a00700 1 -- 172.21.15.82:0/3994040412 shutdown_connections 2024-05-10T04:52:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.183+0000 7fc4b9a00700 1 -- 172.21.15.82:0/3994040412 wait complete. 2024-05-10T04:52:02.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.186+0000 7fc4b9a00700 1 Processor -- start 2024-05-10T04:52:02.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.186+0000 7fc4b9a00700 1 -- start start 2024-05-10T04:52:02.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.187+0000 7fc4b9a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b40b2ca0 0x7fc4b414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.187+0000 7fc4b9a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415df40 0x7fc4b40b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b9a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b415e350 0x7fc4b40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b9a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b4157d30 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b9a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b40b5eb0 con 0x7fc4b415df40 2024-05-10T04:52:02.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b9a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b40b4bb0 con 0x7fc4b415e350 2024-05-10T04:52:02.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b40b2ca0 0x7fc4b414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b40b2ca0 0x7fc4b414bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56936/0 (socket says 172.21.15.82:56936) 2024-05-10T04:52:02.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b3e00700 1 -- 172.21.15.82:0/2892278155 learned_addr learned my addr 172.21.15.82:0/2892278155 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:02.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b9000700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b415e350 0x7fc4b40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4abe00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415df40 0x7fc4b40b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b3e00700 1 -- 172.21.15.82:0/2892278155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b415e350 msgr2=0x7fc4b40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b3e00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b415e350 0x7fc4b40b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b3e00700 1 -- 172.21.15.82:0/2892278155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415df40 msgr2=0x7fc4b40b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b3e00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415df40 0x7fc4b40b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.188+0000 7fc4b3e00700 1 -- 172.21.15.82:0/2892278155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac009a70 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.189+0000 7fc4b3e00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b40b2ca0 0x7fc4b414bb70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400e8b0 tx=0x7fc4a400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.189+0000 7fc4b0c00700 1 -- 172.21.15.82:0/2892278155 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4009600 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.189+0000 7fc4b0c00700 1 -- 172.21.15.82:0/2892278155 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a4013680 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.189+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b40b6100 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.189+0000 7fc4b0c00700 1 -- 172.21.15.82:0/2892278155 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4013a30 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.189+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b40b3650 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.190+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b415faf0 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.191+0000 7fc4b0c00700 1 -- 172.21.15.82:0/2892278155 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc4a4013b90 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.192+0000 7fc4b0c00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc49006ac90 0x7fc49006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.192+0000 7fc4b0c00700 1 -- 172.21.15.82:0/2892278155 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc4a4089250 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.192+0000 7fc4abe00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc49006ac90 0x7fc49006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.193+0000 7fc4abe00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc49006ac90 0x7fc49006d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc4b415cf60 tx=0x7fc49c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:02.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.197+0000 7fc4b0c00700 1 -- 172.21.15.82:0/2892278155 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc4a4054330 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.401+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4b4074af0 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.402+0000 7fc4b0c00700 1 -- 172.21.15.82:0/2892278155 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16230 (secure 0 0 0) 0x7fc4a4057950 con 0x7fc4b40b2ca0 2024-05-10T04:52:02.404 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:02.404 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:51:56.207427+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:30.829302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:32.104657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6836/3440576054":"2024-05-11T04:51:56.207394+0000","172.21.15.82:6834/3440576054":"2024-05-11T04:51:56.207394+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc49006ac90 msgr2=0x7fc49006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc49006ac90 0x7fc49006d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc4b415cf60 tx=0x7fc49c009040 comp rx=0 tx=0).stop 2024-05-10T04:52:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b40b2ca0 msgr2=0x7fc4b414bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b40b2ca0 0x7fc4b414bb70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400e8b0 tx=0x7fc4a400ebc0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 shutdown_connections 2024-05-10T04:52:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc49006ac90 0x7fc49006d1a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc4b415e350 0x7fc4b40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4b40b2ca0 0x7fc4b414bb70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 --2- 172.21.15.82:0/2892278155 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4b415df40 0x7fc4b40b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.404+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 >> 172.21.15.82:0/2892278155 conn(0x7fc4b4067600 msgr2=0x7fc4b415e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.405+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 shutdown_connections 2024-05-10T04:52:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.405+0000 7fc4b9a00700 1 -- 172.21.15.82:0/2892278155 wait complete. 2024-05-10T04:52:02.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:30.829302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:32.104657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:52:02.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:52:02.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.696+0000 7f09b7e00700 1 Processor -- start 2024-05-10T04:52:02.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.696+0000 7f09b7e00700 1 -- start start 2024-05-10T04:52:02.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b7e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b0162150 0x7f09b015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b7e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f09b006c160 0x7f09b006c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b7e00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00d2c00 con 0x7f09b00cf4d0 2024-05-10T04:52:02.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b7e00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b006cab0 con 0x7f09b006c160 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b7e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0162630 con 0x7f09b0162150 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f09b006c160 0x7f09b006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f09b006c160 0x7f09b006c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56938/0 (socket says 172.21.15.82:56938) 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5e00700 1 -- 172.21.15.82:0/661195572 learned_addr learned my addr 172.21.15.82:0/661195572 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5400700 1 --2- 172.21.15.82:0/661195572 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b0162150 0x7f09b015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5e00700 1 -- 172.21.15.82:0/661195572 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b0162150 msgr2=0x7f09b015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5e00700 1 --2- 172.21.15.82:0/661195572 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b0162150 0x7f09b015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5e00700 1 -- 172.21.15.82:0/661195572 >> v1:172.21.15.129:6789/0 conn(0x7f09b00cf4d0 legacy=0x7f09b00b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5e00700 1 -- 172.21.15.82:0/661195572 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0162910 con 0x7f09b006c160 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09b5e00700 1 --2- 172.21.15.82:0/661195572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b006c570 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009e50 tx=0x7f09a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78750ffcb906d9f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09afe00700 1 -- 172.21.15.82:0/661195572 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800e070 con 0x7f09b006c160 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09afe00700 1 -- 172.21.15.82:0/661195572 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800b9c0 con 0x7f09b006c160 2024-05-10T04:52:02.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.699+0000 7f09afe00700 1 -- 172.21.15.82:0/661195572 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800bd70 con 0x7f09b006c160 2024-05-10T04:52:02.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.700+0000 7f09b7e00700 1 -- 172.21.15.82:0/661195572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 msgr2=0x7f09b006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.700+0000 7f09b7e00700 1 --2- 172.21.15.82:0/661195572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b006c570 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009e50 tx=0x7f09a800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:02.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.700+0000 7f09b7e00700 1 -- 172.21.15.82:0/661195572 shutdown_connections 2024-05-10T04:52:02.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.700+0000 7f09b7e00700 1 --2- 172.21.15.82:0/661195572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b006c570 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.700+0000 7f09b7e00700 1 --2- 172.21.15.82:0/661195572 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b0162150 0x7f09b015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.700+0000 7f09b7e00700 1 -- 172.21.15.82:0/661195572 >> 172.21.15.82:0/661195572 conn(0x7f09b00d3e10 msgr2=0x7f09b00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:02.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.700+0000 7f09b7e00700 1 -- 172.21.15.82:0/661195572 shutdown_connections 2024-05-10T04:52:02.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.700+0000 7f09b7e00700 1 -- 172.21.15.82:0/661195572 wait complete. 2024-05-10T04:52:02.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.704+0000 7f09b7e00700 1 Processor -- start 2024-05-10T04:52:02.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.704+0000 7f09b7e00700 1 -- start start 2024-05-10T04:52:02.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b01585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b7e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b00cf4d0 0x7f09b014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b7e00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09b0162150 0x7f09b00b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b7e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b015ec50 con 0x7f09b006c160 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b7e00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0155300 con 0x7f09b0162150 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b7e00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0158b40 con 0x7f09b00cf4d0 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b01585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b01585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56946/0 (socket says 172.21.15.82:56946) 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 -- 172.21.15.82:0/3085853865 learned_addr learned my addr 172.21.15.82:0/3085853865 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b4a00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b00cf4d0 0x7f09b014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5e00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09b0162150 0x7f09b00b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 -- 172.21.15.82:0/3085853865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b00cf4d0 msgr2=0x7f09b014f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b00cf4d0 0x7f09b014f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 -- 172.21.15.82:0/3085853865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09b0162150 msgr2=0x7f09b00b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09b0162150 0x7f09b00b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 -- 172.21.15.82:0/3085853865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8009b30 con 0x7f09b006c160 2024-05-10T04:52:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b5400700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b01585d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f09a400d800 tx=0x7f09a400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09ad600700 1 -- 172.21.15.82:0/3085853865 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a40125f0 con 0x7f09b006c160 2024-05-10T04:52:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09ad600700 1 -- 172.21.15.82:0/3085853865 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a4012750 con 0x7f09b006c160 2024-05-10T04:52:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09ad600700 1 -- 172.21.15.82:0/3085853865 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4012ac0 con 0x7f09b006c160 2024-05-10T04:52:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b01612c0 con 0x7f09b006c160 2024-05-10T04:52:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.706+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b015f140 con 0x7f09b006c160 2024-05-10T04:52:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.707+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b0074af0 con 0x7f09b006c160 2024-05-10T04:52:02.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.708+0000 7f09ad600700 1 -- 172.21.15.82:0/3085853865 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f09a4012c20 con 0x7f09b006c160 2024-05-10T04:52:02.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.709+0000 7f09ad600700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f099006ac90 0x7f099006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:02.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.709+0000 7f09ad600700 1 -- 172.21.15.82:0/3085853865 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f09a4089380 con 0x7f09b006c160 2024-05-10T04:52:02.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.709+0000 7f09b4a00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f099006ac90 0x7f099006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:02.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.710+0000 7f09b4a00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f099006ac90 0x7f099006d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f09b0155ba0 tx=0x7f099c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:02.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.714+0000 7f09ad600700 1 -- 172.21.15.82:0/3085853865 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f09a4054500 con 0x7f09b006c160 2024-05-10T04:52:02.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.914+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09b00b5d10 con 0x7f09b006c160 2024-05-10T04:52:02.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.914+0000 7f09ad600700 1 -- 172.21.15.82:0/3085853865 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09a4057b20 con 0x7f09b006c160 2024-05-10T04:52:02.916 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f099006ac90 msgr2=0x7f099006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f099006ac90 0x7f099006d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f09b0155ba0 tx=0x7f099c009040 comp rx=0 tx=0).stop 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 msgr2=0x7f09b01585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b01585d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f09a400d800 tx=0x7f09a400db10 comp rx=0 tx=0).stop 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 shutdown_connections 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f099006ac90 0x7f099006d1a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f09b0162150 0x7f09b00b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09b006c160 0x7f09b01585d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 --2- 172.21.15.82:0/3085853865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f09b00cf4d0 0x7f09b014f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 >> 172.21.15.82:0/3085853865 conn(0x7f09b00d3e10 msgr2=0x7f09b015bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 shutdown_connections 2024-05-10T04:52:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:02.917+0000 7f09b7e00700 1 -- 172.21.15.82:0/3085853865 wait complete. 2024-05-10T04:52:02.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:52:03.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.207+0000 7fc353800700 1 Processor -- start 2024-05-10T04:52:03.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.207+0000 7fc353800700 1 -- start start 2024-05-10T04:52:03.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc353800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc34c06c160 0x7fc34c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc353800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0d2c00 con 0x7fc34c162150 2024-05-10T04:52:03.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc353800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c06cab0 con 0x7fc34c15e610 2024-05-10T04:52:03.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc353800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c15ea20 con 0x7fc34c06c160 2024-05-10T04:52:03.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc351800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc34c06c160 0x7fc34c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc350e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc34c162150 0x7fc34c0cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52430/0 (socket says 172.21.15.82:52430) 2024-05-10T04:52:03.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc351800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc34c06c160 0x7fc34c06c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56954/0 (socket says 172.21.15.82:56954) 2024-05-10T04:52:03.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc350e00700 1 -- 172.21.15.82:0/3545920579 learned_addr learned my addr 172.21.15.82:0/3545920579 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:03.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc351800700 1 -- 172.21.15.82:0/3545920579 >> v1:172.21.15.129:6789/0 conn(0x7fc34c15e610 legacy=0x7fc34c0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc351800700 1 -- 172.21.15.82:0/3545920579 >> v1:172.21.15.82:6789/0 conn(0x7fc34c162150 legacy=0x7fc34c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.210+0000 7fc351800700 1 -- 172.21.15.82:0/3545920579 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c162630 con 0x7fc34c06c160 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.211+0000 7fc351800700 1 --2- 172.21.15.82:0/3545920579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c06c570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc344009d90 tx=0x7fc34400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778b2d3cc6630d80 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.211+0000 7fc34b400700 1 -- 172.21.15.82:0/3545920579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400e070 con 0x7fc34c06c160 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.211+0000 7fc34b400700 1 -- 172.21.15.82:0/3545920579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34400bbd0 con 0x7fc34c06c160 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.211+0000 7fc34b400700 1 -- 172.21.15.82:0/3545920579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344012430 con 0x7fc34c06c160 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.211+0000 7fc353800700 1 -- 172.21.15.82:0/3545920579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 msgr2=0x7fc34c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.211+0000 7fc353800700 1 --2- 172.21.15.82:0/3545920579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c06c570 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc344009d90 tx=0x7fc34400b330 comp rx=0 tx=0).stop 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.212+0000 7fc353800700 1 -- 172.21.15.82:0/3545920579 shutdown_connections 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.212+0000 7fc353800700 1 --2- 172.21.15.82:0/3545920579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c06c570 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.212+0000 7fc353800700 1 -- 172.21.15.82:0/3545920579 >> 172.21.15.82:0/3545920579 conn(0x7fc34c0d3e10 msgr2=0x7fc34c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.212+0000 7fc353800700 1 -- 172.21.15.82:0/3545920579 shutdown_connections 2024-05-10T04:52:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.212+0000 7fc353800700 1 -- 172.21.15.82:0/3545920579 wait complete. 2024-05-10T04:52:03.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.214+0000 7fc353800700 1 Processor -- start 2024-05-10T04:52:03.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.214+0000 7fc353800700 1 -- start start 2024-05-10T04:52:03.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.215+0000 7fc353800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc353800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc34c15e610 0x7fc34c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc353800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc34c162150 0x7fc34c0d2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc353800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c1f5ec0 con 0x7fc34c06c160 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc353800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c15ec50 con 0x7fc34c162150 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc353800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c15ee90 con 0x7fc34c15e610 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc350e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc350e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56968/0 (socket says 172.21.15.82:56968) 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc350e00700 1 -- 172.21.15.82:0/1491753061 learned_addr learned my addr 172.21.15.82:0/1491753061 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc351800700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc34c162150 0x7fc34c0d2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc350e00700 1 -- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc34c15e610 msgr2=0x7fc34c0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc34be00700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc34c15e610 0x7fc34c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc350e00700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc34c15e610 0x7fc34c0c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc350e00700 1 -- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc34c162150 msgr2=0x7fc34c0d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc350e00700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc34c162150 0x7fc34c0d2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc350e00700 1 -- 172.21.15.82:0/1491753061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344009a70 con 0x7fc34c06c160 2024-05-10T04:52:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc351800700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc34c162150 0x7fc34c0d2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.216+0000 7fc34be00700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc34c15e610 0x7fc34c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.217+0000 7fc350e00700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c160910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c480 tx=0x7fc34000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.217+0000 7fc348c00700 1 -- 172.21.15.82:0/1491753061 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340005d70 con 0x7fc34c06c160 2024-05-10T04:52:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.217+0000 7fc348c00700 1 -- 172.21.15.82:0/1491753061 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3400070d0 con 0x7fc34c06c160 2024-05-10T04:52:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.217+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c160690 con 0x7fc34c06c160 2024-05-10T04:52:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.217+0000 7fc348c00700 1 -- 172.21.15.82:0/1491753061 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340007440 con 0x7fc34c06c160 2024-05-10T04:52:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.217+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c15f0e0 con 0x7fc34c06c160 2024-05-10T04:52:03.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.218+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c1f4810 con 0x7fc34c06c160 2024-05-10T04:52:03.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.219+0000 7fc348c00700 1 -- 172.21.15.82:0/1491753061 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3400075a0 con 0x7fc34c06c160 2024-05-10T04:52:03.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.220+0000 7fc348c00700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc32c06ac90 0x7fc32c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.220+0000 7fc348c00700 1 -- 172.21.15.82:0/1491753061 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc340088940 con 0x7fc34c06c160 2024-05-10T04:52:03.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.220+0000 7fc34be00700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc32c06ac90 0x7fc32c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.221+0000 7fc34be00700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc32c06ac90 0x7fc32c06d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0b2c40 tx=0x7fc338009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:03.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.224+0000 7fc348c00700 1 -- 172.21.15.82:0/1491753061 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc34c1f4810 con 0x7fc34c06c160 2024-05-10T04:52:03.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.427+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc34c15fcf0 con 0x7fc34c06c160 2024-05-10T04:52:03.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.427+0000 7fc348c00700 1 -- 172.21.15.82:0/1491753061 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc34c15fcf0 con 0x7fc34c06c160 2024-05-10T04:52:03.428 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:52:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc32c06ac90 msgr2=0x7fc32c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc32c06ac90 0x7fc32c06d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0b2c40 tx=0x7fc338009040 comp rx=0 tx=0).stop 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 msgr2=0x7fc34c160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c160910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c480 tx=0x7fc34000c840 comp rx=0 tx=0).stop 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 shutdown_connections 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fc32c06ac90 0x7fc32c06d1a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc34c162150 0x7fc34c0d2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc34c06c160 0x7fc34c160910 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 --2- 172.21.15.82:0/1491753061 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fc34c15e610 0x7fc34c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 >> 172.21.15.82:0/1491753061 conn(0x7fc34c0d3e10 msgr2=0x7fc34c0cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 shutdown_connections 2024-05-10T04:52:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.430+0000 7fc353800700 1 -- 172.21.15.82:0/1491753061 wait complete. 2024-05-10T04:52:03.454 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:52:03.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.719+0000 7fa306000700 1 Processor -- start 2024-05-10T04:52:03.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.720+0000 7fa306000700 1 -- start start 2024-05-10T04:52:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.721+0000 7fa306000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa30006df90 0x7fa30006e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.721+0000 7fa306000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa30015d9b0 0x7fa30015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa306000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30006db00 con 0x7fa3000cf610 2024-05-10T04:52:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa306000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30015e300 con 0x7fa30015d9b0 2024-05-10T04:52:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa306000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30015cf00 con 0x7fa30006df90 2024-05-10T04:52:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa2ffe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa30015d9b0 0x7fa30015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa2fea00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fa30006df90 0x7fa30006e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa2ffe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa30015d9b0 0x7fa30015ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56980/0 (socket says 172.21.15.82:56980) 2024-05-10T04:52:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa2ffe00700 1 -- 172.21.15.82:0/2857324044 learned_addr learned my addr 172.21.15.82:0/2857324044 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa2ffe00700 1 -- 172.21.15.82:0/2857324044 >> v2:172.21.15.129:3300/0 conn(0x7fa30006df90 msgr2=0x7fa30006e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa2ffe00700 1 --2- 172.21.15.82:0/2857324044 >> v2:172.21.15.129:3300/0 conn(0x7fa30006df90 0x7fa30006e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa2ffe00700 1 -- 172.21.15.82:0/2857324044 >> v1:172.21.15.129:6789/0 conn(0x7fa3000cf610 legacy=0x7fa30015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.722+0000 7fa2ffe00700 1 -- 172.21.15.82:0/2857324044 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30015d160 con 0x7fa30015d9b0 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.723+0000 7fa2ffe00700 1 --2- 172.21.15.82:0/2857324044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30015d9b0 0x7fa30015ddc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa3000b5090 tx=0x7fa2f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370b456aadc88db1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.723+0000 7fa2fe000700 1 -- 172.21.15.82:0/2857324044 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800e070 con 0x7fa30015d9b0 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.723+0000 7fa2fe000700 1 -- 172.21.15.82:0/2857324044 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f800b910 con 0x7fa30015d9b0 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.723+0000 7fa2fe000700 1 -- 172.21.15.82:0/2857324044 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800bcc0 con 0x7fa30015d9b0 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.723+0000 7fa306000700 1 -- 172.21.15.82:0/2857324044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30015d9b0 msgr2=0x7fa30015ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.723+0000 7fa306000700 1 --2- 172.21.15.82:0/2857324044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30015d9b0 0x7fa30015ddc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa3000b5090 tx=0x7fa2f800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.724+0000 7fa306000700 1 -- 172.21.15.82:0/2857324044 shutdown_connections 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.724+0000 7fa306000700 1 --2- 172.21.15.82:0/2857324044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30015d9b0 0x7fa30015ddc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.724+0000 7fa306000700 1 --2- 172.21.15.82:0/2857324044 >> v2:172.21.15.129:3300/0 conn(0x7fa30006df90 0x7fa30006e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.724+0000 7fa306000700 1 -- 172.21.15.82:0/2857324044 >> 172.21.15.82:0/2857324044 conn(0x7fa3000b1830 msgr2=0x7fa3000b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.724+0000 7fa306000700 1 -- 172.21.15.82:0/2857324044 shutdown_connections 2024-05-10T04:52:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.724+0000 7fa306000700 1 -- 172.21.15.82:0/2857324044 wait complete. 2024-05-10T04:52:03.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.726+0000 7fa306000700 1 Processor -- start 2024-05-10T04:52:03.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.726+0000 7fa306000700 1 -- start start 2024-05-10T04:52:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.727+0000 7fa306000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30006df90 0x7fa300153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa306000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3000cf610 0x7fa300071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa306000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa30015d9b0 0x7fa30013a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa306000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300153f50 con 0x7fa30006df90 2024-05-10T04:52:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa306000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001437b0 con 0x7fa3000cf610 2024-05-10T04:52:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa306000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000b1410 con 0x7fa30015d9b0 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ff400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30006df90 0x7fa300153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ff400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30006df90 0x7fa300153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56992/0 (socket says 172.21.15.82:56992) 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ff400700 1 -- 172.21.15.82:0/1750137835 learned_addr learned my addr 172.21.15.82:0/1750137835 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ffe00700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa30015d9b0 0x7fa30013a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2fea00700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3000cf610 0x7fa300071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ff400700 1 -- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa30015d9b0 msgr2=0x7fa30013a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ff400700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa30015d9b0 0x7fa30013a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ff400700 1 -- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3000cf610 msgr2=0x7fa300071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ff400700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3000cf610 0x7fa300071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ff400700 1 -- 172.21.15.82:0/1750137835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f8009b30 con 0x7fa30006df90 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2ffe00700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa30015d9b0 0x7fa30013a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.728+0000 7fa2fea00700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3000cf610 0x7fa300071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.729+0000 7fa2ff400700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30006df90 0x7fa300153a10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000c430 tx=0x7fa2f000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.729+0000 7fa2f7400700 1 -- 172.21.15.82:0/1750137835 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00052d0 con 0x7fa30006df90 2024-05-10T04:52:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.729+0000 7fa2f7400700 1 -- 172.21.15.82:0/1750137835 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f0005430 con 0x7fa30006df90 2024-05-10T04:52:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.729+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa300141fe0 con 0x7fa30006df90 2024-05-10T04:52:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.729+0000 7fa2f7400700 1 -- 172.21.15.82:0/1750137835 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00038c0 con 0x7fa30006df90 2024-05-10T04:52:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.729+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3001562d0 con 0x7fa30006df90 2024-05-10T04:52:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.730+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3001422c0 con 0x7fa30006df90 2024-05-10T04:52:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.731+0000 7fa2f7400700 1 -- 172.21.15.82:0/1750137835 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa2f0003a20 con 0x7fa30006df90 2024-05-10T04:52:03.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.732+0000 7fa2f7400700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2e006ac90 0x7fa2e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.732+0000 7fa2f7400700 1 -- 172.21.15.82:0/1750137835 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa2f0088860 con 0x7fa30006df90 2024-05-10T04:52:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.732+0000 7fa2fea00700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2e006ac90 0x7fa2e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.733+0000 7fa2fea00700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2e006ac90 0x7fa2e006d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa300141530 tx=0x7fa2ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.736+0000 7fa2f7400700 1 -- 172.21.15.82:0/1750137835 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa2f00538b0 con 0x7fa30006df90 2024-05-10T04:52:03.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.938+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa300074af0 con 0x7fa30006df90 2024-05-10T04:52:03.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.938+0000 7fa2f7400700 1 -- 172.21.15.82:0/1750137835 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2f00170a0 con 0x7fa30006df90 2024-05-10T04:52:03.939 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:52:03.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.940+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2e006ac90 msgr2=0x7fa2e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.940+0000 7fa306000700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2e006ac90 0x7fa2e006d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa300141530 tx=0x7fa2ec008040 comp rx=0 tx=0).stop 2024-05-10T04:52:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.940+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30006df90 msgr2=0x7fa300153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.940+0000 7fa306000700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30006df90 0x7fa300153a10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000c430 tx=0x7fa2f000c7f0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.941+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 shutdown_connections 2024-05-10T04:52:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.941+0000 7fa306000700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fa2e006ac90 0x7fa2e006d1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.941+0000 7fa306000700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fa30015d9b0 0x7fa30013a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.941+0000 7fa306000700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa30006df90 0x7fa300153a10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.941+0000 7fa306000700 1 --2- 172.21.15.82:0/1750137835 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fa3000cf610 0x7fa300071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.941+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 >> 172.21.15.82:0/1750137835 conn(0x7fa3000b1830 msgr2=0x7fa300144430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.941+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 shutdown_connections 2024-05-10T04:52:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:03.941+0000 7fa306000700 1 -- 172.21.15.82:0/1750137835 wait complete. 2024-05-10T04:52:03.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:52:04.147 INFO:tasks.ceph.mds.b.smithi129.stderr:2024-05-10T04:52:04.146+0000 7fbcf2200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:52:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.231+0000 7f8d7d200700 1 Processor -- start 2024-05-10T04:52:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.231+0000 7f8d7d200700 1 -- start start 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d7d200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 0x7f8d78161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d7d200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d780d3030 0x7f8d780d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d7d200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8d780d0630 0x7f8d780d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d7d200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d780b3360 con 0x7f8d780d3030 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d7d200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d781624e0 con 0x7f8d780d0630 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d7d200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780d28c0 con 0x7f8d780b2f50 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d6fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d780d3030 0x7f8d780d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d6fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d780d3030 0x7f8d780d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57008/0 (socket says 172.21.15.82:57008) 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d6fe00700 1 -- 172.21.15.82:0/1085931427 learned_addr learned my addr 172.21.15.82:0/1085931427 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d75e00700 1 --2- 172.21.15.82:0/1085931427 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 0x7f8d78161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.233+0000 7f8d76800700 1 --2- 172.21.15.82:0/1085931427 >> v2:172.21.15.129:3300/0 conn(0x7f8d780d0630 0x7f8d780d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d6fe00700 1 -- 172.21.15.82:0/1085931427 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 msgr2=0x7f8d78161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d6fe00700 1 --2- 172.21.15.82:0/1085931427 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 0x7f8d78161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d6fe00700 1 -- 172.21.15.82:0/1085931427 >> v2:172.21.15.129:3300/0 conn(0x7f8d780d0630 msgr2=0x7f8d780d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d6fe00700 1 --2- 172.21.15.82:0/1085931427 >> v2:172.21.15.129:3300/0 conn(0x7f8d780d0630 0x7f8d780d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d6fe00700 1 -- 172.21.15.82:0/1085931427 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780d2ba0 con 0x7f8d780d3030 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d6fe00700 1 --2- 172.21.15.82:0/1085931427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d3030 0x7f8d780d3440 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d780ce340 tx=0x7f8d60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4778b9346facb696 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d75400700 1 -- 172.21.15.82:0/1085931427 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60011830 con 0x7f8d780d3030 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d75400700 1 -- 172.21.15.82:0/1085931427 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60011990 con 0x7f8d780d3030 2024-05-10T04:52:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.234+0000 7f8d75400700 1 -- 172.21.15.82:0/1085931427 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60011d20 con 0x7f8d780d3030 2024-05-10T04:52:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 -- 172.21.15.82:0/1085931427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d3030 msgr2=0x7f8d780d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 --2- 172.21.15.82:0/1085931427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d3030 0x7f8d780d3440 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d780ce340 tx=0x7f8d60009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 -- 172.21.15.82:0/1085931427 shutdown_connections 2024-05-10T04:52:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 --2- 172.21.15.82:0/1085931427 >> v2:172.21.15.129:3300/0 conn(0x7f8d780d0630 0x7f8d780d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 --2- 172.21.15.82:0/1085931427 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 0x7f8d78161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 --2- 172.21.15.82:0/1085931427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d3030 0x7f8d780d3440 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 -- 172.21.15.82:0/1085931427 >> 172.21.15.82:0/1085931427 conn(0x7f8d7806c3f0 msgr2=0x7f8d7806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 -- 172.21.15.82:0/1085931427 shutdown_connections 2024-05-10T04:52:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.235+0000 7f8d7d200700 1 -- 172.21.15.82:0/1085931427 wait complete. 2024-05-10T04:52:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.237+0000 7f8d7d200700 1 Processor -- start 2024-05-10T04:52:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.238+0000 7f8d7d200700 1 -- start start 2024-05-10T04:52:04.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d7d200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 0x7f8d78153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:04.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d7d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d0630 0x7f8d780b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:04.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d7d200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d780d3030 0x7f8d78152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d7d200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780b1470 con 0x7f8d780d0630 2024-05-10T04:52:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d7d200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78151980 con 0x7f8d780d3030 2024-05-10T04:52:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d7d200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78154460 con 0x7f8d780b2f50 2024-05-10T04:52:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d6fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d0630 0x7f8d780b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d6fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d0630 0x7f8d780b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57018/0 (socket says 172.21.15.82:57018) 2024-05-10T04:52:04.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d6fe00700 1 -- 172.21.15.82:0/52488553 learned_addr learned my addr 172.21.15.82:0/52488553 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.239+0000 7f8d75e00700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 0x7f8d78153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d76800700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d780d3030 0x7f8d78152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6fe00700 1 -- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 msgr2=0x7f8d78153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6fe00700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 0x7f8d78153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6fe00700 1 -- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d780d3030 msgr2=0x7f8d78152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:04.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6fe00700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d780d3030 0x7f8d78152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6fe00700 1 -- 172.21.15.82:0/52488553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d60009550 con 0x7f8d780d0630 2024-05-10T04:52:04.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d76800700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d780d3030 0x7f8d78152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:04.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6fe00700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d0630 0x7f8d780b0980 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8d60014040 tx=0x7f8d60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:04.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6e000700 1 -- 172.21.15.82:0/52488553 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60004240 con 0x7f8d780d0630 2024-05-10T04:52:04.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6e000700 1 -- 172.21.15.82:0/52488553 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6001f070 con 0x7f8d780d0630 2024-05-10T04:52:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d6e000700 1 -- 172.21.15.82:0/52488553 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600036a0 con 0x7f8d780d0630 2024-05-10T04:52:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.240+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d78151bd0 con 0x7f8d780d0630 2024-05-10T04:52:04.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.241+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d78152190 con 0x7f8d780d0630 2024-05-10T04:52:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.242+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d78074af0 con 0x7f8d780d0630 2024-05-10T04:52:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.243+0000 7f8d6e000700 1 -- 172.21.15.82:0/52488553 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d60021030 con 0x7f8d780d0630 2024-05-10T04:52:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.243+0000 7f8d6e000700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d5406ac90 0x7f8d5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.244+0000 7f8d6e000700 1 -- 172.21.15.82:0/52488553 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8d6008a500 con 0x7f8d780d0630 2024-05-10T04:52:04.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.244+0000 7f8d75e00700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d5406ac90 0x7f8d5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.244+0000 7f8d75e00700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d5406ac90 0x7f8d5406d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8d7808d080 tx=0x7f8d68009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:04.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.248+0000 7f8d6e000700 1 -- 172.21.15.82:0/52488553 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8d60055670 con 0x7f8d780d0630 2024-05-10T04:52:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.465+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d780b8c00 con 0x7f8d780d0630 2024-05-10T04:52:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.465+0000 7f8d6e000700 1 -- 172.21.15.82:0/52488553 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v36) v1 ==== 80+0+122 (secure 0 0 0) 0x7f8d60058c90 con 0x7f8d780d0630 2024-05-10T04:52:04.467 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6836/3440576054 2024-05-11T04:51:56.207394+0000 2024-05-10T04:52:04.467 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6834/3440576054 2024-05-11T04:51:56.207394+0000 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d5406ac90 msgr2=0x7f8d5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d5406ac90 0x7f8d5406d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8d7808d080 tx=0x7f8d68009210 comp rx=0 tx=0).stop 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d0630 msgr2=0x7f8d780b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d0630 0x7f8d780b0980 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8d60014040 tx=0x7f8d60004750 comp rx=0 tx=0).stop 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 shutdown_connections 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d5406ac90 0x7f8d5406d1a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d780d3030 0x7f8d78152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d780b2f50 0x7f8d78153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 --2- 172.21.15.82:0/52488553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d780d0630 0x7f8d780b0980 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 >> 172.21.15.82:0/52488553 conn(0x7f8d7806c3f0 msgr2=0x7f8d780b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 shutdown_connections 2024-05-10T04:52:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:04.468+0000 7f8d7d200700 1 -- 172.21.15.82:0/52488553 wait complete. 2024-05-10T04:52:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:listed 2 entries 2024-05-10T04:52:04.493 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T04:52:04.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:04.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:04.570 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:52:04.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:04.570 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T04:52:04.615 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:52:04.616 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:04.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343248k,nr_inodes=4085812,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2024-05-10T04:52:04.668 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:52:04.668 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:04.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343188k,nr_inodes=4085797,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275192k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2024-05-10T04:52:04.713 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:52:04.713 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:04.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343248k,nr_inodes=4085812,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2024-05-10T04:52:04.761 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.023+0000 7fadcf600700 1 Processor -- start 2024-05-10T04:52:05.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.023+0000 7fadcf600700 1 -- start start 2024-05-10T04:52:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadcf600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadc80b60b0 0x7fadc80d2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadcf600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80d2c90 0x7fadc80d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadcf600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc81627a0 con 0x7fadc8162c30 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadcf600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc8163040 con 0x7fadc80b60b0 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadcf600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc815f4e0 con 0x7fadc80d2c90 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadc7e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadc80b60b0 0x7fadc80d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadc7e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadc80b60b0 0x7fadc80d2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57022/0 (socket says 172.21.15.82:57022) 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadc7e00700 1 -- 172.21.15.82:0/3242046055 learned_addr learned my addr 172.21.15.82:0/3242046055 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadccc00700 1 --1- 172.21.15.82:0/3242046055 >> v1:172.21.15.82:6789/0 conn(0x7fadc8162c30 0x7fadc80b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52440/0 (socket says 172.21.15.82:52440) 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.025+0000 7fadcd600700 1 --2- 172.21.15.82:0/3242046055 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80d2c90 0x7fadc80d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7e00700 1 -- 172.21.15.82:0/3242046055 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80d2c90 msgr2=0x7fadc80d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7e00700 1 --2- 172.21.15.82:0/3242046055 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80d2c90 0x7fadc80d30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7e00700 1 -- 172.21.15.82:0/3242046055 >> v1:172.21.15.82:6789/0 conn(0x7fadc8162c30 legacy=0x7fadc80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7e00700 1 -- 172.21.15.82:0/3242046055 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc815fa20 con 0x7fadc80b60b0 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7400700 1 -- 172.21.15.82:0/3242046055 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653616651 0 0) 0x7fadc81627a0 con 0x7fadc8162c30 2024-05-10T04:52:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadcd600700 1 --2- 172.21.15.82:0/3242046055 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80d2c90 0x7fadc80d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:05.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7e00700 1 --2- 172.21.15.82:0/3242046055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc80b60b0 0x7fadc80d2750 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fadb40098f0 tx=0x7fadb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347b9851eaacb6d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:05.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7400700 1 -- 172.21.15.82:0/3242046055 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400b8a0 con 0x7fadc80b60b0 2024-05-10T04:52:05.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7400700 1 -- 172.21.15.82:0/3242046055 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb400ba00 con 0x7fadc80b60b0 2024-05-10T04:52:05.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.026+0000 7fadc7400700 1 -- 172.21.15.82:0/3242046055 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400bd90 con 0x7fadc80b60b0 2024-05-10T04:52:05.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.027+0000 7fadcf600700 1 -- 172.21.15.82:0/3242046055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc80b60b0 msgr2=0x7fadc80d2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.027+0000 7fadcf600700 1 --2- 172.21.15.82:0/3242046055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc80b60b0 0x7fadc80d2750 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fadb40098f0 tx=0x7fadb4009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:05.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.027+0000 7fadcf600700 1 -- 172.21.15.82:0/3242046055 shutdown_connections 2024-05-10T04:52:05.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.027+0000 7fadcf600700 1 --2- 172.21.15.82:0/3242046055 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80d2c90 0x7fadc80d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.027+0000 7fadcf600700 1 --2- 172.21.15.82:0/3242046055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc80b60b0 0x7fadc80d2750 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.027+0000 7fadcf600700 1 -- 172.21.15.82:0/3242046055 >> 172.21.15.82:0/3242046055 conn(0x7fadc80d0b80 msgr2=0x7fadc80d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:05.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.027+0000 7fadcf600700 1 -- 172.21.15.82:0/3242046055 shutdown_connections 2024-05-10T04:52:05.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.027+0000 7fadcf600700 1 -- 172.21.15.82:0/3242046055 wait complete. 2024-05-10T04:52:05.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.029+0000 7fadcf600700 1 Processor -- start 2024-05-10T04:52:05.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.030+0000 7fadcf600700 1 -- start start 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadcf600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fadc80d2c90 0x7fadc80c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadcf600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc8162c30 0x7fadc815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadcf600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80c9620 0x7fadc80c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadcf600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80aca90 con 0x7fadc8162c30 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadcf600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80ca580 con 0x7fadc80d2c90 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadcf600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80c9f70 con 0x7fadc80c9620 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadc7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc8162c30 0x7fadc815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadc7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc8162c30 0x7fadc815b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57030/0 (socket says 172.21.15.82:57030) 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadc7e00700 1 -- 172.21.15.82:0/1439188050 learned_addr learned my addr 172.21.15.82:0/1439188050 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadccc00700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fadc80d2c90 0x7fadc80c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.031+0000 7fadcd600700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80c9620 0x7fadc80c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc7e00700 1 -- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80c9620 msgr2=0x7fadc80c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc7e00700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80c9620 0x7fadc80c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc7e00700 1 -- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fadc80d2c90 msgr2=0x7fadc80c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc7e00700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fadc80d2c90 0x7fadc80c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc7e00700 1 -- 172.21.15.82:0/1439188050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4009550 con 0x7fadc8162c30 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadcd600700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80c9620 0x7fadc80c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc7e00700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc8162c30 0x7fadc815b730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fadb4014040 tx=0x7fadb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc4c00700 1 -- 172.21.15.82:0/1439188050 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4004590 con 0x7fadc8162c30 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc4c00700 1 -- 172.21.15.82:0/1439188050 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb401e070 con 0x7fadc8162c30 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadc4c00700 1 -- 172.21.15.82:0/1439188050 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40038a0 con 0x7fadc8162c30 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc80ca7d0 con 0x7fadc8162c30 2024-05-10T04:52:05.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.032+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc80aac70 con 0x7fadc8162c30 2024-05-10T04:52:05.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.034+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc80732b0 con 0x7fadc8162c30 2024-05-10T04:52:05.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.035+0000 7fadc4c00700 1 -- 172.21.15.82:0/1439188050 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fadb4003a00 con 0x7fadc8162c30 2024-05-10T04:52:05.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.035+0000 7fadc4c00700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fada806acc0 0x7fada806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.035+0000 7fadc4c00700 1 -- 172.21.15.82:0/1439188050 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fadb4020070 con 0x7fadc8162c30 2024-05-10T04:52:05.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.036+0000 7fadccc00700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fada806acc0 0x7fada806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.036+0000 7fadccc00700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fada806acc0 0x7fada806d1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadbc000f60 tx=0x7fadbc007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:05.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.040+0000 7fadc4c00700 1 -- 172.21.15.82:0/1439188050 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fadb40555d0 con 0x7fadc8162c30 2024-05-10T04:52:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.295+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadc80d14a0 con 0x7fadc8162c30 2024-05-10T04:52:05.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.296+0000 7fadc4c00700 1 -- 172.21.15.82:0/1439188050 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fadb4003cb0 con 0x7fadc8162c30 2024-05-10T04:52:05.296 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:05.297 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3738724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3738724499},{"type":"v1","addr":"172.21.15.82:6836","nonce":3738724499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:52:00.229530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4975},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4975":{"gid":4975,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":13,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:52:05.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fada806acc0 msgr2=0x7fada806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fada806acc0 0x7fada806d1d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadbc000f60 tx=0x7fadbc007e70 comp rx=0 tx=0).stop 2024-05-10T04:52:05.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc8162c30 msgr2=0x7fadc815b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc8162c30 0x7fadc815b730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fadb4014040 tx=0x7fadb4004750 comp rx=0 tx=0).stop 2024-05-10T04:52:05.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 shutdown_connections 2024-05-10T04:52:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fada806acc0 0x7fada806d1d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fadc80c9620 0x7fadc80c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fadc80d2c90 0x7fadc80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 --2- 172.21.15.82:0/1439188050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc8162c30 0x7fadc815b730 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.298+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 >> 172.21.15.82:0/1439188050 conn(0x7fadc80d0b80 msgr2=0x7fadc815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.299+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 shutdown_connections 2024-05-10T04:52:05.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.299+0000 7fadcf600700 1 -- 172.21.15.82:0/1439188050 wait complete. 2024-05-10T04:52:05.302 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-05-10T04:52:05.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.589+0000 7fcc1d800700 1 Processor -- start 2024-05-10T04:52:05.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.589+0000 7fcc1d800700 1 -- start start 2024-05-10T04:52:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.591+0000 7fcc1d800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc180ca0d0 0x7fcc1815a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.591+0000 7fcc1d800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc180ca4e0 con 0x7fcc180cf450 2024-05-10T04:52:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.591+0000 7fcc1d800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc180ce600 con 0x7fcc18072630 2024-05-10T04:52:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.591+0000 7fcc1d800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc180cd9f0 con 0x7fcc180ca0d0 2024-05-10T04:52:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.591+0000 7fcc17400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc180ca0d0 0x7fcc1815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.591+0000 7fcc17400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc180ca0d0 0x7fcc1815a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57046/0 (socket says 172.21.15.82:57046) 2024-05-10T04:52:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.591+0000 7fcc16a00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcc180cf450 0x7fcc18071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52446/0 (socket says 172.21.15.82:52446) 2024-05-10T04:52:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.591+0000 7fcc17400700 1 -- 172.21.15.82:0/4265160410 learned_addr learned my addr 172.21.15.82:0/4265160410 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.592+0000 7fcc17400700 1 -- 172.21.15.82:0/4265160410 >> v1:172.21.15.129:6789/0 conn(0x7fcc18072630 legacy=0x7fcc1806ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.592+0000 7fcc17400700 1 -- 172.21.15.82:0/4265160410 >> v1:172.21.15.82:6789/0 conn(0x7fcc180cf450 legacy=0x7fcc18071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.592+0000 7fcc17400700 1 -- 172.21.15.82:0/4265160410 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180cdcd0 con 0x7fcc180ca0d0 2024-05-10T04:52:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.592+0000 7fcc15600700 1 -- 172.21.15.82:0/4265160410 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832305810 0 0) 0x7fcc180ca4e0 con 0x7fcc180cf450 2024-05-10T04:52:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.592+0000 7fcc17400700 1 --2- 172.21.15.82:0/4265160410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180ca0d0 0x7fcc1815a850 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000af60 tx=0x7fcc1000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd20f89b0ac7e2f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.592+0000 7fcc15600700 1 -- 172.21.15.82:0/4265160410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000f070 con 0x7fcc180ca0d0 2024-05-10T04:52:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.592+0000 7fcc15600700 1 -- 172.21.15.82:0/4265160410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1000a2e0 con 0x7fcc180ca0d0 2024-05-10T04:52:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.592+0000 7fcc15600700 1 -- 172.21.15.82:0/4265160410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000ccb0 con 0x7fcc180ca0d0 2024-05-10T04:52:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.593+0000 7fcc1d800700 1 -- 172.21.15.82:0/4265160410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180ca0d0 msgr2=0x7fcc1815a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.593+0000 7fcc1d800700 1 --2- 172.21.15.82:0/4265160410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180ca0d0 0x7fcc1815a850 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000af60 tx=0x7fcc1000af90 comp rx=0 tx=0).stop 2024-05-10T04:52:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.593+0000 7fcc1d800700 1 -- 172.21.15.82:0/4265160410 shutdown_connections 2024-05-10T04:52:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.593+0000 7fcc1d800700 1 --2- 172.21.15.82:0/4265160410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180ca0d0 0x7fcc1815a850 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.593+0000 7fcc1d800700 1 -- 172.21.15.82:0/4265160410 >> 172.21.15.82:0/4265160410 conn(0x7fcc180cfa80 msgr2=0x7fcc180cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.593+0000 7fcc1d800700 1 -- 172.21.15.82:0/4265160410 shutdown_connections 2024-05-10T04:52:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.593+0000 7fcc1d800700 1 -- 172.21.15.82:0/4265160410 wait complete. 2024-05-10T04:52:05.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.595+0000 7fcc1d800700 1 Processor -- start 2024-05-10T04:52:05.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.595+0000 7fcc1d800700 1 -- start start 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc1d800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc180ca0d0 0x7fcc1814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc1d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180cf450 0x7fcc181f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc1d800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc181f47d0 0x7fcc180c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc1d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181f4be0 con 0x7fcc180cf450 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc1d800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181f5940 con 0x7fcc180ca0d0 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc1d800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181f4e00 con 0x7fcc181f47d0 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc16000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180cf450 0x7fcc181f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc16000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180cf450 0x7fcc181f4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57056/0 (socket says 172.21.15.82:57056) 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc16000700 1 -- 172.21.15.82:0/3317291127 learned_addr learned my addr 172.21.15.82:0/3317291127 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:05.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc16a00700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc180ca0d0 0x7fcc1814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.597+0000 7fcc17400700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc181f47d0 0x7fcc180c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc16000700 1 -- 172.21.15.82:0/3317291127 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc181f47d0 msgr2=0x7fcc180c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc16000700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc181f47d0 0x7fcc180c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc16000700 1 -- 172.21.15.82:0/3317291127 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc180ca0d0 msgr2=0x7fcc1814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc16000700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc180ca0d0 0x7fcc1814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc16000700 1 -- 172.21.15.82:0/3317291127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1000ac40 con 0x7fcc180cf450 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc16000700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180cf450 0x7fcc181f4290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c500 tx=0x7fcc0400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc0ea00700 1 -- 172.21.15.82:0/3317291127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc040052d0 con 0x7fcc180cf450 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc0ea00700 1 -- 172.21.15.82:0/3317291127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04005430 con 0x7fcc180cf450 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc181f5050 con 0x7fcc180cf450 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc0ea00700 1 -- 172.21.15.82:0/3317291127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc040038c0 con 0x7fcc180cf450 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.598+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc181536a0 con 0x7fcc180cf450 2024-05-10T04:52:05.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.599+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1814f2d0 con 0x7fcc180cf450 2024-05-10T04:52:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.600+0000 7fcc0ea00700 1 -- 172.21.15.82:0/3317291127 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc04003a20 con 0x7fcc180cf450 2024-05-10T04:52:05.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.601+0000 7fcc0ea00700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbf806ac90 0x7fcbf806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.601+0000 7fcc0ea00700 1 -- 172.21.15.82:0/3317291127 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcc04088740 con 0x7fcc180cf450 2024-05-10T04:52:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.601+0000 7fcc16a00700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbf806ac90 0x7fcbf806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:05.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.602+0000 7fcc16a00700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbf806ac90 0x7fcbf806d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcc08000f60 tx=0x7fcc08004a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:05.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.606+0000 7fcc0ea00700 1 -- 172.21.15.82:0/3317291127 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcc04053820 con 0x7fcc180cf450 2024-05-10T04:52:05.652 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:05.656 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.817+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc18074af0 con 0x7fcc180cf450 2024-05-10T04:52:05.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.819+0000 7fcc0ea00700 1 -- 172.21.15.82:0/3317291127 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16230 (secure 0 0 0) 0x7fcc04056e40 con 0x7fcc180cf450 2024-05-10T04:52:05.820 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:05.820 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:51:56.207427+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:30.829302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:32.104657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6836/3440576054":"2024-05-11T04:51:56.207394+0000","172.21.15.82:6834/3440576054":"2024-05-11T04:51:56.207394+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbf806ac90 msgr2=0x7fcbf806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbf806ac90 0x7fcbf806d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcc08000f60 tx=0x7fcc08004a50 comp rx=0 tx=0).stop 2024-05-10T04:52:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180cf450 msgr2=0x7fcc181f4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180cf450 0x7fcc181f4290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c500 tx=0x7fcc0400c810 comp rx=0 tx=0).stop 2024-05-10T04:52:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 shutdown_connections 2024-05-10T04:52:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcbf806ac90 0x7fcbf806d1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcc181f47d0 0x7fcc180c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcc180ca0d0 0x7fcc1814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 --2- 172.21.15.82:0/3317291127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc180cf450 0x7fcc181f4290 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 >> 172.21.15.82:0/3317291127 conn(0x7fcc180cfa80 msgr2=0x7fcc180cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 shutdown_connections 2024-05-10T04:52:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:05.821+0000 7fcc1d800700 1 -- 172.21.15.82:0/3317291127 wait complete. 2024-05-10T04:52:05.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:50:05.029386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:30.829302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:32.104657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:52:05.850 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:52:06.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.115+0000 7f93ca000700 1 Processor -- start 2024-05-10T04:52:06.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.115+0000 7f93ca000700 1 -- start start 2024-05-10T04:52:06.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.116+0000 7f93ca000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c415e610 0x7f93c40b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.116+0000 7f93ca000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f93c40b7910 0x7f93c406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.116+0000 7f93ca000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c40d2c00 con 0x7f93c4162150 2024-05-10T04:52:06.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.117+0000 7f93ca000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c415ea20 con 0x7f93c40b7910 2024-05-10T04:52:06.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.117+0000 7f93ca000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c4162630 con 0x7f93c415e610 2024-05-10T04:52:06.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.117+0000 7f93c2a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c415e610 0x7f93c40b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.117+0000 7f93c2a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c415e610 0x7f93c40b73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3301/0 says I am v2:172.21.15.82:50696/0 (socket says 172.21.15.82:50696) 2024-05-10T04:52:06.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.117+0000 7f93c2a00700 1 -- 172.21.15.82:0/1711297485 learned_addr learned my addr 172.21.15.82:0/1711297485 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:06.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.117+0000 7f93c3e00700 1 --2- 172.21.15.82:0/1711297485 >> v2:172.21.15.129:3300/0 conn(0x7f93c40b7910 0x7f93c406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.117+0000 7f93c3400700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f93c4162150 0x7f93c40cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:41854/0 (socket says 172.21.15.82:41854) 2024-05-10T04:52:06.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c3e00700 1 -- 172.21.15.82:0/1711297485 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c415e610 msgr2=0x7f93c40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:06.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c3e00700 1 --2- 172.21.15.82:0/1711297485 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c415e610 0x7f93c40b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c3e00700 1 -- 172.21.15.82:0/1711297485 >> v1:172.21.15.129:6789/0 conn(0x7f93c4162150 legacy=0x7f93c40cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c3e00700 1 -- 172.21.15.82:0/1711297485 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c4162910 con 0x7f93c40b7910 2024-05-10T04:52:06.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c2000700 1 -- 172.21.15.82:0/1711297485 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585374480 0 0) 0x7f93c40d2c00 con 0x7f93c4162150 2024-05-10T04:52:06.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c2a00700 1 --2- 172.21.15.82:0/1711297485 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c415e610 0x7f93c40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:06.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c3e00700 1 --2- 172.21.15.82:0/1711297485 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 0x7f93c406c160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009d90 tx=0x7f93bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbaa2b44935842c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:06.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c2000700 1 -- 172.21.15.82:0/1711297485 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00e070 con 0x7f93c40b7910 2024-05-10T04:52:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.118+0000 7f93c2000700 1 -- 172.21.15.82:0/1711297485 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc00bb20 con 0x7f93c40b7910 2024-05-10T04:52:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93c2000700 1 -- 172.21.15.82:0/1711297485 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc012430 con 0x7f93c40b7910 2024-05-10T04:52:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93ca000700 1 -- 172.21.15.82:0/1711297485 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 msgr2=0x7f93c406c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93ca000700 1 --2- 172.21.15.82:0/1711297485 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 0x7f93c406c160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009d90 tx=0x7f93bc00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93ca000700 1 -- 172.21.15.82:0/1711297485 shutdown_connections 2024-05-10T04:52:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93ca000700 1 --2- 172.21.15.82:0/1711297485 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 0x7f93c406c160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93ca000700 1 --2- 172.21.15.82:0/1711297485 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c415e610 0x7f93c40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93ca000700 1 -- 172.21.15.82:0/1711297485 >> 172.21.15.82:0/1711297485 conn(0x7f93c40d3e10 msgr2=0x7f93c40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:06.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93ca000700 1 -- 172.21.15.82:0/1711297485 shutdown_connections 2024-05-10T04:52:06.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.119+0000 7f93ca000700 1 -- 172.21.15.82:0/1711297485 wait complete. 2024-05-10T04:52:06.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.122+0000 7f93ca000700 1 Processor -- start 2024-05-10T04:52:06.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.122+0000 7f93ca000700 1 -- start start 2024-05-10T04:52:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.123+0000 7f93ca000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 0x7f93c414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.123+0000 7f93ca000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c415e610 0x7f93c40ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.123+0000 7f93ca000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c4162150 0x7f93c4149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.123+0000 7f93ca000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c41616b0 con 0x7f93c415e610 2024-05-10T04:52:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.123+0000 7f93ca000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40cc7f0 con 0x7f93c40b7910 2024-05-10T04:52:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.123+0000 7f93ca000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c4161180 con 0x7f93c4162150 2024-05-10T04:52:06.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.123+0000 7f93c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c415e610 0x7f93c40ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c415e610 0x7f93c40ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49956/0 (socket says 172.21.15.82:49956) 2024-05-10T04:52:06.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c2a00700 1 -- 172.21.15.82:0/4180078074 learned_addr learned my addr 172.21.15.82:0/4180078074 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:06.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c3400700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 0x7f93c414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c3e00700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c4162150 0x7f93c4149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c2a00700 1 -- 172.21.15.82:0/4180078074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c4162150 msgr2=0x7f93c4149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c2a00700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c4162150 0x7f93c4149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c2a00700 1 -- 172.21.15.82:0/4180078074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 msgr2=0x7f93c414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c2a00700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 0x7f93c414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c2a00700 1 -- 172.21.15.82:0/4180078074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0009550 con 0x7f93c415e610 2024-05-10T04:52:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.124+0000 7f93c2a00700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c415e610 0x7f93c40ce260 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f93b000e9b0 tx=0x7f93b000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.125+0000 7f93bb400700 1 -- 172.21.15.82:0/4180078074 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000ee50 con 0x7f93c415e610 2024-05-10T04:52:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.125+0000 7f93bb400700 1 -- 172.21.15.82:0/4180078074 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b000c850 con 0x7f93c415e610 2024-05-10T04:52:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.125+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc009a70 con 0x7f93c415e610 2024-05-10T04:52:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.125+0000 7f93bb400700 1 -- 172.21.15.82:0/4180078074 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000cbc0 con 0x7f93c415e610 2024-05-10T04:52:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.125+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c40c7030 con 0x7f93c415e610 2024-05-10T04:52:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.126+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c41484d0 con 0x7f93c415e610 2024-05-10T04:52:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.127+0000 7f93bb400700 1 -- 172.21.15.82:0/4180078074 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f93b000cd20 con 0x7f93c415e610 2024-05-10T04:52:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.128+0000 7f93bb400700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f93a406ac90 0x7f93a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.128+0000 7f93bb400700 1 -- 172.21.15.82:0/4180078074 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f93b00894e0 con 0x7f93c415e610 2024-05-10T04:52:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.128+0000 7f93c3400700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f93a406ac90 0x7f93a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.129+0000 7f93c3400700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f93a406ac90 0x7f93a406d1a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000f60 tx=0x7f93b4007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.133+0000 7f93bb400700 1 -- 172.21.15.82:0/4180078074 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f93b0054660 con 0x7f93c415e610 2024-05-10T04:52:06.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.334+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93c40c7030 con 0x7f93c415e610 2024-05-10T04:52:06.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.335+0000 7f93bb400700 1 -- 172.21.15.82:0/4180078074 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93c40c7030 con 0x7f93c415e610 2024-05-10T04:52:06.335 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f93a406ac90 msgr2=0x7f93a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f93a406ac90 0x7f93a406d1a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93b4000f60 tx=0x7f93b4007e70 comp rx=0 tx=0).stop 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c415e610 msgr2=0x7f93c40ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c415e610 0x7f93c40ce260 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f93b000e9b0 tx=0x7f93b000ecc0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 shutdown_connections 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f93a406ac90 0x7f93a406d1a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f93c4162150 0x7f93c4149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93c40b7910 0x7f93c414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 --2- 172.21.15.82:0/4180078074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c415e610 0x7f93c40ce260 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 >> 172.21.15.82:0/4180078074 conn(0x7f93c40d3e10 msgr2=0x7f93c40cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 shutdown_connections 2024-05-10T04:52:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.337+0000 7f93ca000700 1 -- 172.21.15.82:0/4180078074 wait complete. 2024-05-10T04:52:06.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:52:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.629+0000 7f7f27200700 1 Processor -- start 2024-05-10T04:52:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.629+0000 7f7f27200700 1 -- start start 2024-05-10T04:52:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f27200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f2815f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f27200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7f2806c1a0 0x7f7f2806c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f27200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280d2590 con 0x7f7f2815e790 2024-05-10T04:52:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f27200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280cec30 con 0x7f7f2806c1a0 2024-05-10T04:52:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f27200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2815fe90 con 0x7f7f2815beb0 2024-05-10T04:52:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f26800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7f2815e790 0x7f7f2815eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39984/0 (socket says 172.21.15.82:39984) 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f26800700 1 -- 172.21.15.82:0/653316874 learned_addr learned my addr 172.21.15.82:0/653316874 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f25400700 1 --2- 172.21.15.82:0/653316874 >> v2:172.21.15.129:3300/0 conn(0x7f7f2806c1a0 0x7f7f2806c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f25e00700 1 --2- 172.21.15.82:0/653316874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f2815f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f24a00700 1 -- 172.21.15.82:0/653316874 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723255457 0 0) 0x7f7f280d2590 con 0x7f7f2815e790 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.631+0000 7f7f24a00700 1 -- 172.21.15.82:0/653316874 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f0c0035b0 con 0x7f7f2815e790 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.632+0000 7f7f25e00700 1 -- 172.21.15.82:0/653316874 >> v2:172.21.15.129:3300/0 conn(0x7f7f2806c1a0 msgr2=0x7f7f2806c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.632+0000 7f7f25e00700 1 --2- 172.21.15.82:0/653316874 >> v2:172.21.15.129:3300/0 conn(0x7f7f2806c1a0 0x7f7f2806c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.632+0000 7f7f25e00700 1 -- 172.21.15.82:0/653316874 >> v1:172.21.15.82:6789/0 conn(0x7f7f2815e790 legacy=0x7f7f2815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.632+0000 7f7f25e00700 1 -- 172.21.15.82:0/653316874 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2806caf0 con 0x7f7f2815beb0 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.632+0000 7f7f25e00700 1 --2- 172.21.15.82:0/653316874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f2815f950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009840 tx=0x7f7f18009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef005277c04ec455 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.632+0000 7f7f24a00700 1 -- 172.21.15.82:0/653316874 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011830 con 0x7f7f2815beb0 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.632+0000 7f7f24a00700 1 -- 172.21.15.82:0/653316874 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f18011990 con 0x7f7f2815beb0 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.632+0000 7f7f24a00700 1 -- 172.21.15.82:0/653316874 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011d20 con 0x7f7f2815beb0 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.633+0000 7f7f27200700 1 -- 172.21.15.82:0/653316874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 msgr2=0x7f7f2815f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.633+0000 7f7f27200700 1 --2- 172.21.15.82:0/653316874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f2815f950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009840 tx=0x7f7f18009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.633+0000 7f7f27200700 1 -- 172.21.15.82:0/653316874 shutdown_connections 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.633+0000 7f7f27200700 1 --2- 172.21.15.82:0/653316874 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f2815f950 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.633+0000 7f7f27200700 1 --2- 172.21.15.82:0/653316874 >> v2:172.21.15.129:3300/0 conn(0x7f7f2806c1a0 0x7f7f2806c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.633+0000 7f7f27200700 1 -- 172.21.15.82:0/653316874 >> 172.21.15.82:0/653316874 conn(0x7f7f280d3be0 msgr2=0x7f7f280d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.633+0000 7f7f27200700 1 -- 172.21.15.82:0/653316874 shutdown_connections 2024-05-10T04:52:06.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.633+0000 7f7f27200700 1 -- 172.21.15.82:0/653316874 wait complete. 2024-05-10T04:52:06.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.636+0000 7f7f27200700 1 Processor -- start 2024-05-10T04:52:06.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.636+0000 7f7f27200700 1 -- start start 2024-05-10T04:52:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f27200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f2806c1a0 0x7f7f281f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f27200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f280c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f27200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2815e790 0x7f7f280ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f27200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281584b0 con 0x7f7f2815e790 2024-05-10T04:52:06.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f27200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280b4070 con 0x7f7f2806c1a0 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f27200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280b4ed0 con 0x7f7f2815beb0 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f26800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2815e790 0x7f7f280ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f26800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2815e790 0x7f7f280ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49966/0 (socket says 172.21.15.82:49966) 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f26800700 1 -- 172.21.15.82:0/587925247 learned_addr learned my addr 172.21.15.82:0/587925247 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.638+0000 7f7f25400700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f280c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f26800700 1 -- 172.21.15.82:0/587925247 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 msgr2=0x7f7f280c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f26800700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f280c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f26800700 1 -- 172.21.15.82:0/587925247 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f2806c1a0 msgr2=0x7f7f281f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f26800700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f2806c1a0 0x7f7f281f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f26800700 1 -- 172.21.15.82:0/587925247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180094a0 con 0x7f7f2815e790 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f26800700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2815e790 0x7f7f280ccdf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000caa0 tx=0x7f7f2000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:06.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f1e000700 1 -- 172.21.15.82:0/587925247 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000aa80 con 0x7f7f2815e790 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f1e000700 1 -- 172.21.15.82:0/587925247 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2000abe0 con 0x7f7f2815e790 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f281f4570 con 0x7f7f2815e790 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f1e000700 1 -- 172.21.15.82:0/587925247 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20012400 con 0x7f7f2815e790 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.639+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f280b45a0 con 0x7f7f2815e790 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.640+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f280b6ad0 con 0x7f7f2815e790 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.641+0000 7f7f1e000700 1 -- 172.21.15.82:0/587925247 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f2001b3b0 con 0x7f7f2815e790 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.642+0000 7f7f1e000700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7f0806ac90 0x7f7f0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.642+0000 7f7f1e000700 1 -- 172.21.15.82:0/587925247 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7f200892e0 con 0x7f7f2815e790 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.642+0000 7f7f25e00700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7f0806ac90 0x7f7f0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:06.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.643+0000 7f7f25e00700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7f0806ac90 0x7f7f0806d1a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009840 tx=0x7f7f18010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:06.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.647+0000 7f7f1e000700 1 -- 172.21.15.82:0/587925247 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7f200542b0 con 0x7f7f2815e790 2024-05-10T04:52:06.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.850+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f280b5080 con 0x7f7f2815e790 2024-05-10T04:52:06.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.851+0000 7f7f1e000700 1 -- 172.21.15.82:0/587925247 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f280b5080 con 0x7f7f2815e790 2024-05-10T04:52:06.852 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7f0806ac90 msgr2=0x7f7f0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7f0806ac90 0x7f7f0806d1a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009840 tx=0x7f7f18010000 comp rx=0 tx=0).stop 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2815e790 msgr2=0x7f7f280ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2815e790 0x7f7f280ccdf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000caa0 tx=0x7f7f2000ce60 comp rx=0 tx=0).stop 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 shutdown_connections 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7f0806ac90 0x7f7f0806d1a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2815e790 0x7f7f280ccdf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7f2806c1a0 0x7f7f281f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 --2- 172.21.15.82:0/587925247 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7f2815beb0 0x7f7f280c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:06.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 >> 172.21.15.82:0/587925247 conn(0x7f7f280d3be0 msgr2=0x7f7f2815afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:06.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 shutdown_connections 2024-05-10T04:52:06.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:06.853+0000 7f7f27200700 1 -- 172.21.15.82:0/587925247 wait complete. 2024-05-10T04:52:06.882 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:52:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.148+0000 7fe8dde00700 1 Processor -- start 2024-05-10T04:52:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.148+0000 7fe8dde00700 1 -- start start 2024-05-10T04:52:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.149+0000 7fe8dde00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8d8162150 0x7fe8d815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.149+0000 7fe8dde00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe8d80cf4d0 0x7fe8d80b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8dde00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d80d2c00 con 0x7fe8d80b7910 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8dde00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d8162630 con 0x7fe8d8162150 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8dde00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d8162910 con 0x7fe8d80cf4d0 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8d6a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8d8162150 0x7fe8d815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8d6a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe8d8162150 0x7fe8d815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49976/0 (socket says 172.21.15.82:49976) 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8d6a00700 1 -- 172.21.15.82:0/3482569780 learned_addr learned my addr 172.21.15.82:0/3482569780 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8d6a00700 1 -- 172.21.15.82:0/3482569780 >> v2:172.21.15.129:3300/0 conn(0x7fe8d80cf4d0 msgr2=0x7fe8d80b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8d6a00700 1 --2- 172.21.15.82:0/3482569780 >> v2:172.21.15.129:3300/0 conn(0x7fe8d80cf4d0 0x7fe8d80b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8d6a00700 1 -- 172.21.15.82:0/3482569780 >> v1:172.21.15.129:6789/0 conn(0x7fe8d80b7910 legacy=0x7fe8d806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.150+0000 7fe8d6a00700 1 -- 172.21.15.82:0/3482569780 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8162bf0 con 0x7fe8d8162150 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.151+0000 7fe8d6a00700 1 --2- 172.21.15.82:0/3482569780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d815e610 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80098f0 tx=0x7fe8c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa6d42864cd72b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.151+0000 7fe8d5600700 1 -- 172.21.15.82:0/3482569780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800b860 con 0x7fe8d8162150 2024-05-10T04:52:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.151+0000 7fe8d5600700 1 -- 172.21.15.82:0/3482569780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c800b9c0 con 0x7fe8d8162150 2024-05-10T04:52:07.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.151+0000 7fe8d5600700 1 -- 172.21.15.82:0/3482569780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800bd50 con 0x7fe8d8162150 2024-05-10T04:52:07.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.152+0000 7fe8dde00700 1 -- 172.21.15.82:0/3482569780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 msgr2=0x7fe8d815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.152+0000 7fe8dde00700 1 --2- 172.21.15.82:0/3482569780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d815e610 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80098f0 tx=0x7fe8c8009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.152+0000 7fe8dde00700 1 -- 172.21.15.82:0/3482569780 shutdown_connections 2024-05-10T04:52:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.152+0000 7fe8dde00700 1 --2- 172.21.15.82:0/3482569780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d815e610 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.152+0000 7fe8dde00700 1 --2- 172.21.15.82:0/3482569780 >> v2:172.21.15.129:3300/0 conn(0x7fe8d80cf4d0 0x7fe8d80b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.152+0000 7fe8dde00700 1 -- 172.21.15.82:0/3482569780 >> 172.21.15.82:0/3482569780 conn(0x7fe8d80d3e10 msgr2=0x7fe8d80d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.152+0000 7fe8dde00700 1 -- 172.21.15.82:0/3482569780 shutdown_connections 2024-05-10T04:52:07.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.152+0000 7fe8dde00700 1 -- 172.21.15.82:0/3482569780 wait complete. 2024-05-10T04:52:07.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.154+0000 7fe8dde00700 1 Processor -- start 2024-05-10T04:52:07.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.154+0000 7fe8dde00700 1 -- start start 2024-05-10T04:52:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8dde00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8d80b7910 0x7fe8d81e9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8dde00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8d80cf4d0 0x7fe8d8156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8dde00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d81f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8dde00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d81e9860 con 0x7fe8d8162150 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8dde00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d81f59b0 con 0x7fe8d80b7910 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8dde00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8156780 con 0x7fe8d80cf4d0 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d81f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d81f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49980/0 (socket says 172.21.15.82:49980) 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d7400700 1 -- 172.21.15.82:0/225725174 learned_addr learned my addr 172.21.15.82:0/225725174 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d6a00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8d80b7910 0x7fe8d81e9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d6000700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8d80cf4d0 0x7fe8d8156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d7400700 1 -- 172.21.15.82:0/225725174 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8d80cf4d0 msgr2=0x7fe8d8156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d7400700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8d80cf4d0 0x7fe8d8156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d7400700 1 -- 172.21.15.82:0/225725174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8d80b7910 msgr2=0x7fe8d81e9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d7400700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8d80b7910 0x7fe8d81e9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.156+0000 7fe8d7400700 1 -- 172.21.15.82:0/225725174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c8009550 con 0x7fe8d8162150 2024-05-10T04:52:07.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.157+0000 7fe8d7400700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d81f4c30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000cb50 tx=0x7fe8d000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.157+0000 7fe8cf400700 1 -- 172.21.15.82:0/225725174 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0003c00 con 0x7fe8d8162150 2024-05-10T04:52:07.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.157+0000 7fe8cf400700 1 -- 172.21.15.82:0/225725174 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0003d60 con 0x7fe8d8162150 2024-05-10T04:52:07.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.157+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d81e8280 con 0x7fe8d8162150 2024-05-10T04:52:07.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.157+0000 7fe8cf400700 1 -- 172.21.15.82:0/225725174 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000aa20 con 0x7fe8d8162150 2024-05-10T04:52:07.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.157+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d81e8840 con 0x7fe8d8162150 2024-05-10T04:52:07.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.158+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d8074af0 con 0x7fe8d8162150 2024-05-10T04:52:07.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.159+0000 7fe8cf400700 1 -- 172.21.15.82:0/225725174 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8d000ab80 con 0x7fe8d8162150 2024-05-10T04:52:07.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.161+0000 7fe8cf400700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe8b806ac90 0x7fe8b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.161+0000 7fe8cf400700 1 -- 172.21.15.82:0/225725174 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe8d00894d0 con 0x7fe8d8162150 2024-05-10T04:52:07.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.161+0000 7fe8d6a00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe8b806ac90 0x7fe8b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.161+0000 7fe8d6a00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe8b806ac90 0x7fe8b806d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80098f0 tx=0x7fe8c8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.165+0000 7fe8cf400700 1 -- 172.21.15.82:0/225725174 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe8d0054520 con 0x7fe8d8162150 2024-05-10T04:52:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.367+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8d80b75c0 con 0x7fe8d8162150 2024-05-10T04:52:07.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.367+0000 7fe8cf400700 1 -- 172.21.15.82:0/225725174 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8d0057b40 con 0x7fe8d8162150 2024-05-10T04:52:07.368 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-10T04:52:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe8b806ac90 msgr2=0x7fe8b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe8b806ac90 0x7fe8b806d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80098f0 tx=0x7fe8c8008030 comp rx=0 tx=0).stop 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 msgr2=0x7fe8d81f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d81f4c30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000cb50 tx=0x7fe8d000ce60 comp rx=0 tx=0).stop 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 shutdown_connections 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe8b806ac90 0x7fe8b806d1a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8d8162150 0x7fe8d81f4c30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe8d80b7910 0x7fe8d81e9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 --2- 172.21.15.82:0/225725174 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe8d80cf4d0 0x7fe8d8156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 >> 172.21.15.82:0/225725174 conn(0x7fe8d80d3e10 msgr2=0x7fe8d806c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 shutdown_connections 2024-05-10T04:52:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.370+0000 7fe8dde00700 1 -- 172.21.15.82:0/225725174 wait complete. 2024-05-10T04:52:07.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:07.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.655+0000 7fb8a8000700 1 Processor -- start 2024-05-10T04:52:07.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.656+0000 7fb8a8000700 1 -- start start 2024-05-10T04:52:07.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.657+0000 7fb8a8000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a006c900 0x7fb8a00b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.657+0000 7fb8a8000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8a00b2b90 0x7fb8a00b7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.657+0000 7fb8a8000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a00d34c0 con 0x7fb8a015e6e0 2024-05-10T04:52:07.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.657+0000 7fb8a8000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a006d340 con 0x7fb8a00b2b90 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.657+0000 7fb8a8000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00d2b90 con 0x7fb8a006c900 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a6000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8a00b2b90 0x7fb8a00b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a5600700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb8a015e6e0 0x7fb8a006c1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39994/0 (socket says 172.21.15.82:39994) 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a6000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8a00b2b90 0x7fb8a00b7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49988/0 (socket says 172.21.15.82:49988) 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a5600700 1 -- 172.21.15.82:0/282849963 learned_addr learned my addr 172.21.15.82:0/282849963 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a4c00700 1 --2- 172.21.15.82:0/282849963 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a006c900 0x7fb8a00b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a6000700 1 -- 172.21.15.82:0/282849963 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a006c900 msgr2=0x7fb8a00b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a6000700 1 --2- 172.21.15.82:0/282849963 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a006c900 0x7fb8a00b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a6000700 1 -- 172.21.15.82:0/282849963 >> v1:172.21.15.82:6789/0 conn(0x7fb8a015e6e0 legacy=0x7fb8a006c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a6000700 1 -- 172.21.15.82:0/282849963 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00d2e70 con 0x7fb8a00b2b90 2024-05-10T04:52:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.658+0000 7fb8a6000700 1 --2- 172.21.15.82:0/282849963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a00b2b90 0x7fb8a00b7980 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb898009d90 tx=0x7fb89800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e914dbdf0c97666 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb89fe00700 1 -- 172.21.15.82:0/282849963 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89800e070 con 0x7fb8a00b2b90 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb89fe00700 1 -- 172.21.15.82:0/282849963 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89800bbd0 con 0x7fb8a00b2b90 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb89fe00700 1 -- 172.21.15.82:0/282849963 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898012430 con 0x7fb8a00b2b90 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb8a8000700 1 -- 172.21.15.82:0/282849963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a00b2b90 msgr2=0x7fb8a00b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb8a8000700 1 --2- 172.21.15.82:0/282849963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a00b2b90 0x7fb8a00b7980 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb898009d90 tx=0x7fb89800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb8a8000700 1 -- 172.21.15.82:0/282849963 shutdown_connections 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb8a8000700 1 --2- 172.21.15.82:0/282849963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a00b2b90 0x7fb8a00b7980 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb8a8000700 1 --2- 172.21.15.82:0/282849963 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a006c900 0x7fb8a00b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.659+0000 7fb8a8000700 1 -- 172.21.15.82:0/282849963 >> 172.21.15.82:0/282849963 conn(0x7fb8a00b5db0 msgr2=0x7fb8a00b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.660+0000 7fb8a8000700 1 -- 172.21.15.82:0/282849963 shutdown_connections 2024-05-10T04:52:07.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.660+0000 7fb8a8000700 1 -- 172.21.15.82:0/282849963 wait complete. 2024-05-10T04:52:07.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.662+0000 7fb8a8000700 1 Processor -- start 2024-05-10T04:52:07.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.662+0000 7fb8a8000700 1 -- start start 2024-05-10T04:52:07.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.663+0000 7fb8a8000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a00b2b90 0x7fb8a01544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.663+0000 7fb8a8000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a015e6e0 0x7fb8a013ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.663+0000 7fb8a8000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8a013f390 0x7fb8a01f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.663+0000 7fb8a8000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a0158e30 con 0x7fb8a015e6e0 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.663+0000 7fb8a8000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a0154a10 con 0x7fb8a013f390 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.663+0000 7fb8a8000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a013ff60 con 0x7fb8a00b2b90 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a015e6e0 0x7fb8a013ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a015e6e0 0x7fb8a013ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50004/0 (socket says 172.21.15.82:50004) 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 -- 172.21.15.82:0/1277192589 learned_addr learned my addr 172.21.15.82:0/1277192589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a6000700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8a013f390 0x7fb8a01f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a5600700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a00b2b90 0x7fb8a01544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 -- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a00b2b90 msgr2=0x7fb8a01544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a00b2b90 0x7fb8a01544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 -- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8a013f390 msgr2=0x7fb8a01f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8a013f390 0x7fb8a01f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 -- 172.21.15.82:0/1277192589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898009a70 con 0x7fb8a015e6e0 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a6000700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8a013f390 0x7fb8a01f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb8a4c00700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a015e6e0 0x7fb8a013ee50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00d800 tx=0x7fb88c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.664+0000 7fb89d600700 1 -- 172.21.15.82:0/1277192589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0125f0 con 0x7fb8a015e6e0 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.665+0000 7fb89d600700 1 -- 172.21.15.82:0/1277192589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c012750 con 0x7fb8a015e6e0 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.665+0000 7fb89d600700 1 -- 172.21.15.82:0/1277192589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c012b00 con 0x7fb8a015e6e0 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.665+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a0157490 con 0x7fb8a015e6e0 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.665+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a0159250 con 0x7fb8a015e6e0 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.666+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a00732b0 con 0x7fb8a015e6e0 2024-05-10T04:52:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.667+0000 7fb89d600700 1 -- 172.21.15.82:0/1277192589 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb88c012c60 con 0x7fb8a015e6e0 2024-05-10T04:52:07.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.668+0000 7fb89d600700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb88006ac90 0x7fb88006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.668+0000 7fb89d600700 1 -- 172.21.15.82:0/1277192589 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb88c089760 con 0x7fb8a015e6e0 2024-05-10T04:52:07.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.668+0000 7fb8a5600700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb88006ac90 0x7fb88006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.669+0000 7fb8a5600700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb88006ac90 0x7fb88006d1a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb894005910 tx=0x7fb894009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.674+0000 7fb89d600700 1 -- 172.21.15.82:0/1277192589 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb88c0548c0 con 0x7fb8a015e6e0 2024-05-10T04:52:07.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.922+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8a0158f70 con 0x7fb8a015e6e0 2024-05-10T04:52:07.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.923+0000 7fb89d600700 1 -- 172.21.15.82:0/1277192589 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fb88c057ee0 con 0x7fb8a015e6e0 2024-05-10T04:52:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:07.923 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3738724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3738724499},{"type":"v1","addr":"172.21.15.82:6836","nonce":3738724499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:52:00.229530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4975},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4975":{"gid":4975,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":13,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:52:07.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb88006ac90 msgr2=0x7fb88006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb88006ac90 0x7fb88006d1a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb894005910 tx=0x7fb894009040 comp rx=0 tx=0).stop 2024-05-10T04:52:07.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a015e6e0 msgr2=0x7fb8a013ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a015e6e0 0x7fb8a013ee50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00d800 tx=0x7fb88c00dbc0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 shutdown_connections 2024-05-10T04:52:07.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb88006ac90 0x7fb88006d1a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8a013f390 0x7fb8a01f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8a00b2b90 0x7fb8a01544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 --2- 172.21.15.82:0/1277192589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8a015e6e0 0x7fb8a013ee50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 >> 172.21.15.82:0/1277192589 conn(0x7fb8a00b5db0 msgr2=0x7fb8a00d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.925+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 shutdown_connections 2024-05-10T04:52:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:07.926+0000 7fb8a8000700 1 -- 172.21.15.82:0/1277192589 wait complete. 2024-05-10T04:52:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-05-10T04:52:07.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.210+0000 7f8d59400700 1 Processor -- start 2024-05-10T04:52:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.210+0000 7f8d59400700 1 -- start start 2024-05-10T04:52:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.212+0000 7f8d59400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f8d5415bfe0 0x7f8d5415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.212+0000 7f8d59400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d54161fb0 0x7f8d541623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.212+0000 7f8d59400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d54162a70 con 0x7f8d540b5890 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.212+0000 7f8d59400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5415c3f0 con 0x7f8d54161fb0 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.212+0000 7f8d59400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d54162d50 con 0x7f8d5415bfe0 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.212+0000 7f8d51e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d54161fb0 0x7f8d541623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d51e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d54161fb0 0x7f8d541623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50012/0 (socket says 172.21.15.82:50012) 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d51e00700 1 -- 172.21.15.82:0/1512199306 learned_addr learned my addr 172.21.15.82:0/1512199306 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d51e00700 1 -- 172.21.15.82:0/1512199306 >> v2:172.21.15.129:3300/0 conn(0x7f8d5415bfe0 msgr2=0x7f8d5415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d52800700 1 --2- 172.21.15.82:0/1512199306 >> v2:172.21.15.129:3300/0 conn(0x7f8d5415bfe0 0x7f8d5415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d51e00700 1 --2- 172.21.15.82:0/1512199306 >> v2:172.21.15.129:3300/0 conn(0x7f8d5415bfe0 0x7f8d5415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d51e00700 1 -- 172.21.15.82:0/1512199306 >> v1:172.21.15.129:6789/0 conn(0x7f8d540b5890 legacy=0x7f8d540b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d51e00700 1 -- 172.21.15.82:0/1512199306 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5415ecf0 con 0x7f8d54161fb0 2024-05-10T04:52:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d52800700 1 --2- 172.21.15.82:0/1512199306 >> v2:172.21.15.129:3300/0 conn(0x7f8d5415bfe0 0x7f8d5415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:08.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d51e00700 1 --2- 172.21.15.82:0/1512199306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d54161fb0 0x7f8d541623c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8d5408c860 tx=0x7f8d40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab9e6993abe4679 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.213+0000 7f8d51400700 1 -- 172.21.15.82:0/1512199306 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40004230 con 0x7f8d54161fb0 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d51400700 1 -- 172.21.15.82:0/1512199306 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40004390 con 0x7f8d54161fb0 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d51400700 1 -- 172.21.15.82:0/1512199306 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400036a0 con 0x7f8d54161fb0 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d59400700 1 -- 172.21.15.82:0/1512199306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d54161fb0 msgr2=0x7f8d541623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d59400700 1 --2- 172.21.15.82:0/1512199306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d54161fb0 0x7f8d541623c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8d5408c860 tx=0x7f8d40009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d59400700 1 -- 172.21.15.82:0/1512199306 shutdown_connections 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d59400700 1 --2- 172.21.15.82:0/1512199306 >> v2:172.21.15.129:3300/0 conn(0x7f8d5415bfe0 0x7f8d5415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d59400700 1 --2- 172.21.15.82:0/1512199306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d54161fb0 0x7f8d541623c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d59400700 1 -- 172.21.15.82:0/1512199306 >> 172.21.15.82:0/1512199306 conn(0x7f8d540d0a70 msgr2=0x7f8d540d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d59400700 1 -- 172.21.15.82:0/1512199306 shutdown_connections 2024-05-10T04:52:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.214+0000 7f8d59400700 1 -- 172.21.15.82:0/1512199306 wait complete. 2024-05-10T04:52:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.217+0000 7f8d59400700 1 Processor -- start 2024-05-10T04:52:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.217+0000 7f8d59400700 1 -- start start 2024-05-10T04:52:08.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.218+0000 7f8d59400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d540b5890 0x7f8d5415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.218+0000 7f8d59400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d5415bfe0 0x7f8d54159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.218+0000 7f8d59400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d54161fb0 0x7f8d54158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.218+0000 7f8d59400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540cb900 con 0x7f8d540b5890 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.218+0000 7f8d59400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540c7b60 con 0x7f8d54161fb0 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.218+0000 7f8d59400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540c7d00 con 0x7f8d5415bfe0 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d540b5890 0x7f8d5415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d540b5890 0x7f8d5415a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50020/0 (socket says 172.21.15.82:50020) 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 -- 172.21.15.82:0/1168227650 learned_addr learned my addr 172.21.15.82:0/1168227650 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d51e00700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d5415bfe0 0x7f8d54159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d53200700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d54161fb0 0x7f8d54158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 -- 172.21.15.82:0/1168227650 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d5415bfe0 msgr2=0x7f8d54159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d5415bfe0 0x7f8d54159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 -- 172.21.15.82:0/1168227650 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d54161fb0 msgr2=0x7f8d54158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d54161fb0 0x7f8d54158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 -- 172.21.15.82:0/1168227650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009550 con 0x7f8d540b5890 2024-05-10T04:52:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.219+0000 7f8d52800700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d540b5890 0x7f8d5415a7c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c820 tx=0x7f8d4400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.220+0000 7f8d4aa00700 1 -- 172.21.15.82:0/1168227650 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44011800 con 0x7f8d540b5890 2024-05-10T04:52:08.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.220+0000 7f8d4aa00700 1 -- 172.21.15.82:0/1168227650 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d44011960 con 0x7f8d540b5890 2024-05-10T04:52:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.220+0000 7f8d4aa00700 1 -- 172.21.15.82:0/1168227650 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44011cf0 con 0x7f8d540b5890 2024-05-10T04:52:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.220+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5415ad30 con 0x7f8d540b5890 2024-05-10T04:52:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.220+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d540caf60 con 0x7f8d540b5890 2024-05-10T04:52:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.221+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d54074af0 con 0x7f8d540b5890 2024-05-10T04:52:08.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.222+0000 7f8d4aa00700 1 -- 172.21.15.82:0/1168227650 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d440233a0 con 0x7f8d540b5890 2024-05-10T04:52:08.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.223+0000 7f8d4aa00700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d3406ac90 0x7f8d3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.223+0000 7f8d4aa00700 1 -- 172.21.15.82:0/1168227650 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8d440895e0 con 0x7f8d540b5890 2024-05-10T04:52:08.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.224+0000 7f8d51e00700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d3406ac90 0x7f8d3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.224+0000 7f8d51e00700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d3406ac90 0x7f8d3406d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009130 tx=0x7f8d40008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.228+0000 7f8d4aa00700 1 -- 172.21.15.82:0/1168227650 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8d440546c0 con 0x7f8d540b5890 2024-05-10T04:52:08.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.431+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d540c75a0 con 0x7f8d540b5890 2024-05-10T04:52:08.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.432+0000 7f8d4aa00700 1 -- 172.21.15.82:0/1168227650 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16230 (secure 0 0 0) 0x7f8d44057ce0 con 0x7f8d540b5890 2024-05-10T04:52:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:08.594 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:51:56.207427+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:30.829302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:32.104657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6836/3440576054":"2024-05-11T04:51:56.207394+0000","172.21.15.82:6834/3440576054":"2024-05-11T04:51:56.207394+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d3406ac90 msgr2=0x7f8d3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d3406ac90 0x7f8d3406d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009130 tx=0x7f8d40008030 comp rx=0 tx=0).stop 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d540b5890 msgr2=0x7f8d5415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d540b5890 0x7f8d5415a7c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c820 tx=0x7f8d4400cb30 comp rx=0 tx=0).stop 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 shutdown_connections 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8d3406ac90 0x7f8d3406d1a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8d54161fb0 0x7f8d54158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d540b5890 0x7f8d5415a7c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 --2- 172.21.15.82:0/1168227650 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8d5415bfe0 0x7f8d54159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.434+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 >> 172.21.15.82:0/1168227650 conn(0x7f8d540d0a70 msgr2=0x7f8d541602e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:08.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.435+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 shutdown_connections 2024-05-10T04:52:08.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.435+0000 7f8d59400700 1 -- 172.21.15.82:0/1168227650 wait complete. 2024-05-10T04:52:08.597 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T04:52:08.598 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.861+0000 7f7c96000700 1 Processor -- start 2024-05-10T04:52:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.861+0000 7f7c96000700 1 -- start start 2024-05-10T04:52:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.863+0000 7f7c96000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f7c9015bfe0 0x7f7c9015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.863+0000 7f7c96000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c900b5fa0 0x7f7c901623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.863+0000 7f7c96000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c90162a70 con 0x7f7c90161fb0 2024-05-10T04:52:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.863+0000 7f7c96000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9015c3f0 con 0x7f7c900b5fa0 2024-05-10T04:52:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.863+0000 7f7c96000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c90162d50 con 0x7f7c9015bfe0 2024-05-10T04:52:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.863+0000 7f7c8ea00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7c90161fb0 0x7f7c900b5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40004/0 (socket says 172.21.15.82:40004) 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.863+0000 7f7c8ea00700 1 -- 172.21.15.82:0/3763644858 learned_addr learned my addr 172.21.15.82:0/3763644858 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.863+0000 7f7c8fe00700 1 --2- 172.21.15.82:0/3763644858 >> v2:172.21.15.82:3300/0 conn(0x7f7c900b5fa0 0x7f7c901623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8f400700 1 --2- 172.21.15.82:0/3763644858 >> v2:172.21.15.129:3300/0 conn(0x7f7c9015bfe0 0x7f7c9015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8e000700 1 -- 172.21.15.82:0/3763644858 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132869403 0 0) 0x7f7c90162a70 con 0x7f7c90161fb0 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8e000700 1 -- 172.21.15.82:0/3763644858 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c740035b0 con 0x7f7c90161fb0 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8fe00700 1 -- 172.21.15.82:0/3763644858 >> v2:172.21.15.129:3300/0 conn(0x7f7c9015bfe0 msgr2=0x7f7c9015f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8fe00700 1 --2- 172.21.15.82:0/3763644858 >> v2:172.21.15.129:3300/0 conn(0x7f7c9015bfe0 0x7f7c9015f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8fe00700 1 -- 172.21.15.82:0/3763644858 >> v1:172.21.15.82:6789/0 conn(0x7f7c90161fb0 legacy=0x7f7c900b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8fe00700 1 -- 172.21.15.82:0/3763644858 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9015ecf0 con 0x7f7c900b5fa0 2024-05-10T04:52:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8fe00700 1 --2- 172.21.15.82:0/3763644858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c900b5fa0 0x7f7c901623c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7c9008c860 tx=0x7f7c8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90f3258c52ae3be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8e000700 1 -- 172.21.15.82:0/3763644858 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800e070 con 0x7f7c900b5fa0 2024-05-10T04:52:08.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8e000700 1 -- 172.21.15.82:0/3763644858 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8800bb20 con 0x7f7c900b5fa0 2024-05-10T04:52:08.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.864+0000 7f7c8e000700 1 -- 172.21.15.82:0/3763644858 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88012430 con 0x7f7c900b5fa0 2024-05-10T04:52:08.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.865+0000 7f7c96000700 1 -- 172.21.15.82:0/3763644858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c900b5fa0 msgr2=0x7f7c901623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.865+0000 7f7c96000700 1 --2- 172.21.15.82:0/3763644858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c900b5fa0 0x7f7c901623c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7c9008c860 tx=0x7f7c8800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.865+0000 7f7c96000700 1 -- 172.21.15.82:0/3763644858 shutdown_connections 2024-05-10T04:52:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.865+0000 7f7c96000700 1 --2- 172.21.15.82:0/3763644858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c900b5fa0 0x7f7c901623c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.865+0000 7f7c96000700 1 --2- 172.21.15.82:0/3763644858 >> v2:172.21.15.129:3300/0 conn(0x7f7c9015bfe0 0x7f7c9015f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.865+0000 7f7c96000700 1 -- 172.21.15.82:0/3763644858 >> 172.21.15.82:0/3763644858 conn(0x7f7c900d0a70 msgr2=0x7f7c900d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.865+0000 7f7c96000700 1 -- 172.21.15.82:0/3763644858 shutdown_connections 2024-05-10T04:52:08.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.865+0000 7f7c96000700 1 -- 172.21.15.82:0/3763644858 wait complete. 2024-05-10T04:52:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.867+0000 7f7c96000700 1 Processor -- start 2024-05-10T04:52:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.868+0000 7f7c96000700 1 -- start start 2024-05-10T04:52:08.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c96000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9015bfe0 0x7f7c900c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c96000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c90161fb0 0x7f7c901585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c96000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c90159780 0x7f7c900d3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c96000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c901f5380 con 0x7f7c9015bfe0 2024-05-10T04:52:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c96000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c90159c80 con 0x7f7c90161fb0 2024-05-10T04:52:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c96000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9015aae0 con 0x7f7c90159780 2024-05-10T04:52:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c8f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9015bfe0 0x7f7c900c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c8f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9015bfe0 0x7f7c900c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50040/0 (socket says 172.21.15.82:50040) 2024-05-10T04:52:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.869+0000 7f7c8f400700 1 -- 172.21.15.82:0/2585503892 learned_addr learned my addr 172.21.15.82:0/2585503892 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:08.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8ea00700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c90161fb0 0x7f7c901585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8fe00700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c90159780 0x7f7c900d3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8f400700 1 -- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c90159780 msgr2=0x7f7c900d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8f400700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c90159780 0x7f7c900d3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8f400700 1 -- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c90161fb0 msgr2=0x7f7c901585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8f400700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c90161fb0 0x7f7c901585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8f400700 1 -- 172.21.15.82:0/2585503892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009a70 con 0x7f7c9015bfe0 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8ea00700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c90161fb0 0x7f7c901585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c8f400700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9015bfe0 0x7f7c900c7b50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000d830 tx=0x7f7c8000dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c87400700 1 -- 172.21.15.82:0/2585503892 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800125f0 con 0x7f7c9015bfe0 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c87400700 1 -- 172.21.15.82:0/2585503892 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c80012750 con 0x7f7c9015bfe0 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c87400700 1 -- 172.21.15.82:0/2585503892 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c80012b00 con 0x7f7c9015bfe0 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c90159ed0 con 0x7f7c9015bfe0 2024-05-10T04:52:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.870+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9015a490 con 0x7f7c9015bfe0 2024-05-10T04:52:08.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.871+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9015adc0 con 0x7f7c9015bfe0 2024-05-10T04:52:08.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.872+0000 7f7c87400700 1 -- 172.21.15.82:0/2585503892 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c80012c60 con 0x7f7c9015bfe0 2024-05-10T04:52:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.873+0000 7f7c87400700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c7006acc0 0x7f7c7006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.873+0000 7f7c87400700 1 -- 172.21.15.82:0/2585503892 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7c80089860 con 0x7f7c9015bfe0 2024-05-10T04:52:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.874+0000 7f7c8ea00700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c7006acc0 0x7f7c7006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.874+0000 7f7c8ea00700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c7006acc0 0x7f7c7006d1d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b9860 tx=0x7f7c7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:08.878+0000 7f7c87400700 1 -- 172.21.15.82:0/2585503892 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7c800548b0 con 0x7f7c9015bfe0 2024-05-10T04:52:09.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.129+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c9015ac20 con 0x7f7c9015bfe0 2024-05-10T04:52:09.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.130+0000 7f7c87400700 1 -- 172.21.15.82:0/2585503892 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f7c9015ac20 con 0x7f7c9015bfe0 2024-05-10T04:52:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:09.130 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3738724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3738724499},{"type":"v1","addr":"172.21.15.82:6836","nonce":3738724499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:52:00.229530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4975},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4975":{"gid":4975,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":13,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c7006acc0 msgr2=0x7f7c7006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c7006acc0 0x7f7c7006d1d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b9860 tx=0x7f7c7c009040 comp rx=0 tx=0).stop 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9015bfe0 msgr2=0x7f7c900c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9015bfe0 0x7f7c900c7b50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000d830 tx=0x7f7c8000dbf0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 shutdown_connections 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f7c7006acc0 0x7f7c7006d1d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f7c90159780 0x7f7c900d3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9015bfe0 0x7f7c900c7b50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 --2- 172.21.15.82:0/2585503892 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7c90161fb0 0x7f7c901585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.132+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 >> 172.21.15.82:0/2585503892 conn(0x7f7c900d0a70 msgr2=0x7f7c9015d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.133+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 shutdown_connections 2024-05-10T04:52:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.133+0000 7f7c96000700 1 -- 172.21.15.82:0/2585503892 wait complete. 2024-05-10T04:52:09.134 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-05-10T04:52:09.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.418+0000 7fd8cca00700 1 Processor -- start 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.418+0000 7fd8cca00700 1 -- start start 2024-05-10T04:52:09.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.420+0000 7fd8cca00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd8c815e6e0 0x7fd8c806c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.420+0000 7fd8cca00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c80b2b90 0x7fd8c806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.420+0000 7fd8cca00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c80d34c0 con 0x7fd8c80b3050 2024-05-10T04:52:09.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.420+0000 7fd8cca00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c806d340 con 0x7fd8c815e6e0 2024-05-10T04:52:09.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.420+0000 7fd8cca00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80d2b90 con 0x7fd8c80b2b90 2024-05-10T04:52:09.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.420+0000 7fd8c5e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd8c815e6e0 0x7fd8c806c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.420+0000 7fd8c6800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd8c80b3050 0x7fd8c80d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40012/0 (socket says 172.21.15.82:40012) 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.420+0000 7fd8c6800700 1 -- 172.21.15.82:0/1284473677 learned_addr learned my addr 172.21.15.82:0/1284473677 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8bfe00700 1 --2- 172.21.15.82:0/1284473677 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c80b2b90 0x7fd8c806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8c5e00700 1 -- 172.21.15.82:0/1284473677 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c80b2b90 msgr2=0x7fd8c806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8c5e00700 1 --2- 172.21.15.82:0/1284473677 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c80b2b90 0x7fd8c806c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8c5e00700 1 -- 172.21.15.82:0/1284473677 >> v1:172.21.15.82:6789/0 conn(0x7fd8c80b3050 legacy=0x7fd8c80d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8c5e00700 1 -- 172.21.15.82:0/1284473677 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80d2e70 con 0x7fd8c815e6e0 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8c5400700 1 -- 172.21.15.82:0/1284473677 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446502654 0 0) 0x7fd8c80d34c0 con 0x7fd8c80b3050 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8bfe00700 1 --2- 172.21.15.82:0/1284473677 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c80b2b90 0x7fd8c806c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8c5e00700 1 --2- 172.21.15.82:0/1284473677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c815e6e0 0x7fd8c806c1f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009840 tx=0x7fd8b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fe4441cc71100 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8c5400700 1 -- 172.21.15.82:0/1284473677 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8011830 con 0x7fd8c815e6e0 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.421+0000 7fd8c5400700 1 -- 172.21.15.82:0/1284473677 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b8011990 con 0x7fd8c815e6e0 2024-05-10T04:52:09.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8c5400700 1 -- 172.21.15.82:0/1284473677 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8011d20 con 0x7fd8c815e6e0 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8cca00700 1 -- 172.21.15.82:0/1284473677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c815e6e0 msgr2=0x7fd8c806c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8cca00700 1 --2- 172.21.15.82:0/1284473677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c815e6e0 0x7fd8c806c1f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009840 tx=0x7fd8b8009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8cca00700 1 -- 172.21.15.82:0/1284473677 shutdown_connections 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8cca00700 1 --2- 172.21.15.82:0/1284473677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c815e6e0 0x7fd8c806c1f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8cca00700 1 --2- 172.21.15.82:0/1284473677 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c80b2b90 0x7fd8c806c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8cca00700 1 -- 172.21.15.82:0/1284473677 >> 172.21.15.82:0/1284473677 conn(0x7fd8c80b5db0 msgr2=0x7fd8c80b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8cca00700 1 -- 172.21.15.82:0/1284473677 shutdown_connections 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.422+0000 7fd8cca00700 1 -- 172.21.15.82:0/1284473677 wait complete. 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.425+0000 7fd8cca00700 1 Processor -- start 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.425+0000 7fd8cca00700 1 -- start start 2024-05-10T04:52:09.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.426+0000 7fd8cca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c80b2b90 0x7fd8c8153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.426+0000 7fd8cca00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8c80b3050 0x7fd8c81544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.426+0000 7fd8cca00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c815e6e0 0x7fd8c81f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.426+0000 7fd8cca00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c815c490 con 0x7fd8c80b2b90 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.426+0000 7fd8cca00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8152180 con 0x7fd8c80b3050 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.426+0000 7fd8cca00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c815db90 con 0x7fd8c815e6e0 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.426+0000 7fd8c5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c80b2b90 0x7fd8c8153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.426+0000 7fd8c5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c80b2b90 0x7fd8c8153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50052/0 (socket says 172.21.15.82:50052) 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.427+0000 7fd8c5e00700 1 -- 172.21.15.82:0/2109150064 learned_addr learned my addr 172.21.15.82:0/2109150064 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.427+0000 7fd8c5e00700 1 -- 172.21.15.82:0/2109150064 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c815e6e0 msgr2=0x7fd8c81f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.427+0000 7fd8c5e00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c815e6e0 0x7fd8c81f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.427+0000 7fd8c5e00700 1 -- 172.21.15.82:0/2109150064 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8c80b3050 msgr2=0x7fd8c81544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.427+0000 7fd8c5e00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8c80b3050 0x7fd8c81544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.427+0000 7fd8c5e00700 1 -- 172.21.15.82:0/2109150064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80094a0 con 0x7fd8c80b2b90 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.427+0000 7fd8c5e00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c80b2b90 0x7fd8c8153f70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80090b0 tx=0x7fd8b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.427+0000 7fd8be000700 1 -- 172.21.15.82:0/2109150064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80036a0 con 0x7fd8c80b2b90 2024-05-10T04:52:09.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.428+0000 7fd8be000700 1 -- 172.21.15.82:0/2109150064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b801e070 con 0x7fd8c80b2b90 2024-05-10T04:52:09.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.428+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c81523d0 con 0x7fd8c80b2b90 2024-05-10T04:52:09.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.428+0000 7fd8be000700 1 -- 172.21.15.82:0/2109150064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8003a20 con 0x7fd8c80b2b90 2024-05-10T04:52:09.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.428+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c8152990 con 0x7fd8c80b2b90 2024-05-10T04:52:09.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.429+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c80732b0 con 0x7fd8c80b2b90 2024-05-10T04:52:09.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.430+0000 7fd8be000700 1 -- 172.21.15.82:0/2109150064 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8b8003b80 con 0x7fd8c80b2b90 2024-05-10T04:52:09.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.430+0000 7fd8be000700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8a406acc0 0x7fd8a406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.431+0000 7fd8be000700 1 -- 172.21.15.82:0/2109150064 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd8b808a460 con 0x7fd8c80b2b90 2024-05-10T04:52:09.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.431+0000 7fd8bfe00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8a406acc0 0x7fd8a406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.431+0000 7fd8bfe00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8a406acc0 0x7fd8a406d1d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8158750 tx=0x7fd8b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.435+0000 7fd8be000700 1 -- 172.21.15.82:0/2109150064 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd8b8055650 con 0x7fd8c80b2b90 2024-05-10T04:52:09.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.679+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8c8074af0 con 0x7fd8c80b2b90 2024-05-10T04:52:09.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.680+0000 7fd8be000700 1 -- 172.21.15.82:0/2109150064 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fd8b8058c70 con 0x7fd8c80b2b90 2024-05-10T04:52:09.680 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:09.680 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3738724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3738724499},{"type":"v1","addr":"172.21.15.82:6836","nonce":3738724499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:33.124469+0000","modified":"2024-05-10T04:52:00.229530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4975},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4975":{"gid":4975,"name":"b","rank":0,"incarnation":18,"state":"up:active","state_seq":13,"addr":"172.21.15.129:6835/2037696235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2037696235},{"type":"v1","addr":"172.21.15.129:6835","nonce":2037696235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-10T04:52:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.682+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8a406acc0 msgr2=0x7fd8a406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.682+0000 7fd8cca00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8a406acc0 0x7fd8a406d1d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8158750 tx=0x7fd8b0008040 comp rx=0 tx=0).stop 2024-05-10T04:52:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c80b2b90 msgr2=0x7fd8c8153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c80b2b90 0x7fd8c8153f70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80090b0 tx=0x7fd8b8004750 comp rx=0 tx=0).stop 2024-05-10T04:52:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 shutdown_connections 2024-05-10T04:52:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd8a406acc0 0x7fd8a406d1d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd8c815e6e0 0x7fd8c81f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8c80b2b90 0x7fd8c8153f70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 --2- 172.21.15.82:0/2109150064 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8c80b3050 0x7fd8c81544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 >> 172.21.15.82:0/2109150064 conn(0x7fd8c80b5db0 msgr2=0x7fd8c80b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 shutdown_connections 2024-05-10T04:52:09.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.683+0000 7fd8cca00700 1 -- 172.21.15.82:0/2109150064 wait complete. 2024-05-10T04:52:09.685 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-05-10T04:52:09.708 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.970+0000 7f8ce0400700 1 Processor -- start 2024-05-10T04:52:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.970+0000 7f8ce0400700 1 -- start start 2024-05-10T04:52:09.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.971+0000 7f8ce0400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815f4f0 0x7f8cd80b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.971+0000 7f8ce0400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8cd80b5dd0 0x7f8cd80b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.971+0000 7f8ce0400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd815f900 con 0x7f8cd815bfe0 2024-05-10T04:52:09.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.971+0000 7f8ce0400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd815c3f0 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.971+0000 7f8ce0400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80b61e0 con 0x7f8cd815f4f0 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.972+0000 7f8cde400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8cd80b5dd0 0x7f8cd80b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.972+0000 7f8cde400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8cd80b5dd0 0x7f8cd80b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50062/0 (socket says 172.21.15.82:50062) 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.972+0000 7f8cde400700 1 -- 172.21.15.82:0/4108376071 learned_addr learned my addr 172.21.15.82:0/4108376071 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.972+0000 7f8cdd000700 1 --2- 172.21.15.82:0/4108376071 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815f4f0 0x7f8cd80b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.972+0000 7f8cde400700 1 -- 172.21.15.82:0/4108376071 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815f4f0 msgr2=0x7f8cd80b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.972+0000 7f8cde400700 1 --2- 172.21.15.82:0/4108376071 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815f4f0 0x7f8cd80b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.972+0000 7f8cde400700 1 -- 172.21.15.82:0/4108376071 >> v1:172.21.15.129:6789/0 conn(0x7f8cd815bfe0 legacy=0x7f8cd8161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.972+0000 7f8cde400700 1 -- 172.21.15.82:0/4108376071 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8162a70 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.973+0000 7f8cde400700 1 --2- 172.21.15.82:0/4108376071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd80b2890 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e50 tx=0x7f8cd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0d67e6ae0eaef5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.973+0000 7f8cd7e00700 1 -- 172.21.15.82:0/4108376071 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000e070 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.973+0000 7f8cd7e00700 1 -- 172.21.15.82:0/4108376071 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd000b910 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.973+0000 7f8cd7e00700 1 -- 172.21.15.82:0/4108376071 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000bcc0 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.973+0000 7f8ce0400700 1 -- 172.21.15.82:0/4108376071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 msgr2=0x7f8cd80b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.973+0000 7f8ce0400700 1 --2- 172.21.15.82:0/4108376071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd80b2890 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e50 tx=0x7f8cd000b330 comp rx=0 tx=0).stop 2024-05-10T04:52:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.974+0000 7f8ce0400700 1 -- 172.21.15.82:0/4108376071 shutdown_connections 2024-05-10T04:52:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.974+0000 7f8ce0400700 1 --2- 172.21.15.82:0/4108376071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd80b2890 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.974+0000 7f8ce0400700 1 --2- 172.21.15.82:0/4108376071 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815f4f0 0x7f8cd80b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.974+0000 7f8ce0400700 1 -- 172.21.15.82:0/4108376071 >> 172.21.15.82:0/4108376071 conn(0x7f8cd80d0a70 msgr2=0x7f8cd80d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.974+0000 7f8ce0400700 1 -- 172.21.15.82:0/4108376071 shutdown_connections 2024-05-10T04:52:09.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.974+0000 7f8ce0400700 1 -- 172.21.15.82:0/4108376071 wait complete. 2024-05-10T04:52:09.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.976+0000 7f8ce0400700 1 Processor -- start 2024-05-10T04:52:09.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.976+0000 7f8ce0400700 1 -- start start 2024-05-10T04:52:09.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.977+0000 7f8ce0400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd81f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.977+0000 7f8ce0400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815bfe0 0x7f8cd81f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.977+0000 7f8ce0400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd815f4f0 0x7f8cd80cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8ce0400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81f62d0 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8ce0400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80cbda0 con 0x7f8cd815f4f0 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8ce0400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80cbff0 con 0x7f8cd815bfe0 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd81f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd81f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50066/0 (socket says 172.21.15.82:50066) 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 -- 172.21.15.82:0/3825693003 learned_addr learned my addr 172.21.15.82:0/3825693003 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 -- 172.21.15.82:0/3825693003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815bfe0 msgr2=0x7f8cd81f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815bfe0 0x7f8cd81f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 -- 172.21.15.82:0/3825693003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd815f4f0 msgr2=0x7f8cd80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd815f4f0 0x7f8cd80cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 -- 172.21.15.82:0/3825693003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0009b30 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.978+0000 7f8cdda00700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd81f5c90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c450 tx=0x7f8ccc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.979+0000 7f8cd5600700 1 -- 172.21.15.82:0/3825693003 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0052d0 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.979+0000 7f8cd5600700 1 -- 172.21.15.82:0/3825693003 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc005430 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.979+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd80c7a50 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.979+0000 7f8cd5600700 1 -- 172.21.15.82:0/3825693003 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0038c0 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.979+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd80c8010 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.980+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd8074af0 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.981+0000 7f8cd5600700 1 -- 172.21.15.82:0/3825693003 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8ccc003a20 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.982+0000 7f8cd5600700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cb806ac90 0x7f8cb806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.982+0000 7f8cd5600700 1 -- 172.21.15.82:0/3825693003 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8ccc088580 con 0x7f8cd80b5dd0 2024-05-10T04:52:09.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.982+0000 7f8cdd000700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cb806ac90 0x7f8cb806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.983+0000 7f8cdd000700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cb806ac90 0x7f8cb806d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4006b20 tx=0x7f8cc4006ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:09.987+0000 7f8cd5600700 1 -- 172.21.15.82:0/3825693003 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8ccc053790 con 0x7f8cd80b5dd0 2024-05-10T04:52:10.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.191+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cd815f900 con 0x7f8cd80b5dd0 2024-05-10T04:52:10.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.193+0000 7f8cd5600700 1 -- 172.21.15.82:0/3825693003 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16230 (secure 0 0 0) 0x7f8cd815f900 con 0x7f8cd80b5dd0 2024-05-10T04:52:10.193 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:10.193 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:51:56.207427+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:30.829302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:32.104657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6836/3440576054":"2024-05-11T04:51:56.207394+0000","172.21.15.82:6834/3440576054":"2024-05-11T04:51:56.207394+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.195+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cb806ac90 msgr2=0x7f8cb806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.195+0000 7f8ce0400700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cb806ac90 0x7f8cb806d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4006b20 tx=0x7f8cc4006ab0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.195+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 msgr2=0x7f8cd81f5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.195+0000 7f8ce0400700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd81f5c90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c450 tx=0x7f8ccc00c810 comp rx=0 tx=0).stop 2024-05-10T04:52:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.196+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 shutdown_connections 2024-05-10T04:52:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.196+0000 7f8ce0400700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f8cb806ac90 0x7f8cb806d1a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.196+0000 7f8ce0400700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8cd815f4f0 0x7f8cd80cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.196+0000 7f8ce0400700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd80b5dd0 0x7f8cd81f5c90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.196+0000 7f8ce0400700 1 --2- 172.21.15.82:0/3825693003 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f8cd815bfe0 0x7f8cd81f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.196+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 >> 172.21.15.82:0/3825693003 conn(0x7f8cd80d0a70 msgr2=0x7f8cd80d3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.196+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 shutdown_connections 2024-05-10T04:52:10.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.196+0000 7f8ce0400700 1 -- 172.21.15.82:0/3825693003 wait complete. 2024-05-10T04:52:10.224 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T04:52:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.484+0000 7f2c4cc00700 1 Processor -- start 2024-05-10T04:52:10.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.485+0000 7f2c4cc00700 1 -- start start 2024-05-10T04:52:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.486+0000 7f2c4cc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c480d0a20 0x7f2c480d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.486+0000 7f2c4cc00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f2c480d2560 0x7f2c480d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.486+0000 7f2c4cc00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c48161d70 con 0x7f2c480b62f0 2024-05-10T04:52:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.486+0000 7f2c4cc00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c481628f0 con 0x7f2c480d2560 2024-05-10T04:52:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.486+0000 7f2c4cc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480b7180 con 0x7f2c480d0a20 2024-05-10T04:52:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.486+0000 7f2c47400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2c480b62f0 0x7f2c480b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40016/0 (socket says 172.21.15.82:40016) 2024-05-10T04:52:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.486+0000 7f2c47400700 1 -- 172.21.15.82:0/189549273 learned_addr learned my addr 172.21.15.82:0/189549273 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c47e00700 1 --2- 172.21.15.82:0/189549273 >> v2:172.21.15.129:3300/0 conn(0x7f2c480d2560 0x7f2c480d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c3fe00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c480d0a20 0x7f2c480d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727819728 0 0) 0x7f2c48161d70 con 0x7f2c480b62f0 2024-05-10T04:52:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c2c0035b0 con 0x7f2c480b62f0 2024-05-10T04:52:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2403283687 0 0) 0x7f2c2c0035b0 con 0x7f2c480b62f0 2024-05-10T04:52:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c480d0a20 msgr2=0x7f2c480d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c480d0a20 0x7f2c480d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 >> v2:172.21.15.129:3300/0 conn(0x7f2c480d2560 msgr2=0x7f2c480d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 --2- 172.21.15.82:0/189549273 >> v2:172.21.15.129:3300/0 conn(0x7f2c480d2560 0x7f2c480d2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480d1370 con 0x7f2c480b62f0 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f2c38001670 con 0x7f2c480b62f0 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c47e00700 1 --2- 172.21.15.82:0/189549273 >> v2:172.21.15.129:3300/0 conn(0x7f2c480d2560 0x7f2c480d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 >> v1:172.21.15.82:6789/0 conn(0x7f2c480b62f0 legacy=0x7f2c480b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c2c003a00 0x7f2c2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c004850 0x7f2c2c004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.487+0000 7f2c46a00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c0051a0 0x7f2c2c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c481628f0 con 0x7f2c2c0051a0 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480b7180 con 0x7f2c2c003a00 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c00bfd0 con 0x7f2c2c004850 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c3fe00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c480d0a20 0x7f2c480d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c47e00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c0051a0 0x7f2c2c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c47400700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c2c003a00 0x7f2c2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c3fe00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c004850 0x7f2c2c004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c47e00700 1 -- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c004850 msgr2=0x7f2c2c004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c47e00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c004850 0x7f2c2c004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c47e00700 1 -- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c2c003a00 msgr2=0x7f2c2c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c47e00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c2c003a00 0x7f2c2c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c47e00700 1 -- 172.21.15.82:0/189549273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2c0035b0 con 0x7f2c2c0051a0 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.488+0000 7f2c47e00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c0051a0 0x7f2c2c00ba10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2c480ce230 tx=0x7f2c2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abf06aedba5d573 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.489+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000ed90 con 0x7f2c2c0051a0 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.489+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000f040 con 0x7f2c2c0051a0 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.489+0000 7f2c46a00700 1 -- 172.21.15.82:0/189549273 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40003c40 con 0x7f2c2c0051a0 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.489+0000 7f2c4cc00700 1 -- 172.21.15.82:0/189549273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c0051a0 msgr2=0x7f2c2c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.489+0000 7f2c4cc00700 1 --2- 172.21.15.82:0/189549273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c2c0051a0 0x7f2c2c00ba10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2c480ce230 tx=0x7f2c2c005880 comp rx=0 tx=0).stop 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.489+0000 7f2c47e00700 1 -- 172.21.15.82:0/189549273 reap_dead start 2024-05-10T04:52:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.489+0000 7f2c4cc00700 1 -- 172.21.15.82:0/189549273 shutdown_connections 2024-05-10T04:52:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.490+0000 7f2c4cc00700 1 -- 172.21.15.82:0/189549273 >> 172.21.15.82:0/189549273 conn(0x7f2c4806c5f0 msgr2=0x7f2c4806ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.490+0000 7f2c4cc00700 1 -- 172.21.15.82:0/189549273 shutdown_connections 2024-05-10T04:52:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.490+0000 7f2c4cc00700 1 -- 172.21.15.82:0/189549273 wait complete. 2024-05-10T04:52:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.492+0000 7f2c4cc00700 1 Processor -- start 2024-05-10T04:52:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.492+0000 7f2c4cc00700 1 -- start start 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.493+0000 7f2c4cc00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c0051a0 0x7f2c481511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.493+0000 7f2c4cc00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c4815b260 0x7f2c4815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.493+0000 7f2c4cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c48153f50 0x7f2c4815d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.493+0000 7f2c4cc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48152c10 con 0x7f2c48153f50 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.493+0000 7f2c4cc00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815d990 con 0x7f2c4815b260 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.493+0000 7f2c4cc00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815dc70 con 0x7f2c2c0051a0 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c48153f50 0x7f2c4815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c48153f50 0x7f2c4815d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50086/0 (socket says 172.21.15.82:50086) 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47e00700 1 -- 172.21.15.82:0/2859532750 learned_addr learned my addr 172.21.15.82:0/2859532750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47400700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c0051a0 0x7f2c481511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c3fe00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c4815b260 0x7f2c4815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47e00700 1 -- 172.21.15.82:0/2859532750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c0051a0 msgr2=0x7f2c481511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47e00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c0051a0 0x7f2c481511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47e00700 1 -- 172.21.15.82:0/2859532750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c4815b260 msgr2=0x7f2c4815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47e00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c4815b260 0x7f2c4815cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.494+0000 7f2c47e00700 1 -- 172.21.15.82:0/2859532750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c48160c50 con 0x7f2c48153f50 2024-05-10T04:52:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.495+0000 7f2c47e00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c48153f50 0x7f2c4815d150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b010 tx=0x7f2c40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.495+0000 7f2c3f400700 1 -- 172.21.15.82:0/2859532750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40004440 con 0x7f2c48153f50 2024-05-10T04:52:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.495+0000 7f2c3f400700 1 -- 172.21.15.82:0/2859532750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400045e0 con 0x7f2c48153f50 2024-05-10T04:52:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.495+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c48160f30 con 0x7f2c48153f50 2024-05-10T04:52:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.495+0000 7f2c3f400700 1 -- 172.21.15.82:0/2859532750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40009430 con 0x7f2c48153f50 2024-05-10T04:52:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.495+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c48152950 con 0x7f2c48153f50 2024-05-10T04:52:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.496+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c48074af0 con 0x7f2c48153f50 2024-05-10T04:52:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.497+0000 7f2c3f400700 1 -- 172.21.15.82:0/2859532750 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c40024070 con 0x7f2c48153f50 2024-05-10T04:52:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.498+0000 7f2c3f400700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c2406acc0 0x7f2c2406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.498+0000 7f2c3f400700 1 -- 172.21.15.82:0/2859532750 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2c4008b0b0 con 0x7f2c48153f50 2024-05-10T04:52:10.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.498+0000 7f2c47400700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c2406acc0 0x7f2c2406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.499+0000 7f2c47400700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c2406acc0 0x7f2c2406d1d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000c00 tx=0x7f2c38007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.503+0000 7f2c3f400700 1 -- 172.21.15.82:0/2859532750 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2c40056220 con 0x7f2c48153f50 2024-05-10T04:52:10.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.752+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2c48152c10 con 0x7f2c48153f50 2024-05-10T04:52:10.753 INFO:tasks.ceph.mon.a.smithi082.stderr:2024-05-10T04:52:10.753+0000 7fcf99200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T04:52:10.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.763+0000 7f2c3f400700 1 -- 172.21.15.82:0/2859532750 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2c40059840 con 0x7f2c48153f50 2024-05-10T04:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c2406acc0 msgr2=0x7f2c2406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c2406acc0 0x7f2c2406d1d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000c00 tx=0x7f2c38007040 comp rx=0 tx=0).stop 2024-05-10T04:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c48153f50 msgr2=0x7f2c4815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c48153f50 0x7f2c4815d150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b010 tx=0x7f2c40009750 comp rx=0 tx=0).stop 2024-05-10T04:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 shutdown_connections 2024-05-10T04:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c2406acc0 0x7f2c2406d1d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c48153f50 0x7f2c4815d150 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2c2c0051a0 0x7f2c481511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 --2- 172.21.15.82:0/2859532750 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2c4815b260 0x7f2c4815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.765+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 >> 172.21.15.82:0/2859532750 conn(0x7f2c4806c5f0 msgr2=0x7f2c480b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:10.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.766+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 shutdown_connections 2024-05-10T04:52:10.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:10.766+0000 7f2c4cc00700 1 -- 172.21.15.82:0/2859532750 wait complete. 2024-05-10T04:52:10.767 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T04:52:10.774 INFO:tasks.ceph.mds.b.smithi129.stderr: -360> 2024-05-10T04:52:04.146+0000 7fbcf2200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:52:10.791 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T04:52:10.894 INFO:tasks.ceph.mds.b.smithi129.stdout:starting mds.b at 2024-05-10T04:52:11.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.058+0000 7f1e86c00700 1 Processor -- start 2024-05-10T04:52:11.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.058+0000 7f1e86c00700 1 -- start start 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.059+0000 7f1e86c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1e800d3510 0x7f1e800b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e86c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e800ceb90 0x7f1e800cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e86c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 0x7f1e800d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e86c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e800cf4e0 con 0x7f1e800ceb90 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e86c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e800d27e0 con 0x7f1e800d3510 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e86c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800d3080 con 0x7f1e800d05d0 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7f400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e800ceb90 0x7f1e800cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7f400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e800ceb90 0x7f1e800cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50102/0 (socket says 172.21.15.82:50102) 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7f400700 1 -- 172.21.15.82:0/836723962 learned_addr learned my addr 172.21.15.82:0/836723962 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7fe00700 1 --2- 172.21.15.82:0/836723962 >> v2:172.21.15.129:3300/0 conn(0x7f1e800d3510 0x7f1e800b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e84c00700 1 --2- 172.21.15.82:0/836723962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 0x7f1e800d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7f400700 1 -- 172.21.15.82:0/836723962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 msgr2=0x7f1e800d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7f400700 1 --2- 172.21.15.82:0/836723962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 0x7f1e800d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7f400700 1 -- 172.21.15.82:0/836723962 >> v2:172.21.15.129:3300/0 conn(0x7f1e800d3510 msgr2=0x7f1e800b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7f400700 1 --2- 172.21.15.82:0/836723962 >> v2:172.21.15.129:3300/0 conn(0x7f1e800d3510 0x7f1e800b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.060+0000 7f1e7f400700 1 -- 172.21.15.82:0/836723962 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800cf6e0 con 0x7f1e800ceb90 2024-05-10T04:52:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.061+0000 7f1e7f400700 1 --2- 172.21.15.82:0/836723962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cefa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1e800d4e50 tx=0x7f1e6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198520f7005a483a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.061+0000 7f1e7ea00700 1 -- 172.21.15.82:0/836723962 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00b870 con 0x7f1e800ceb90 2024-05-10T04:52:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.061+0000 7f1e7ea00700 1 -- 172.21.15.82:0/836723962 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00b9d0 con 0x7f1e800ceb90 2024-05-10T04:52:11.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.061+0000 7f1e7ea00700 1 -- 172.21.15.82:0/836723962 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00bd60 con 0x7f1e800ceb90 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 -- 172.21.15.82:0/836723962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 msgr2=0x7f1e800cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 --2- 172.21.15.82:0/836723962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cefa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1e800d4e50 tx=0x7f1e6c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 -- 172.21.15.82:0/836723962 shutdown_connections 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 --2- 172.21.15.82:0/836723962 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 0x7f1e800d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 --2- 172.21.15.82:0/836723962 >> v2:172.21.15.129:3300/0 conn(0x7f1e800d3510 0x7f1e800b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 --2- 172.21.15.82:0/836723962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cefa0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 -- 172.21.15.82:0/836723962 >> 172.21.15.82:0/836723962 conn(0x7f1e8006c4b0 msgr2=0x7f1e8006c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 -- 172.21.15.82:0/836723962 shutdown_connections 2024-05-10T04:52:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.062+0000 7f1e86c00700 1 -- 172.21.15.82:0/836723962 wait complete. 2024-05-10T04:52:11.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.065+0000 7f1e86c00700 1 Processor -- start 2024-05-10T04:52:11.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.066+0000 7f1e86c00700 1 -- start start 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e86c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e86c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 0x7f1e8014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e86c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e800d3510 0x7f1e8014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e86c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800abfa0 con 0x7f1e800ceb90 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e86c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800ac3c0 con 0x7f1e800d3510 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e86c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80150010 con 0x7f1e800d05d0 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e7fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e7fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50106/0 (socket says 172.21.15.82:50106) 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e7fe00700 1 -- 172.21.15.82:0/2972340915 learned_addr learned my addr 172.21.15.82:0/2972340915 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e7f400700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 0x7f1e8014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.067+0000 7f1e84c00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e800d3510 0x7f1e8014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e7fe00700 1 -- 172.21.15.82:0/2972340915 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 msgr2=0x7f1e8014d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e7fe00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 0x7f1e8014d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e7fe00700 1 -- 172.21.15.82:0/2972340915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e800d3510 msgr2=0x7f1e8014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e7fe00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e800d3510 0x7f1e8014dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e7fe00700 1 -- 172.21.15.82:0/2972340915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009550 con 0x7f1e800ceb90 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e7fe00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cd750 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000d7d0 tx=0x7f1e7000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e77e00700 1 -- 172.21.15.82:0/2972340915 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700125f0 con 0x7f1e800ceb90 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e77e00700 1 -- 172.21.15.82:0/2972340915 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70012750 con 0x7f1e800ceb90 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e800ab320 con 0x7f1e800ceb90 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e77e00700 1 -- 172.21.15.82:0/2972340915 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70012ae0 con 0x7f1e800ceb90 2024-05-10T04:52:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.068+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e800ab8e0 con 0x7f1e800ceb90 2024-05-10T04:52:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.069+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e80074af0 con 0x7f1e800ceb90 2024-05-10T04:52:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.070+0000 7f1e77e00700 1 -- 172.21.15.82:0/2972340915 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e70012c40 con 0x7f1e800ceb90 2024-05-10T04:52:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.071+0000 7f1e77e00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1e6006acc0 0x7f1e6006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.071+0000 7f1e77e00700 1 -- 172.21.15.82:0/2972340915 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f1e70089470 con 0x7f1e800ceb90 2024-05-10T04:52:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.072+0000 7f1e7f400700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1e6006acc0 0x7f1e6006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.072+0000 7f1e7f400700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1e6006acc0 0x7f1e6006d1d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c014040 tx=0x7f1e6c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.076+0000 7f1e77e00700 1 -- 172.21.15.82:0/2972340915 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e70054580 con 0x7f1e800ceb90 2024-05-10T04:52:11.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.324+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e800ac0e0 con 0x7f1e800ceb90 2024-05-10T04:52:11.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.769+0000 7f1e77e00700 1 -- 172.21.15.82:0/2972340915 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1e800ac0e0 con 0x7f1e800ceb90 2024-05-10T04:52:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.771+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1e6006acc0 msgr2=0x7f1e6006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.771+0000 7f1e86c00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1e6006acc0 0x7f1e6006d1d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c014040 tx=0x7f1e6c008030 comp rx=0 tx=0).stop 2024-05-10T04:52:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.771+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 msgr2=0x7f1e800cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.771+0000 7f1e86c00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cd750 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000d7d0 tx=0x7f1e7000dae0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.772+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 shutdown_connections 2024-05-10T04:52:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.772+0000 7f1e86c00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1e6006acc0 0x7f1e6006d1d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.772+0000 7f1e86c00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1e800d3510 0x7f1e8014dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.772+0000 7f1e86c00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e800ceb90 0x7f1e800cd750 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.772+0000 7f1e86c00700 1 --2- 172.21.15.82:0/2972340915 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1e800d05d0 0x7f1e8014d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.772+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 >> 172.21.15.82:0/2972340915 conn(0x7f1e8006c4b0 msgr2=0x7f1e80160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.772+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 shutdown_connections 2024-05-10T04:52:11.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:11.772+0000 7f1e86c00700 1 -- 172.21.15.82:0/2972340915 wait complete. 2024-05-10T04:52:11.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T04:52:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.069+0000 7f0eb2200700 1 Processor -- start 2024-05-10T04:52:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.069+0000 7f0eb2200700 1 -- start start 2024-05-10T04:52:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.071+0000 7f0eb2200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0eac0d0a10 0x7f0eac0d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.071+0000 7f0eb2200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0b7130 con 0x7f0eac15e240 2024-05-10T04:52:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.071+0000 7f0eb2200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0d1360 con 0x7f0eac0b75f0 2024-05-10T04:52:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.071+0000 7f0eb2200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac0cebe0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.071+0000 7f0eabe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0eac0d0a10 0x7f0eac0d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.072+0000 7f0eabe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0eac0d0a10 0x7f0eac0d0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50112/0 (socket says 172.21.15.82:50112) 2024-05-10T04:52:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.072+0000 7f0eabe00700 1 -- 172.21.15.82:0/2071144117 learned_addr learned my addr 172.21.15.82:0/2071144117 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.072+0000 7f0eabe00700 1 -- 172.21.15.82:0/2071144117 >> v1:172.21.15.129:6789/0 conn(0x7f0eac0b75f0 legacy=0x7f0eac0b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.072+0000 7f0eabe00700 1 -- 172.21.15.82:0/2071144117 >> v1:172.21.15.82:6789/0 conn(0x7f0eac15e240 legacy=0x7f0eac0d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.072+0000 7f0eabe00700 1 -- 172.21.15.82:0/2071144117 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0d2ba0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.072+0000 7f0eab400700 1 -- 172.21.15.82:0/2071144117 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153636486 0 0) 0x7f0eac0b7130 con 0x7f0eac15e240 2024-05-10T04:52:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.072+0000 7f0eabe00700 1 --2- 172.21.15.82:0/2071144117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac0d0e20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0e980098f0 tx=0x7f0e98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d6b0226a31e2c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eab400700 1 -- 172.21.15.82:0/2071144117 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98004230 con 0x7f0eac0d0a10 2024-05-10T04:52:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eab400700 1 -- 172.21.15.82:0/2071144117 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98004390 con 0x7f0eac0d0a10 2024-05-10T04:52:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eab400700 1 -- 172.21.15.82:0/2071144117 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980036a0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eb2200700 1 -- 172.21.15.82:0/2071144117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 msgr2=0x7f0eac0d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eb2200700 1 --2- 172.21.15.82:0/2071144117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac0d0e20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0e980098f0 tx=0x7f0e98009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eb2200700 1 -- 172.21.15.82:0/2071144117 shutdown_connections 2024-05-10T04:52:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eb2200700 1 --2- 172.21.15.82:0/2071144117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac0d0e20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eb2200700 1 -- 172.21.15.82:0/2071144117 >> 172.21.15.82:0/2071144117 conn(0x7f0eac06c5a0 msgr2=0x7f0eac06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eb2200700 1 -- 172.21.15.82:0/2071144117 shutdown_connections 2024-05-10T04:52:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.073+0000 7f0eb2200700 1 -- 172.21.15.82:0/2071144117 wait complete. 2024-05-10T04:52:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.076+0000 7f0eb2200700 1 Processor -- start 2024-05-10T04:52:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.076+0000 7f0eb2200700 1 -- start start 2024-05-10T04:52:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.077+0000 7f0eb2200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0eac0b75f0 0x7f0eac0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.077+0000 7f0eb2200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.077+0000 7f0eb2200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0eac15e240 0x7f0eac156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.077+0000 7f0eb2200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac152620 con 0x7f0eac0d0a10 2024-05-10T04:52:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.077+0000 7f0eb2200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1576e0 con 0x7f0eac0b75f0 2024-05-10T04:52:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.077+0000 7f0eb2200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0b39f0 con 0x7f0eac15e240 2024-05-10T04:52:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50122/0 (socket says 172.21.15.82:50122) 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 -- 172.21.15.82:0/3278078076 learned_addr learned my addr 172.21.15.82:0/3278078076 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eb0e00700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0eac0b75f0 0x7f0eac0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eb1800700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0eac15e240 0x7f0eac156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 -- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0eac15e240 msgr2=0x7f0eac156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0eac15e240 0x7f0eac156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 -- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0eac0b75f0 msgr2=0x7f0eac0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0eac0b75f0 0x7f0eac0b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 -- 172.21.15.82:0/3278078076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98009550 con 0x7f0eac0d0a10 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eb1800700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0eac15e240 0x7f0eac156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.078+0000 7f0eabe00700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac151c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009130 tx=0x7f0e98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.079+0000 7f0ea8c00700 1 -- 172.21.15.82:0/3278078076 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800b660 con 0x7f0eac0d0a10 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.079+0000 7f0ea8c00700 1 -- 172.21.15.82:0/3278078076 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9800b7e0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.079+0000 7f0ea8c00700 1 -- 172.21.15.82:0/3278078076 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800bb90 con 0x7f0eac0d0a10 2024-05-10T04:52:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.079+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac0b3c40 con 0x7f0eac0d0a10 2024-05-10T04:52:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.079+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0b4200 con 0x7f0eac0d0a10 2024-05-10T04:52:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.080+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac074af0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.081+0000 7f0ea8c00700 1 -- 172.21.15.82:0/3278078076 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e9800bcf0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.081+0000 7f0ea8c00700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0e8c06ac90 0x7f0e8c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.082+0000 7f0ea8c00700 1 -- 172.21.15.82:0/3278078076 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0e9808ade0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.082+0000 7f0eb0e00700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0e8c06ac90 0x7f0e8c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.082+0000 7f0eb0e00700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0e8c06ac90 0x7f0e8c06d1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0000f60 tx=0x7f0ea0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.086+0000 7f0ea8c00700 1 -- 172.21.15.82:0/3278078076 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0e98055fa0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.289+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0eac15f6f0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.771+0000 7f0ea8c00700 1 -- 172.21.15.82:0/3278078076 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0e980595c0 con 0x7f0eac0d0a10 2024-05-10T04:52:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.774+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0e8c06ac90 msgr2=0x7f0e8c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.774+0000 7f0eb2200700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0e8c06ac90 0x7f0e8c06d1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0000f60 tx=0x7f0ea0009040 comp rx=0 tx=0).stop 2024-05-10T04:52:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.774+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 msgr2=0x7f0eac151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.774+0000 7f0eb2200700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac151c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009130 tx=0x7f0e98004750 comp rx=0 tx=0).stop 2024-05-10T04:52:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.775+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 shutdown_connections 2024-05-10T04:52:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.775+0000 7f0eb2200700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f0e8c06ac90 0x7f0e8c06d1a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.775+0000 7f0eb2200700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f0eac15e240 0x7f0eac156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.775+0000 7f0eb2200700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0eac0b75f0 0x7f0eac0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.775+0000 7f0eb2200700 1 --2- 172.21.15.82:0/3278078076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eac0d0a10 0x7f0eac151c50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.775+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 >> 172.21.15.82:0/3278078076 conn(0x7f0eac06c5a0 msgr2=0x7f0eac15ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:12.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.775+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 shutdown_connections 2024-05-10T04:52:12.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:12.775+0000 7f0eb2200700 1 -- 172.21.15.82:0/3278078076 wait complete. 2024-05-10T04:52:12.777 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-05-10T04:52:12.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T04:52:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.068+0000 7f2ca7a00700 1 Processor -- start 2024-05-10T04:52:13.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.068+0000 7f2ca7a00700 1 -- start start 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2ca7a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 0x7f2ca0161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2ca7a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ca00b5c10 0x7f2ca00b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2ca7a00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca00b6560 con 0x7f2ca00cea50 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2ca7a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca00cada0 con 0x7f2ca00b5c10 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2ca7a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01624a0 con 0x7f2ca015e5e0 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2ca5a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ca00b5c10 0x7f2ca00b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2ca5a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ca00b5c10 0x7f2ca00b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50132/0 (socket says 172.21.15.82:50132) 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2ca5a00700 1 -- 172.21.15.82:0/1251913366 learned_addr learned my addr 172.21.15.82:0/1251913366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:13.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.070+0000 7f2c9fe00700 1 --1- 172.21.15.82:0/1251913366 >> v1:172.21.15.82:6789/0 conn(0x7f2ca00cea50 0x7f2ca00b7340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40026/0 (socket says 172.21.15.82:40026) 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2ca5000700 1 --2- 172.21.15.82:0/1251913366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 0x7f2ca0161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2ca5a00700 1 -- 172.21.15.82:0/1251913366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 msgr2=0x7f2ca0161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2ca5a00700 1 --2- 172.21.15.82:0/1251913366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 0x7f2ca0161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2ca5a00700 1 -- 172.21.15.82:0/1251913366 >> v1:172.21.15.82:6789/0 conn(0x7f2ca00cea50 legacy=0x7f2ca00b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2ca5a00700 1 -- 172.21.15.82:0/1251913366 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca01626b0 con 0x7f2ca00b5c10 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2c9f400700 1 -- 172.21.15.82:0/1251913366 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469517775 0 0) 0x7f2ca00b6560 con 0x7f2ca00cea50 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2ca5a00700 1 --2- 172.21.15.82:0/1251913366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca00b6020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009e50 tx=0x7f2c9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d7c0feb8209ec5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2c9f400700 1 -- 172.21.15.82:0/1251913366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800e070 con 0x7f2ca00b5c10 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2c9f400700 1 -- 172.21.15.82:0/1251913366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9800b9c0 con 0x7f2ca00b5c10 2024-05-10T04:52:13.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.071+0000 7f2c9f400700 1 -- 172.21.15.82:0/1251913366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800bd70 con 0x7f2ca00b5c10 2024-05-10T04:52:13.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.072+0000 7f2ca7a00700 1 -- 172.21.15.82:0/1251913366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 msgr2=0x7f2ca00b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.072+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/1251913366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca00b6020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009e50 tx=0x7f2c9800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:13.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.072+0000 7f2ca7a00700 1 -- 172.21.15.82:0/1251913366 shutdown_connections 2024-05-10T04:52:13.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.072+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/1251913366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca00b6020 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.072+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/1251913366 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 0x7f2ca0161f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.072+0000 7f2ca7a00700 1 -- 172.21.15.82:0/1251913366 >> 172.21.15.82:0/1251913366 conn(0x7f2ca00d0cd0 msgr2=0x7f2ca00d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:13.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.072+0000 7f2ca7a00700 1 -- 172.21.15.82:0/1251913366 shutdown_connections 2024-05-10T04:52:13.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.072+0000 7f2ca7a00700 1 -- 172.21.15.82:0/1251913366 wait complete. 2024-05-10T04:52:13.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.074+0000 7f2ca7a00700 1 Processor -- start 2024-05-10T04:52:13.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.075+0000 7f2ca7a00700 1 -- start start 2024-05-10T04:52:13.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca7a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca7a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ca00cea50 0x7f2ca00cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca7a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 0x7f2ca00cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca7a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca01f5260 con 0x7f2ca00b5c10 2024-05-10T04:52:13.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca7a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca00cc420 con 0x7f2ca00cea50 2024-05-10T04:52:13.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca7a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0160030 con 0x7f2ca015e5e0 2024-05-10T04:52:13.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca5000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca5000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca014e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50144/0 (socket says 172.21.15.82:50144) 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.076+0000 7f2ca5000700 1 -- 172.21.15.82:0/3695057729 learned_addr learned my addr 172.21.15.82:0/3695057729 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2c9fe00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ca00cea50 0x7f2ca00cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2ca5a00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 0x7f2ca00cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2ca5000700 1 -- 172.21.15.82:0/3695057729 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 msgr2=0x7f2ca00cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2ca5000700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 0x7f2ca00cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2ca5000700 1 -- 172.21.15.82:0/3695057729 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ca00cea50 msgr2=0x7f2ca00cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2ca5000700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ca00cea50 0x7f2ca00cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2ca5000700 1 -- 172.21.15.82:0/3695057729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98009b30 con 0x7f2ca00b5c10 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2ca5000700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca014e1a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400d7d0 tx=0x7f2c9400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2c9cc00700 1 -- 172.21.15.82:0/3695057729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940125f0 con 0x7f2ca00b5c10 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2c9cc00700 1 -- 172.21.15.82:0/3695057729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94012750 con 0x7f2ca00b5c10 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.077+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca00cc670 con 0x7f2ca00b5c10 2024-05-10T04:52:13.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.078+0000 7f2c9cc00700 1 -- 172.21.15.82:0/3695057729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94012ae0 con 0x7f2ca00b5c10 2024-05-10T04:52:13.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.078+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca00cd0a0 con 0x7f2ca00b5c10 2024-05-10T04:52:13.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.079+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca0074af0 con 0x7f2ca00b5c10 2024-05-10T04:52:13.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.079+0000 7f2c9cc00700 1 -- 172.21.15.82:0/3695057729 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2c94012c40 con 0x7f2ca00b5c10 2024-05-10T04:52:13.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.081+0000 7f2c9cc00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c8006ac90 0x7f2c8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.081+0000 7f2c9cc00700 1 -- 172.21.15.82:0/3695057729 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f2c94089320 con 0x7f2ca00b5c10 2024-05-10T04:52:13.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.081+0000 7f2c9fe00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c8006ac90 0x7f2c8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.082+0000 7f2c9fe00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c8006ac90 0x7f2c8006d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0159480 tx=0x7f2c8c007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.086+0000 7f2c9cc00700 1 -- 172.21.15.82:0/3695057729 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2c94054550 con 0x7f2ca00b5c10 2024-05-10T04:52:13.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.291+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ca00d2280 con 0x7f2ca00b5c10 2024-05-10T04:52:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.779+0000 7f2c9cc00700 1 -- 172.21.15.82:0/3695057729 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2c94057b70 con 0x7f2ca00b5c10 2024-05-10T04:52:13.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c8006ac90 msgr2=0x7f2c8006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c8006ac90 0x7f2c8006d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0159480 tx=0x7f2c8c007e90 comp rx=0 tx=0).stop 2024-05-10T04:52:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 msgr2=0x7f2ca014e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca014e1a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400d7d0 tx=0x7f2c9400dae0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 shutdown_connections 2024-05-10T04:52:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f2c8006ac90 0x7f2c8006d1a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f2ca015e5e0 0x7f2ca00cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ca00b5c10 0x7f2ca014e1a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 --2- 172.21.15.82:0/3695057729 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2ca00cea50 0x7f2ca00cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 >> 172.21.15.82:0/3695057729 conn(0x7f2ca00d0cd0 msgr2=0x7f2ca00d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 shutdown_connections 2024-05-10T04:52:13.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:13.783+0000 7f2ca7a00700 1 -- 172.21.15.82:0/3695057729 wait complete. 2024-05-10T04:52:13.786 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-05-10T04:52:13.812 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-10T04:52:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.081+0000 7f712e200700 1 Processor -- start 2024-05-10T04:52:14.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.081+0000 7f712e200700 1 -- start start 2024-05-10T04:52:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.083+0000 7f712e200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71280b3280 0x7f71280d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.083+0000 7f712e200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f71280b5d00 0x7f71280b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.083+0000 7f712e200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280d38d0 con 0x7f712806c2f0 2024-05-10T04:52:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.083+0000 7f712e200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280b6650 con 0x7f71280b5d00 2024-05-10T04:52:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.083+0000 7f712e200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712806cf70 con 0x7f71280b3280 2024-05-10T04:52:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.083+0000 7f7127e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f712806c2f0 0x7f712806c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40040/0 (socket says 172.21.15.82:40040) 2024-05-10T04:52:14.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.083+0000 7f7127e00700 1 -- 172.21.15.82:0/2213375422 learned_addr learned my addr 172.21.15.82:0/2213375422 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126a00700 1 --2- 172.21.15.82:0/2213375422 >> v2:172.21.15.129:3300/0 conn(0x7f71280b5d00 0x7f71280b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7127400700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71280b3280 0x7f71280d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026452332 0 0) 0x7f71280d38d0 con 0x7f712806c2f0 2024-05-10T04:52:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f710c0035b0 con 0x7f712806c2f0 2024-05-10T04:52:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1082760481 0 0) 0x7f710c0035b0 con 0x7f712806c2f0 2024-05-10T04:52:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71280b3280 msgr2=0x7f71280d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:14.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71280b3280 0x7f71280d3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 >> v2:172.21.15.129:3300/0 conn(0x7f71280b5d00 msgr2=0x7f71280b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 --2- 172.21.15.82:0/2213375422 >> v2:172.21.15.129:3300/0 conn(0x7f71280b5d00 0x7f71280b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712806d250 con 0x7f712806c2f0 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f7120001a10 con 0x7f712806c2f0 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 >> v1:172.21.15.82:6789/0 conn(0x7f712806c2f0 legacy=0x7f712806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71280b3280 0x7f710c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c003f80 0x7f710c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.084+0000 7f7126000700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f710c004d90 0x7f710c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280b6650 con 0x7f710c003f80 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712806cf70 con 0x7f710c004d90 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c00bb10 con 0x7f71280b3280 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126a00700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c003f80 0x7f710c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7127e00700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f710c004d90 0x7f710c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7127400700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71280b3280 0x7f710c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126a00700 1 -- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71280b3280 msgr2=0x7f710c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126a00700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71280b3280 0x7f710c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126a00700 1 -- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f710c004d90 msgr2=0x7f710c0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126a00700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f710c004d90 0x7f710c0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126a00700 1 -- 172.21.15.82:0/2213375422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0035b0 con 0x7f710c003f80 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.085+0000 7f7126a00700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c003f80 0x7f710c004850 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7114009b40 tx=0x7f710c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c7cf71a2eac843 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.086+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114005a20 con 0x7f710c003f80 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.086+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7114005b80 con 0x7f710c003f80 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.086+0000 7f7126000700 1 -- 172.21.15.82:0/2213375422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400e6c0 con 0x7f710c003f80 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.086+0000 7f712e200700 1 -- 172.21.15.82:0/2213375422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c003f80 msgr2=0x7f710c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.086+0000 7f712e200700 1 --2- 172.21.15.82:0/2213375422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c003f80 0x7f710c004850 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7114009b40 tx=0x7f710c005880 comp rx=0 tx=0).stop 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.086+0000 7f7127e00700 1 -- 172.21.15.82:0/2213375422 reap_dead start 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.086+0000 7f712e200700 1 -- 172.21.15.82:0/2213375422 shutdown_connections 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.086+0000 7f712e200700 1 -- 172.21.15.82:0/2213375422 >> 172.21.15.82:0/2213375422 conn(0x7f71280d40a0 msgr2=0x7f71280d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:14.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.087+0000 7f712e200700 1 -- 172.21.15.82:0/2213375422 shutdown_connections 2024-05-10T04:52:14.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.087+0000 7f712e200700 1 -- 172.21.15.82:0/2213375422 wait complete. 2024-05-10T04:52:14.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.089+0000 7f712e200700 1 Processor -- start 2024-05-10T04:52:14.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.089+0000 7f712e200700 1 -- start start 2024-05-10T04:52:14.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.090+0000 7f712e200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f710c003f80 0x7f7128150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.090+0000 7f712e200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71281509b0 0x7f71280b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.090+0000 7f712e200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7128150dc0 0x7f71280b9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.090+0000 7f712e200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7128152d70 con 0x7f7128150dc0 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.090+0000 7f712e200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7128154ed0 con 0x7f710c003f80 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.090+0000 7f712e200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7128151340 con 0x7f71281509b0 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7128150dc0 0x7f71280b9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7128150dc0 0x7f71280b9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50160/0 (socket says 172.21.15.82:50160) 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 -- 172.21.15.82:0/789558865 learned_addr learned my addr 172.21.15.82:0/789558865 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7126a00700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71281509b0 0x7f71280b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 -- 172.21.15.82:0/789558865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71281509b0 msgr2=0x7f71280b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71281509b0 0x7f71280b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 -- 172.21.15.82:0/789558865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f710c003f80 msgr2=0x7f7128150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f710c003f80 0x7f7128150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 -- 172.21.15.82:0/789558865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71281521a0 con 0x7f7128150dc0 2024-05-10T04:52:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f7127e00700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7128150dc0 0x7f71280b9200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f71280caeb0 tx=0x7f712000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.091+0000 7f711f400700 1 -- 172.21.15.82:0/789558865 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712000ae70 con 0x7f7128150dc0 2024-05-10T04:52:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.092+0000 7f711f400700 1 -- 172.21.15.82:0/789558865 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71200133f0 con 0x7f7128150dc0 2024-05-10T04:52:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.092+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71281506a0 con 0x7f7128150dc0 2024-05-10T04:52:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.092+0000 7f711f400700 1 -- 172.21.15.82:0/789558865 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200137c0 con 0x7f7128150dc0 2024-05-10T04:52:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.092+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7128151870 con 0x7f7128150dc0 2024-05-10T04:52:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.093+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71280732b0 con 0x7f7128150dc0 2024-05-10T04:52:14.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.094+0000 7f711f400700 1 -- 172.21.15.82:0/789558865 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7120013920 con 0x7f7128150dc0 2024-05-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.095+0000 7f711f400700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f710806ac90 0x7f710806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.095+0000 7f711f400700 1 -- 172.21.15.82:0/789558865 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7120089ba0 con 0x7f7128150dc0 2024-05-10T04:52:14.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.095+0000 7f7127400700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f710806ac90 0x7f710806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.096+0000 7f7127400700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f710806ac90 0x7f710806d1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f71180091e0 tx=0x7f7118006e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.100+0000 7f711f400700 1 -- 172.21.15.82:0/789558865 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7120054f80 con 0x7f7128150dc0 2024-05-10T04:52:14.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.303+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7128074af0 con 0x7f7128150dc0 2024-05-10T04:52:14.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.308+0000 7f711f400700 1 -- 172.21.15.82:0/789558865 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f71200585a0 con 0x7f7128150dc0 2024-05-10T04:52:14.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f710806ac90 msgr2=0x7f710806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f710806ac90 0x7f710806d1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f71180091e0 tx=0x7f7118006e80 comp rx=0 tx=0).stop 2024-05-10T04:52:14.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7128150dc0 msgr2=0x7f71280b9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7128150dc0 0x7f71280b9200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f71280caeb0 tx=0x7f712000a640 comp rx=0 tx=0).stop 2024-05-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 shutdown_connections 2024-05-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f710806ac90 0x7f710806d1a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7128150dc0 0x7f71280b9200 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f710c003f80 0x7f7128150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 --2- 172.21.15.82:0/789558865 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f71281509b0 0x7f71280b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 >> 172.21.15.82:0/789558865 conn(0x7f71280d40a0 msgr2=0x7f71280b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 shutdown_connections 2024-05-10T04:52:14.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.311+0000 7f712e200700 1 -- 172.21.15.82:0/789558865 wait complete. 2024-05-10T04:52:14.336 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create' 2024-05-10T04:52:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.598+0000 7f96eca00700 1 Processor -- start 2024-05-10T04:52:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.598+0000 7f96eca00700 1 -- start start 2024-05-10T04:52:14.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96eca00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 0x7f96e80b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96eca00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e806b8e0 con 0x7f96e80d04a0 2024-05-10T04:52:14.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96eca00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e806acd0 con 0x7f96e80b31c0 2024-05-10T04:52:14.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96eca00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e806afb0 con 0x7f96e8070640 2024-05-10T04:52:14.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96e6800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f96e80d04a0 0x7f96e806e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40042/0 (socket says 172.21.15.82:40042) 2024-05-10T04:52:14.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96e6800700 1 -- 172.21.15.82:0/1113158512 learned_addr learned my addr 172.21.15.82:0/1113158512 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:14.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96e5e00700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 0x7f96e80b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972280499 0 0) 0x7f96e806b8e0 con 0x7f96e80d04a0 2024-05-10T04:52:14.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.600+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96cc0035b0 con 0x7f96e80d04a0 2024-05-10T04:52:14.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605419271 0 0) 0x7f96cc0035b0 con 0x7f96e80d04a0 2024-05-10T04:52:14.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 msgr2=0x7f96e80b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:14.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 0x7f96e80b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 >> v1:172.21.15.129:6789/0 conn(0x7f96e80b31c0 legacy=0x7f96e80cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e806b290 con 0x7f96e80d04a0 2024-05-10T04:52:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f96e00019f0 con 0x7f96e80d04a0 2024-05-10T04:52:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 >> v1:172.21.15.82:6789/0 conn(0x7f96e80d04a0 legacy=0x7f96e806e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96cc003a30 0x7f96cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc004850 0x7f96cc004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 0x7f96cc005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e806afb0 con 0x7f96cc004850 2024-05-10T04:52:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc00bba0 con 0x7f96cc003a30 2024-05-10T04:52:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc00bd60 con 0x7f96e8070640 2024-05-10T04:52:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e5400700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc004850 0x7f96cc004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e6800700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 0x7f96cc005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.601+0000 7f96e5e00700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96cc003a30 0x7f96cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e5400700 1 -- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 msgr2=0x7f96cc005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e5400700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 0x7f96cc005320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e5400700 1 -- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96cc003a30 msgr2=0x7f96cc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e5400700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96cc003a30 0x7f96cc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e5400700 1 -- 172.21.15.82:0/1113158512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0035b0 con 0x7f96cc004850 2024-05-10T04:52:14.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e6800700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96e8070640 0x7f96cc005320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:14.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e5e00700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96cc003a30 0x7f96cc003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:14.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e5400700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc004850 0x7f96cc004c60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96e80b6410 tx=0x7f96cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c21f8ed446ca8d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d40052d0 con 0x7f96cc004850 2024-05-10T04:52:14.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d4005430 con 0x7f96cc004850 2024-05-10T04:52:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.602+0000 7f96e4a00700 1 -- 172.21.15.82:0/1113158512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d40038c0 con 0x7f96cc004850 2024-05-10T04:52:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.603+0000 7f96eca00700 1 -- 172.21.15.82:0/1113158512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc004850 msgr2=0x7f96cc004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.603+0000 7f96eca00700 1 --2- 172.21.15.82:0/1113158512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96cc004850 0x7f96cc004c60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96e80b6410 tx=0x7f96cc005880 comp rx=0 tx=0).stop 2024-05-10T04:52:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.603+0000 7f96e6800700 1 -- 172.21.15.82:0/1113158512 reap_dead start 2024-05-10T04:52:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.603+0000 7f96eca00700 1 -- 172.21.15.82:0/1113158512 shutdown_connections 2024-05-10T04:52:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.603+0000 7f96eca00700 1 -- 172.21.15.82:0/1113158512 >> 172.21.15.82:0/1113158512 conn(0x7f96e80b26a0 msgr2=0x7f96e80b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:14.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.603+0000 7f96eca00700 1 -- 172.21.15.82:0/1113158512 shutdown_connections 2024-05-10T04:52:14.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.603+0000 7f96eca00700 1 -- 172.21.15.82:0/1113158512 wait complete. 2024-05-10T04:52:14.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.605+0000 7f96eca00700 1 Processor -- start 2024-05-10T04:52:14.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.605+0000 7f96eca00700 1 -- start start 2024-05-10T04:52:14.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96eca00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96cc004850 0x7f96e815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96eca00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96e80c9720 0x7f96e80c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96eca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e806f370 0x7f96e806f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96eca00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80ca070 con 0x7f96e806f370 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96eca00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80c81d0 con 0x7f96e80c9720 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96eca00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81f4090 con 0x7f96cc004850 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96e6800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e806f370 0x7f96e806f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96e6800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e806f370 0x7f96e806f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50190/0 (socket says 172.21.15.82:50190) 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96e6800700 1 -- 172.21.15.82:0/3297309217 learned_addr learned my addr 172.21.15.82:0/3297309217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96e5e00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96cc004850 0x7f96e815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.607+0000 7f96e5400700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96e80c9720 0x7f96e80c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96e6800700 1 -- 172.21.15.82:0/3297309217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96cc004850 msgr2=0x7f96e815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96e6800700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96cc004850 0x7f96e815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96e6800700 1 -- 172.21.15.82:0/3297309217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96e80c9720 msgr2=0x7f96e80c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96e6800700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96e80c9720 0x7f96e80c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96e6800700 1 -- 172.21.15.82:0/3297309217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e81f4e60 con 0x7f96e806f370 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96e6800700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e806f370 0x7f96e806f780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f96e0001f60 tx=0x7f96e000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96de000700 1 -- 172.21.15.82:0/3297309217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e000ebc0 con 0x7f96e806f370 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96de000700 1 -- 172.21.15.82:0/3297309217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e000ed20 con 0x7f96e806f370 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96de000700 1 -- 172.21.15.82:0/3297309217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0013640 con 0x7f96e806f370 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e806fcc0 con 0x7f96e806f370 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.608+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e81f45c0 con 0x7f96e806f370 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.610+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e8074af0 con 0x7f96e806f370 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.610+0000 7f96de000700 1 -- 172.21.15.82:0/3297309217 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f96e00137a0 con 0x7f96e806f370 2024-05-10T04:52:14.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.611+0000 7f96de000700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f96c806acc0 0x7f96c806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.611+0000 7f96de000700 1 -- 172.21.15.82:0/3297309217 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f96e00895f0 con 0x7f96e806f370 2024-05-10T04:52:14.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.611+0000 7f96e5e00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f96c806acc0 0x7f96c806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.612+0000 7f96e5e00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f96c806acc0 0x7f96c806d1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96e80d0b00 tx=0x7f96d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.616+0000 7f96de000700 1 -- 172.21.15.82:0/3297309217 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f96e00549d0 con 0x7f96e806f370 2024-05-10T04:52:14.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:14.904+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]} v 0) v1 -- 0x7f96e80cbf30 con 0x7f96e806f370 2024-05-10T04:52:15.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.784+0000 7f96de000700 1 -- 172.21.15.82:0/3297309217 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cap_flush.TestCapFlush.test_replay_create"]}]=0 v134) v1 ==== 138+0+0 (secure 0 0 0) 0x7f96e0057ff0 con 0x7f96e806f370 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f96c806acc0 msgr2=0x7f96c806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f96c806acc0 0x7f96c806d1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f96e80d0b00 tx=0x7f96d8008040 comp rx=0 tx=0).stop 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e806f370 msgr2=0x7f96e806f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e806f370 0x7f96e806f780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f96e0001f60 tx=0x7f96e000e440 comp rx=0 tx=0).stop 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 shutdown_connections 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f96c806acc0 0x7f96c806d1d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e806f370 0x7f96e806f780 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f96cc004850 0x7f96e815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 --2- 172.21.15.82:0/3297309217 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f96e80c9720 0x7f96e80c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 >> 172.21.15.82:0/3297309217 conn(0x7f96e80b26a0 msgr2=0x7f96e80b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:15.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 shutdown_connections 2024-05-10T04:52:15.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:15.787+0000 7f96eca00700 1 -- 172.21.15.82:0/3297309217 wait complete. 2024-05-10T04:52:15.819 INFO:tasks.cephfs_test_runner:MDS starts to handle client caps when it enters clientreplay stage. ... ok 2024-05-10T04:52:15.819 INFO:tasks.cephfs_test_runner: 2024-05-10T04:52:15.819 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-10T04:52:15.819 INFO:tasks.cephfs_test_runner:Ran 1 test in 77.179s 2024-05-10T04:52:15.819 INFO:tasks.cephfs_test_runner: 2024-05-10T04:52:15.819 INFO:tasks.cephfs_test_runner:OK 2024-05-10T04:52:15.820 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-10T04:52:15.830 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-10T04:52:15.848 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T04:52:15.849 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:52:15.849 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:15.896 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343188k,nr_inodes=4085797,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275192k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2024-05-10T04:52:15.896 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-10T04:52:15.896 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:15.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343188k,nr_inodes=4085797,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275192k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2024-05-10T04:52:15.982 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:52:15.982 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:16.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343248k,nr_inodes=4085812,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2024-05-10T04:52:16.033 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-05-10T04:52:16.033 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:16.078 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16343248k,nr_inodes=4085812,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275204k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2024-05-10T04:52:16.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.079 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T04:52:16.124 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T04:52:16.124 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-10T04:52:16.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.125 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:52:16.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.234 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-10T04:52:16.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-10T04:52:16.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.426 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-10T04:52:16.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-10T04:52:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-05-10T04:52:16.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:52:16.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.587 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-05-10T04:52:16.636 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T04:52:16.637 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-10T04:52:16.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.638 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T04:52:16.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.710 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-10T04:52:16.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.781 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2024-05-10T04:52:16.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.903 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-05-10T04:52:16.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:16.950 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2024-05-10T04:52:17.022 INFO:teuthology.orchestra.run.smithi129.stderr:Cannot find device "ceph-brx" 2024-05-10T04:52:17.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:52:17.025 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-10T04:52:17.035 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T04:52:17.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:17.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.298+0000 7f5e5c200700 1 Processor -- start 2024-05-10T04:52:17.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.298+0000 7f5e5c200700 1 -- start start 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e5c200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5e540cf450 0x7f5e540ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e5c200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e54072630 0x7f5e5406ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e5c200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e540ce600 con 0x7f5e5415a850 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e5c200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e540cd9f0 con 0x7f5e54072630 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e5c200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e540cdcd0 con 0x7f5e540cf450 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e5a200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e54072630 0x7f5e5406ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e59800700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f5e540cf450 0x7f5e540ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e5a200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e54072630 0x7f5e5406ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44410/0 (socket says 172.21.15.82:44410) 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e5a200700 1 -- 172.21.15.82:0/364940803 learned_addr learned my addr 172.21.15.82:0/364940803 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.300+0000 7f5e58e00700 1 --1- 172.21.15.82:0/364940803 >> v1:172.21.15.82:6789/0 conn(0x7f5e5415a850 0x7f5e54071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47968/0 (socket says 172.21.15.82:47968) 2024-05-10T04:52:17.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e5a200700 1 -- 172.21.15.82:0/364940803 >> v2:172.21.15.129:3300/0 conn(0x7f5e540cf450 msgr2=0x7f5e540ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:17.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e5a200700 1 --2- 172.21.15.82:0/364940803 >> v2:172.21.15.129:3300/0 conn(0x7f5e540cf450 0x7f5e540ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e5a200700 1 -- 172.21.15.82:0/364940803 >> v1:172.21.15.82:6789/0 conn(0x7f5e5415a850 legacy=0x7f5e54071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e5a200700 1 -- 172.21.15.82:0/364940803 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e540cdfb0 con 0x7f5e54072630 2024-05-10T04:52:17.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e53e00700 1 -- 172.21.15.82:0/364940803 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512261914 0 0) 0x7f5e540ce600 con 0x7f5e5415a850 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e5a200700 1 --2- 172.21.15.82:0/364940803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e54072630 0x7f5e5406ecf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5e540cf300 tx=0x7f5e4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfe00a0b1bf0051 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e53e00700 1 -- 172.21.15.82:0/364940803 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c00e070 con 0x7f5e54072630 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e53e00700 1 -- 172.21.15.82:0/364940803 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c00b910 con 0x7f5e54072630 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.301+0000 7f5e53e00700 1 -- 172.21.15.82:0/364940803 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c00bcc0 con 0x7f5e54072630 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.302+0000 7f5e5c200700 1 -- 172.21.15.82:0/364940803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e54072630 msgr2=0x7f5e5406ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.302+0000 7f5e5c200700 1 --2- 172.21.15.82:0/364940803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e54072630 0x7f5e5406ecf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5e540cf300 tx=0x7f5e4c00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.302+0000 7f5e5c200700 1 -- 172.21.15.82:0/364940803 shutdown_connections 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.302+0000 7f5e5c200700 1 --2- 172.21.15.82:0/364940803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e54072630 0x7f5e5406ecf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.302+0000 7f5e5c200700 1 --2- 172.21.15.82:0/364940803 >> v2:172.21.15.129:3300/0 conn(0x7f5e540cf450 0x7f5e540ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.302+0000 7f5e5c200700 1 -- 172.21.15.82:0/364940803 >> 172.21.15.82:0/364940803 conn(0x7f5e540cfa80 msgr2=0x7f5e540cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.302+0000 7f5e5c200700 1 -- 172.21.15.82:0/364940803 shutdown_connections 2024-05-10T04:52:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.302+0000 7f5e5c200700 1 -- 172.21.15.82:0/364940803 wait complete. 2024-05-10T04:52:17.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.305+0000 7f5e5c200700 1 Processor -- start 2024-05-10T04:52:17.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.305+0000 7f5e5c200700 1 -- start start 2024-05-10T04:52:17.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.306+0000 7f5e5c200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e540cf450 0x7f5e5413c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.306+0000 7f5e5c200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e5415a850 0x7f5e5415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.306+0000 7f5e5c200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e5413cfc0 0x7f5e540b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.306+0000 7f5e5c200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540b2780 con 0x7f5e5413cfc0 2024-05-10T04:52:17.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.306+0000 7f5e5c200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540b3350 con 0x7f5e5415a850 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.306+0000 7f5e5c200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5415bfc0 con 0x7f5e540cf450 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e5413cfc0 0x7f5e540b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e5413cfc0 0x7f5e540b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44412/0 (socket says 172.21.15.82:44412) 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 -- 172.21.15.82:0/1072232620 learned_addr learned my addr 172.21.15.82:0/1072232620 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e59800700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e540cf450 0x7f5e5413c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e58e00700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e5415a850 0x7f5e5415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 -- 172.21.15.82:0/1072232620 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e540cf450 msgr2=0x7f5e5413c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e540cf450 0x7f5e5413c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 -- 172.21.15.82:0/1072232620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e5415a850 msgr2=0x7f5e5415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e5415a850 0x7f5e5415c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 -- 172.21.15.82:0/1072232620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c009b30 con 0x7f5e5413cfc0 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.307+0000 7f5e5a200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e5413cfc0 0x7f5e540b28f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00b680 tx=0x7f5e4c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.308+0000 7f5e51600700 1 -- 172.21.15.82:0/1072232620 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0099b0 con 0x7f5e5413cfc0 2024-05-10T04:52:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.308+0000 7f5e51600700 1 -- 172.21.15.82:0/1072232620 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c004250 con 0x7f5e5413cfc0 2024-05-10T04:52:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.308+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5413cdc0 con 0x7f5e5413cfc0 2024-05-10T04:52:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.308+0000 7f5e51600700 1 -- 172.21.15.82:0/1072232620 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c004600 con 0x7f5e5413cfc0 2024-05-10T04:52:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.308+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5415b970 con 0x7f5e5413cfc0 2024-05-10T04:52:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.309+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e54074af0 con 0x7f5e5413cfc0 2024-05-10T04:52:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.310+0000 7f5e51600700 1 -- 172.21.15.82:0/1072232620 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e4c004760 con 0x7f5e5413cfc0 2024-05-10T04:52:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.311+0000 7f5e51600700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406acc0 0x7f5e3406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.311+0000 7f5e51600700 1 -- 172.21.15.82:0/1072232620 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5e4c08a520 con 0x7f5e5413cfc0 2024-05-10T04:52:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.311+0000 7f5e59800700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406acc0 0x7f5e3406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.311+0000 7f5e59800700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406acc0 0x7f5e3406d1d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e54070e60 tx=0x7f5e48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.315+0000 7f5e51600700 1 -- 172.21.15.82:0/1072232620 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5e4c055990 con 0x7f5e5413cfc0 2024-05-10T04:52:17.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.511+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e540cb550 con 0x7f5e3406acc0 2024-05-10T04:52:17.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.514+0000 7f5e51600700 1 -- 172.21.15.82:0/1072232620 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50460 (secure 0 0 0) 0x7f5e540cb550 con 0x7f5e3406acc0 2024-05-10T04:52:17.517 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406acc0 msgr2=0x7f5e3406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406acc0 0x7f5e3406d1d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e54070e60 tx=0x7f5e48008040 comp rx=0 tx=0).stop 2024-05-10T04:52:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e5413cfc0 msgr2=0x7f5e540b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e5413cfc0 0x7f5e540b28f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00b680 tx=0x7f5e4c004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 shutdown_connections 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f5e3406acc0 0x7f5e3406d1d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e5413cfc0 0x7f5e540b28f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f5e540cf450 0x7f5e5413c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 --2- 172.21.15.82:0/1072232620 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e5415a850 0x7f5e5415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.516+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 >> 172.21.15.82:0/1072232620 conn(0x7f5e540cfa80 msgr2=0x7f5e5414bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.517+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 shutdown_connections 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.517+0000 7f5e5c200700 1 -- 172.21.15.82:0/1072232620 wait complete. 2024-05-10T04:52:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:52:17.543 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-05-10T04:52:16.995406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":220768,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753952,"statfs":{"total":773094113280,"available":772868046848,"internally_reserved":0,"allocated":4694016,"data_stored":2581256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18132,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-78,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.240411"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T04:52:11.063785+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:52:11.063785+0000","last_peered":"2024-05-10T04:52:11.063785+0000","last_clean":"2024-05-10T04:52:11.063785+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:52:11.063785+0000","last_undegraded":"2024-05-10T04:52:11.063785+0000","last_fullsized":"2024-05-10T04:52:11.063785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":765433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.438,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":1.268,"15min":1.268},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95199999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.337,"15min":1.337},"last":0.751},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2230000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93400000000000005}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.56999999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.63700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.266,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0529999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.628},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0209999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.028,"5min":1.26,"15min":1.26},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59899999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.442}]},{"osd":2,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.503}]},{"osd":4,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.753,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.63100000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96699999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.288,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":765433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.318},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58899999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.37}]},{"osd":2,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.58199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0349999999999999,"5min":1.242,"15min":1.242},"last":0.747},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.89100000000000001,"5min":1.397,"15min":1.397},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.91100000000000003,"5min":1.03,"15min":1.03},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81599999999999995,"15min":0.82499999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.93899999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83599999999999997},"min":{"1min":0.60299999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.131,"15min":1.131},"last":0.78500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.73799999999999999,"15min":0.79200000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.51800000000000002,"5min":5.266,"15min":5.266},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.70099999999999996,"15min":0.748},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.62,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.58199999999999996,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58199999999999996,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.77000000000000002,"15min":0.81599999999999995},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.60699999999999998,"5min":5.8520000000000003,"15min":5.8520000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.65400000000000003,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84299999999999997,"15min":0.84799999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1419999999999999,"5min":2.157,"15min":2.157},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.91900000000000004,"15min":0.94899999999999995},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94999999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.99399999999999999,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.94399999999999995,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86399999999999999,"15min":0.875},"min":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.97199999999999998,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.93100000000000005,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0700000000000001,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.022,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.61399999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.95399999999999996,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":1.056,"15min":1.0940000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.196,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.438,"15min":0.442},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.503},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71899999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.143,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.995,"5min":1.198,"15min":1.198},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1759999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.097,"5min":1.113,"15min":1.113},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.117,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.998,"5min":1.516,"15min":1.516},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.52400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.54700000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.86199999999999999}]},{"osd":1,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.752}]},{"osd":2,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":5.0670000000000002,"15min":5.0670000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":1.014},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98099999999999998,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.83999999999999997}]},{"osd":3,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55900000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.65000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.52100000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.871,"5min":1.087,"15min":1.087},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92200000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.64300000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97399999999999998,"5min":1.024,"15min":1.024},"last":0.89200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0169999999999999,"5min":1.595,"15min":1.595},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.099,"15min":1.099},"last":0.626}]},{"osd":2,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98199999999999998,"5min":1.349,"15min":1.349},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96299999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93400000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68999999999999995,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2250000000000001,"5min":1.554,"15min":1.554},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92900000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.61699999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.056,"5min":1.625,"15min":1.625},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:17.546 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:17.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.810+0000 7f381f000700 1 Processor -- start 2024-05-10T04:52:17.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.810+0000 7f381f000700 1 -- start start 2024-05-10T04:52:17.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.812+0000 7f381f000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180b2b90 0x7f381815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.812+0000 7f381f000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f38180b6090 0x7f38180d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.812+0000 7f381f000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38181620a0 con 0x7f38180cf800 2024-05-10T04:52:17.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.812+0000 7f381f000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3818162c20 con 0x7f38180b6090 2024-05-10T04:52:17.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.812+0000 7f381f000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381815e9f0 con 0x7f38180b2b90 2024-05-10T04:52:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.813+0000 7f3817e00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180b2b90 0x7f381815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.813+0000 7f381d000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f38180b6090 0x7f38180d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.813+0000 7f3817400700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f38180cf800 0x7f38180b5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:48702/0 (socket says 172.21.15.82:48702) 2024-05-10T04:52:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.813+0000 7f3817400700 1 -- 172.21.15.82:0/1304368833 learned_addr learned my addr 172.21.15.82:0/1304368833 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3816a00700 1 -- 172.21.15.82:0/1304368833 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465963801 0 0) 0x7f38181620a0 con 0x7f38180cf800 2024-05-10T04:52:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3816a00700 1 -- 172.21.15.82:0/1304368833 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37fc0035b0 con 0x7f38180cf800 2024-05-10T04:52:17.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3817e00700 1 -- 172.21.15.82:0/1304368833 >> v2:172.21.15.129:3300/0 conn(0x7f38180b6090 msgr2=0x7f38180d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:17.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3817e00700 1 --2- 172.21.15.82:0/1304368833 >> v2:172.21.15.129:3300/0 conn(0x7f38180b6090 0x7f38180d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3817e00700 1 -- 172.21.15.82:0/1304368833 >> v1:172.21.15.129:6789/0 conn(0x7f38180cf800 legacy=0x7f38180b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3817e00700 1 -- 172.21.15.82:0/1304368833 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38181622f0 con 0x7f38180b2b90 2024-05-10T04:52:17.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f381d000700 1 --2- 172.21.15.82:0/1304368833 >> v2:172.21.15.129:3300/0 conn(0x7f38180b6090 0x7f38180d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:17.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3817e00700 1 --2- 172.21.15.82:0/1304368833 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180b2b90 0x7f381815e4b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3808009840 tx=0x7f3808009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de2e6f8d7c851bcb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3816a00700 1 -- 172.21.15.82:0/1304368833 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808011830 con 0x7f38180b2b90 2024-05-10T04:52:17.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3816a00700 1 -- 172.21.15.82:0/1304368833 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808011990 con 0x7f38180b2b90 2024-05-10T04:52:17.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.814+0000 7f3816a00700 1 -- 172.21.15.82:0/1304368833 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808011d20 con 0x7f38180b2b90 2024-05-10T04:52:17.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.815+0000 7f381f000700 1 -- 172.21.15.82:0/1304368833 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180b2b90 msgr2=0x7f381815e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.815+0000 7f381f000700 1 --2- 172.21.15.82:0/1304368833 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180b2b90 0x7f381815e4b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3808009840 tx=0x7f3808009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:17.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.815+0000 7f381f000700 1 -- 172.21.15.82:0/1304368833 shutdown_connections 2024-05-10T04:52:17.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.815+0000 7f381f000700 1 --2- 172.21.15.82:0/1304368833 >> v2:172.21.15.129:3300/0 conn(0x7f38180b6090 0x7f38180d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.815+0000 7f381f000700 1 --2- 172.21.15.82:0/1304368833 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180b2b90 0x7f381815e4b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.815+0000 7f381f000700 1 -- 172.21.15.82:0/1304368833 >> 172.21.15.82:0/1304368833 conn(0x7f38180d0b60 msgr2=0x7f38180d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:17.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.815+0000 7f381f000700 1 -- 172.21.15.82:0/1304368833 shutdown_connections 2024-05-10T04:52:17.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.815+0000 7f381f000700 1 -- 172.21.15.82:0/1304368833 wait complete. 2024-05-10T04:52:17.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.817+0000 7f381f000700 1 Processor -- start 2024-05-10T04:52:17.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.817+0000 7f381f000700 1 -- start start 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f381f000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38180b2b90 0x7f38181f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f381f000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180cf800 0x7f381815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f381f000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38180cb9c0 0x7f38180ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f381f000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38181f6060 con 0x7f38180b2b90 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f381f000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180ca8c0 con 0x7f38180cb9c0 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f381f000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180cde50 con 0x7f38180cf800 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f3817e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38180b2b90 0x7f38181f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f3817e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38180b2b90 0x7f38181f5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44420/0 (socket says 172.21.15.82:44420) 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.819+0000 7f3817e00700 1 -- 172.21.15.82:0/3740164855 learned_addr learned my addr 172.21.15.82:0/3740164855 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f3817e00700 1 -- 172.21.15.82:0/3740164855 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180cf800 msgr2=0x7f381815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f3817e00700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180cf800 0x7f381815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f3817e00700 1 -- 172.21.15.82:0/3740164855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38180cb9c0 msgr2=0x7f38180ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f3817e00700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38180cb9c0 0x7f38180ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f3817e00700 1 -- 172.21.15.82:0/3740164855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810009a70 con 0x7f38180b2b90 2024-05-10T04:52:17.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f3817e00700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38180b2b90 0x7f38181f5690 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3808009fd0 tx=0x7f3808004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f380fe00700 1 -- 172.21.15.82:0/3740164855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080036a0 con 0x7f38180b2b90 2024-05-10T04:52:17.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f380fe00700 1 -- 172.21.15.82:0/3740164855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380801e070 con 0x7f38180b2b90 2024-05-10T04:52:17.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38080094a0 con 0x7f38180b2b90 2024-05-10T04:52:17.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f380fe00700 1 -- 172.21.15.82:0/3740164855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808003a60 con 0x7f38180b2b90 2024-05-10T04:52:17.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.820+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38181f5bd0 con 0x7f38180b2b90 2024-05-10T04:52:17.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.821+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38180732b0 con 0x7f38180b2b90 2024-05-10T04:52:17.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.822+0000 7f380fe00700 1 -- 172.21.15.82:0/3740164855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3808003bc0 con 0x7f38180b2b90 2024-05-10T04:52:17.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.823+0000 7f380fe00700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f37f806acc0 0x7f37f806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.823+0000 7f380fe00700 1 -- 172.21.15.82:0/3740164855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3808089ec0 con 0x7f38180b2b90 2024-05-10T04:52:17.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.824+0000 7f3817400700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f37f806acc0 0x7f37f806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.824+0000 7f3817400700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f37f806acc0 0x7f37f806d1d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f38180cac40 tx=0x7f38040079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:17.828+0000 7f380fe00700 1 -- 172.21.15.82:0/3740164855 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f38080553d0 con 0x7f38180b2b90 2024-05-10T04:52:18.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.027+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38180cac90 con 0x7f37f806acc0 2024-05-10T04:52:18.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.030+0000 7f380fe00700 1 -- 172.21.15.82:0/3740164855 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50460 (secure 0 0 0) 0x7f38180cac90 con 0x7f37f806acc0 2024-05-10T04:52:18.032 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f37f806acc0 msgr2=0x7f37f806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f37f806acc0 0x7f37f806d1d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f38180cac40 tx=0x7f38040079c0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38180b2b90 msgr2=0x7f38181f5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38180b2b90 0x7f38181f5690 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3808009fd0 tx=0x7f3808004750 comp rx=0 tx=0).stop 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 shutdown_connections 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f37f806acc0 0x7f37f806d1d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f38180cb9c0 0x7f38180ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38180b2b90 0x7f38181f5690 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 --2- 172.21.15.82:0/3740164855 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f38180cf800 0x7f381815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 >> 172.21.15.82:0/3740164855 conn(0x7f38180d0b60 msgr2=0x7f38180b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 shutdown_connections 2024-05-10T04:52:18.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.032+0000 7f381f000700 1 -- 172.21.15.82:0/3740164855 wait complete. 2024-05-10T04:52:18.035 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:52:18.062 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-05-10T04:52:16.995406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":220768,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753952,"statfs":{"total":773094113280,"available":772868046848,"internally_reserved":0,"allocated":4694016,"data_stored":2581256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18132,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-78,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.240411"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T04:52:11.063785+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:52:11.063785+0000","last_peered":"2024-05-10T04:52:11.063785+0000","last_clean":"2024-05-10T04:52:11.063785+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:52:11.063785+0000","last_undegraded":"2024-05-10T04:52:11.063785+0000","last_fullsized":"2024-05-10T04:52:11.063785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":765433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.438,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":1.268,"15min":1.268},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95199999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.337,"15min":1.337},"last":0.751},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2230000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93400000000000005}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.56999999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.63700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.266,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0529999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.628},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0209999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.028,"5min":1.26,"15min":1.26},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59899999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.442}]},{"osd":2,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.503}]},{"osd":4,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.753,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.63100000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96699999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.288,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":765433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.318},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58899999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.37}]},{"osd":2,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.58199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0349999999999999,"5min":1.242,"15min":1.242},"last":0.747},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.89100000000000001,"5min":1.397,"15min":1.397},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.91100000000000003,"5min":1.03,"15min":1.03},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81599999999999995,"15min":0.82499999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.93899999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83599999999999997},"min":{"1min":0.60299999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.131,"15min":1.131},"last":0.78500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.73799999999999999,"15min":0.79200000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.51800000000000002,"5min":5.266,"15min":5.266},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.70099999999999996,"15min":0.748},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.62,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.58199999999999996,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58199999999999996,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.77000000000000002,"15min":0.81599999999999995},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.60699999999999998,"5min":5.8520000000000003,"15min":5.8520000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.65400000000000003,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84299999999999997,"15min":0.84799999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1419999999999999,"5min":2.157,"15min":2.157},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.91900000000000004,"15min":0.94899999999999995},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94999999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.99399999999999999,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.94399999999999995,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86399999999999999,"15min":0.875},"min":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.97199999999999998,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.93100000000000005,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0700000000000001,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.022,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.61399999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.95399999999999996,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":1.056,"15min":1.0940000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.196,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.438,"15min":0.442},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.503},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71899999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.143,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.995,"5min":1.198,"15min":1.198},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1759999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.097,"5min":1.113,"15min":1.113},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.117,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.998,"5min":1.516,"15min":1.516},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.52400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.54700000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.86199999999999999}]},{"osd":1,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.752}]},{"osd":2,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":5.0670000000000002,"15min":5.0670000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":1.014},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98099999999999998,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.83999999999999997}]},{"osd":3,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55900000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.65000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.52100000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.871,"5min":1.087,"15min":1.087},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92200000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.64300000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97399999999999998,"5min":1.024,"15min":1.024},"last":0.89200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0169999999999999,"5min":1.595,"15min":1.595},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.099,"15min":1.099},"last":0.626}]},{"osd":2,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98199999999999998,"5min":1.349,"15min":1.349},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96299999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93400000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68999999999999995,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2250000000000001,"5min":1.554,"15min":1.554},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92900000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.61699999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.056,"5min":1.625,"15min":1.625},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:18.063 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T04:52:18.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.323+0000 7ff48f800700 1 Processor -- start 2024-05-10T04:52:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.323+0000 7ff48f800700 1 -- start start 2024-05-10T04:52:18.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff48f800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 0x7ff4880b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff48f800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff4880b31c0 0x7ff4880cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff48f800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48806b8e0 con 0x7ff4880d02d0 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff48f800700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48806acd0 con 0x7ff4880b31c0 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff48f800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48806afb0 con 0x7ff488070640 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff487e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff4880b31c0 0x7ff4880cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff48d800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff4880d02d0 0x7ff4880cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47972/0 (socket says 172.21.15.82:47972) 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff48d800700 1 -- 172.21.15.82:0/2519464662 learned_addr learned my addr 172.21.15.82:0/2519464662 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff48ce00700 1 --2- 172.21.15.82:0/2519464662 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 0x7ff4880b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff487e00700 1 -- 172.21.15.82:0/2519464662 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 msgr2=0x7ff4880b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff487e00700 1 --2- 172.21.15.82:0/2519464662 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 0x7ff4880b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff487e00700 1 -- 172.21.15.82:0/2519464662 >> v1:172.21.15.82:6789/0 conn(0x7ff4880d02d0 legacy=0x7ff4880cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.325+0000 7ff487400700 1 -- 172.21.15.82:0/2519464662 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580489016 0 0) 0x7ff48806b8e0 con 0x7ff4880d02d0 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.326+0000 7ff487e00700 1 -- 172.21.15.82:0/2519464662 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48806b290 con 0x7ff4880b31c0 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.326+0000 7ff487e00700 1 --2- 172.21.15.82:0/2519464662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4880cfd90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff474009840 tx=0x7ff474009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebdc4f41ea5845e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.326+0000 7ff487400700 1 -- 172.21.15.82:0/2519464662 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474011830 con 0x7ff4880b31c0 2024-05-10T04:52:18.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.326+0000 7ff487400700 1 -- 172.21.15.82:0/2519464662 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff474011990 con 0x7ff4880b31c0 2024-05-10T04:52:18.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.326+0000 7ff487400700 1 -- 172.21.15.82:0/2519464662 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474011d20 con 0x7ff4880b31c0 2024-05-10T04:52:18.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.327+0000 7ff48f800700 1 -- 172.21.15.82:0/2519464662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 msgr2=0x7ff4880cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.327+0000 7ff48f800700 1 --2- 172.21.15.82:0/2519464662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4880cfd90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff474009840 tx=0x7ff474009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:18.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.327+0000 7ff48f800700 1 -- 172.21.15.82:0/2519464662 shutdown_connections 2024-05-10T04:52:18.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.327+0000 7ff48f800700 1 --2- 172.21.15.82:0/2519464662 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 0x7ff4880b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.327+0000 7ff48f800700 1 --2- 172.21.15.82:0/2519464662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4880cfd90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.327+0000 7ff48f800700 1 -- 172.21.15.82:0/2519464662 >> 172.21.15.82:0/2519464662 conn(0x7ff4880b26a0 msgr2=0x7ff4880b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:18.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.327+0000 7ff48f800700 1 -- 172.21.15.82:0/2519464662 shutdown_connections 2024-05-10T04:52:18.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.327+0000 7ff48f800700 1 -- 172.21.15.82:0/2519464662 wait complete. 2024-05-10T04:52:18.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.329+0000 7ff48f800700 1 Processor -- start 2024-05-10T04:52:18.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.329+0000 7ff48f800700 1 -- start start 2024-05-10T04:52:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff48f800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 0x7ff488160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff48f800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4881611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff48f800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4880d02d0 0x7ff4880c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff48f800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880b3620 con 0x7ff4880b31c0 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff48f800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c6630 con 0x7ff4880d02d0 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff48f800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880b3780 con 0x7ff488070640 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff487e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4881611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff487e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4881611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44438/0 (socket says 172.21.15.82:44438) 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff487e00700 1 -- 172.21.15.82:0/3007063878 learned_addr learned my addr 172.21.15.82:0/3007063878 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff48ce00700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 0x7ff488160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff48d800700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4880d02d0 0x7ff4880c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff487e00700 1 -- 172.21.15.82:0/3007063878 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 msgr2=0x7ff488160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff487e00700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 0x7ff488160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff487e00700 1 -- 172.21.15.82:0/3007063878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4880d02d0 msgr2=0x7ff4880c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff487e00700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4880d02d0 0x7ff4880c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.331+0000 7ff487e00700 1 -- 172.21.15.82:0/3007063878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740094a0 con 0x7ff4880b31c0 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.332+0000 7ff487e00700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4881611a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff474009b90 tx=0x7ff474004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.332+0000 7ff484c00700 1 -- 172.21.15.82:0/3007063878 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4740036a0 con 0x7ff4880b31c0 2024-05-10T04:52:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.332+0000 7ff484c00700 1 -- 172.21.15.82:0/3007063878 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47401e070 con 0x7ff4880b31c0 2024-05-10T04:52:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.332+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4881618b0 con 0x7ff4880b31c0 2024-05-10T04:52:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.332+0000 7ff484c00700 1 -- 172.21.15.82:0/3007063878 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474003a00 con 0x7ff4880b31c0 2024-05-10T04:52:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.332+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4880c5120 con 0x7ff4880b31c0 2024-05-10T04:52:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.333+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880c52b0 con 0x7ff4880b31c0 2024-05-10T04:52:18.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.334+0000 7ff484c00700 1 -- 172.21.15.82:0/3007063878 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff474003b60 con 0x7ff4880b31c0 2024-05-10T04:52:18.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.335+0000 7ff484c00700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff46806ac90 0x7ff46806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.335+0000 7ff484c00700 1 -- 172.21.15.82:0/3007063878 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff47408a090 con 0x7ff4880b31c0 2024-05-10T04:52:18.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.335+0000 7ff48ce00700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff46806ac90 0x7ff46806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.336+0000 7ff48ce00700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff46806ac90 0x7ff46806d1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff47c006b20 tx=0x7ff47c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.340+0000 7ff484c00700 1 -- 172.21.15.82:0/3007063878 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff474055500 con 0x7ff4880b31c0 2024-05-10T04:52:18.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.539+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4880d06e0 con 0x7ff46806ac90 2024-05-10T04:52:18.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.542+0000 7ff484c00700 1 -- 172.21.15.82:0/3007063878 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50460 (secure 0 0 0) 0x7ff47c0076b0 con 0x7ff46806ac90 2024-05-10T04:52:18.544 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:18.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff46806ac90 msgr2=0x7ff46806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff46806ac90 0x7ff46806d1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff47c006b20 tx=0x7ff47c008040 comp rx=0 tx=0).stop 2024-05-10T04:52:18.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 msgr2=0x7ff4881611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4881611a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff474009b90 tx=0x7ff474004750 comp rx=0 tx=0).stop 2024-05-10T04:52:18.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 shutdown_connections 2024-05-10T04:52:18.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff46806ac90 0x7ff46806d1a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff4880d02d0 0x7ff4880c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff488070640 0x7ff488160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 --2- 172.21.15.82:0/3007063878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4880b31c0 0x7ff4881611a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 >> 172.21.15.82:0/3007063878 conn(0x7ff4880b26a0 msgr2=0x7ff4880b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:18.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.544+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 shutdown_connections 2024-05-10T04:52:18.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.545+0000 7ff48f800700 1 -- 172.21.15.82:0/3007063878 wait complete. 2024-05-10T04:52:18.547 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:52:18.574 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-05-10T04:52:16.995406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":220768,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753952,"statfs":{"total":773094113280,"available":772868046848,"internally_reserved":0,"allocated":4694016,"data_stored":2581256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18132,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-86,"num_read_kb":-88,"num_write":-78,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.240411"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-10T04:52:11.063785+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:52:11.063785+0000","last_peered":"2024-05-10T04:52:11.063785+0000","last_clean":"2024-05-10T04:52:11.063785+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:52:11.063785+0000","last_undegraded":"2024-05-10T04:52:11.063785+0000","last_fullsized":"2024-05-10T04:52:11.063785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":765433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.438,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":1.268,"15min":1.268},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95199999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.337,"15min":1.337},"last":0.751},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.69899999999999995}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2230000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93400000000000005}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.56999999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.63700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.266,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0529999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.628},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0209999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.028,"5min":1.26,"15min":1.26},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59899999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.442}]},{"osd":2,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.503}]},{"osd":4,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.96999999999999997}]},{"osd":5,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.753,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.92300000000000004}]},{"osd":6,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.63100000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96699999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.288,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.84799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":765433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.318},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58899999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.37}]},{"osd":2,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.58199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0349999999999999,"5min":1.242,"15min":1.242},"last":0.747},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.89100000000000001,"5min":1.397,"15min":1.397},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.91100000000000003,"5min":1.03,"15min":1.03},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81599999999999995,"15min":0.82499999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.93899999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83599999999999997},"min":{"1min":0.60299999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.131,"15min":1.131},"last":0.78500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.73799999999999999,"15min":0.79200000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.51800000000000002,"5min":5.266,"15min":5.266},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.70099999999999996,"15min":0.748},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.62,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.58199999999999996,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58199999999999996,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.77000000000000002,"15min":0.81599999999999995},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.60699999999999998,"5min":5.8520000000000003,"15min":5.8520000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.65400000000000003,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84299999999999997,"15min":0.84799999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1419999999999999,"5min":2.157,"15min":2.157},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.91900000000000004,"15min":0.94899999999999995},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94999999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.99399999999999999,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.94399999999999995,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86399999999999999,"15min":0.875},"min":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.97199999999999998,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.93100000000000005,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0700000000000001,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.022,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.61399999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.95399999999999996,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":1.056,"15min":1.0940000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.196,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.438,"15min":0.442},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.503},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.37},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71899999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.143,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.995,"5min":1.198,"15min":1.198},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1759999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.097,"5min":1.113,"15min":1.113},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.117,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.998,"5min":1.516,"15min":1.516},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.52400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.54700000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.86199999999999999}]},{"osd":1,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.752}]},{"osd":2,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":5.0670000000000002,"15min":5.0670000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":1.014},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98099999999999998,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.83999999999999997}]},{"osd":3,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55900000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73399999999999999}]},{"osd":5,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.65000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.52100000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.871,"5min":1.087,"15min":1.087},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92200000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.64300000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97399999999999998,"5min":1.024,"15min":1.024},"last":0.89200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":175065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0169999999999999,"5min":1.595,"15min":1.595},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.099,"15min":1.099},"last":0.626}]},{"osd":2,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98199999999999998,"5min":1.349,"15min":1.349},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96299999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93400000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68999999999999995,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2250000000000001,"5min":1.554,"15min":1.554},"last":0.57899999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92900000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.61699999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.056,"5min":1.625,"15min":1.625},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:18.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:18.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.839+0000 7fe5ab000700 1 Processor -- start 2024-05-10T04:52:18.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.839+0000 7fe5ab000700 1 -- start start 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5ab000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fe5a40b2ca0 0x7fe5a40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5ab000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415df40 0x7fe5a40d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5ab000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe5a415e350 0x7fe5a40d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5ab000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a40d0e30 con 0x7fe5a415e350 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5ab000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a4161e40 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5ab000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4162120 con 0x7fe5a415df40 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5aa600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe5a415e350 0x7fe5a40d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5aa600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe5a415e350 0x7fe5a40d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44452/0 (socket says 172.21.15.82:44452) 2024-05-10T04:52:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.841+0000 7fe5aa600700 1 -- 172.21.15.82:0/3461691074 learned_addr learned my addr 172.21.15.82:0/3461691074 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.842+0000 7fe5aa600700 1 -- 172.21.15.82:0/3461691074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415df40 msgr2=0x7fe5a40d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.842+0000 7fe5aa600700 1 --2- 172.21.15.82:0/3461691074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415df40 0x7fe5a40d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.842+0000 7fe5aa600700 1 -- 172.21.15.82:0/3461691074 >> v2:172.21.15.129:3300/0 conn(0x7fe5a40b2ca0 msgr2=0x7fe5a40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.842+0000 7fe5aa600700 1 --2- 172.21.15.82:0/3461691074 >> v2:172.21.15.129:3300/0 conn(0x7fe5a40b2ca0 0x7fe5a40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.842+0000 7fe5aa600700 1 -- 172.21.15.82:0/3461691074 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a4162400 con 0x7fe5a415e350 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.842+0000 7fe5aa600700 1 --2- 172.21.15.82:0/3461691074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a415e350 0x7fe5a40d08f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe5a406d2d0 tx=0x7fe59c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200d6a31a138aafc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.842+0000 7fe5a3e00700 1 -- 172.21.15.82:0/3461691074 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00e070 con 0x7fe5a415e350 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.842+0000 7fe5a3e00700 1 -- 172.21.15.82:0/3461691074 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c00b9c0 con 0x7fe5a415e350 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5a3e00700 1 -- 172.21.15.82:0/3461691074 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00bd70 con 0x7fe5a415e350 2024-05-10T04:52:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 -- 172.21.15.82:0/3461691074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a415e350 msgr2=0x7fe5a40d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 --2- 172.21.15.82:0/3461691074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a415e350 0x7fe5a40d08f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe5a406d2d0 tx=0x7fe59c00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 -- 172.21.15.82:0/3461691074 shutdown_connections 2024-05-10T04:52:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 --2- 172.21.15.82:0/3461691074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a415e350 0x7fe5a40d08f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 --2- 172.21.15.82:0/3461691074 >> v2:172.21.15.129:3300/0 conn(0x7fe5a40b2ca0 0x7fe5a40cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 --2- 172.21.15.82:0/3461691074 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415df40 0x7fe5a40d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 -- 172.21.15.82:0/3461691074 >> 172.21.15.82:0/3461691074 conn(0x7fe5a4067600 msgr2=0x7fe5a406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 -- 172.21.15.82:0/3461691074 shutdown_connections 2024-05-10T04:52:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.843+0000 7fe5ab000700 1 -- 172.21.15.82:0/3461691074 wait complete. 2024-05-10T04:52:18.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.846+0000 7fe5ab000700 1 Processor -- start 2024-05-10T04:52:18.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.846+0000 7fe5ab000700 1 -- start start 2024-05-10T04:52:18.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.847+0000 7fe5ab000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a40b2ca0 0x7fe5a40cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.847+0000 7fe5ab000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5a415df40 0x7fe5a41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.847+0000 7fe5ab000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415e350 0x7fe5a40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.847+0000 7fe5ab000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4155350 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.847+0000 7fe5ab000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4159350 con 0x7fe5a415df40 2024-05-10T04:52:18.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.847+0000 7fe5ab000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a414fdd0 con 0x7fe5a415e350 2024-05-10T04:52:18.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.847+0000 7fe5a9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a40b2ca0 0x7fe5a40cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a40b2ca0 0x7fe5a40cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44458/0 (socket says 172.21.15.82:44458) 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9c00700 1 -- 172.21.15.82:0/43386374 learned_addr learned my addr 172.21.15.82:0/43386374 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5aa600700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415e350 0x7fe5a40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9200700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5a415df40 0x7fe5a41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9c00700 1 -- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415e350 msgr2=0x7fe5a40b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9c00700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415e350 0x7fe5a40b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9c00700 1 -- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5a415df40 msgr2=0x7fe5a41588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9c00700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5a415df40 0x7fe5a41588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9c00700 1 -- 172.21.15.82:0/43386374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c009b30 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5aa600700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415e350 0x7fe5a40b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a9c00700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a40b2ca0 0x7fe5a40cdbf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe59800b4a0 tx=0x7fe59800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a1600700 1 -- 172.21.15.82:0/43386374 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598011830 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5a1600700 1 -- 172.21.15.82:0/43386374 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598011990 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.848+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a41f7e50 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.849+0000 7fe5a1600700 1 -- 172.21.15.82:0/43386374 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598011d40 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.849+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a41f8410 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.850+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a40748a0 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.851+0000 7fe5a1600700 1 -- 172.21.15.82:0/43386374 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe59801a400 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.851+0000 7fe5a1600700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe58406acc0 0x7fe58406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.852+0000 7fe5a1600700 1 -- 172.21.15.82:0/43386374 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe5980890c0 con 0x7fe5a40b2ca0 2024-05-10T04:52:18.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.852+0000 7fe5a9200700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe58406acc0 0x7fe58406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.852+0000 7fe5a9200700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe58406acc0 0x7fe58406d1d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe590006fd0 tx=0x7fe590008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:18.856+0000 7fe5a1600700 1 -- 172.21.15.82:0/43386374 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe5980544c0 con 0x7fe5a40b2ca0 2024-05-10T04:52:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.063+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5a4074af0 con 0x7fe5a40b2ca0 2024-05-10T04:52:19.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.064+0000 7fe5a1600700 1 -- 172.21.15.82:0/43386374 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12650 (secure 0 0 0) 0x7fe598057ae0 con 0x7fe5a40b2ca0 2024-05-10T04:52:19.065 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":39,"fsid":"c7bb1514-6d11-4350-825d-a52cfeee72e9","created":"2024-05-10T04:49:49.645216+0000","modified":"2024-05-10T04:52:13.769814+0000","last_up_change":"2024-05-10T04:50:03.213824+0000","last_in_change":"2024-05-10T04:49:53.870644+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:50:05.029386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c25e5b0c-03f8-48b2-a338-9fbf05e16b50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":43965},{"type":"v1","addr":"172.21.15.82:6809","nonce":43965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":43965},{"type":"v1","addr":"172.21.15.82:6811","nonce":43965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6819","nonce":43965},{"type":"v1","addr":"172.21.15.82:6822","nonce":43965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":43965},{"type":"v1","addr":"172.21.15.82:6814","nonce":43965}]},"public_addr":"172.21.15.82:6809/43965","cluster_addr":"172.21.15.82:6811/43965","heartbeat_back_addr":"172.21.15.82:6822/43965","heartbeat_front_addr":"172.21.15.82:6814/43965","state":["exists","up"]},{"osd":1,"uuid":"caa734a3-6c99-4088-a935-5cdfd6eb0b81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":43969},{"type":"v1","addr":"172.21.15.82:6801","nonce":43969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":43969},{"type":"v1","addr":"172.21.15.82:6803","nonce":43969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":43969},{"type":"v1","addr":"172.21.15.82:6807","nonce":43969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":43969},{"type":"v1","addr":"172.21.15.82:6805","nonce":43969}]},"public_addr":"172.21.15.82:6801/43969","cluster_addr":"172.21.15.82:6803/43969","heartbeat_back_addr":"172.21.15.82:6807/43969","heartbeat_front_addr":"172.21.15.82:6805/43969","state":["exists","up"]},{"osd":2,"uuid":"25e45572-97fc-438e-b46b-623e1f7dcc18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":43970},{"type":"v1","addr":"172.21.15.82:6815","nonce":43970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":43970},{"type":"v1","addr":"172.21.15.82:6820","nonce":43970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6827","nonce":43970},{"type":"v1","addr":"172.21.15.82:6829","nonce":43970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":43970},{"type":"v1","addr":"172.21.15.82:6825","nonce":43970}]},"public_addr":"172.21.15.82:6815/43970","cluster_addr":"172.21.15.82:6820/43970","heartbeat_back_addr":"172.21.15.82:6829/43970","heartbeat_front_addr":"172.21.15.82:6825/43970","state":["exists","up"]},{"osd":3,"uuid":"02301f01-ba44-4a50-af7e-51b08f106b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":43967},{"type":"v1","addr":"172.21.15.82:6818","nonce":43967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":43967},{"type":"v1","addr":"172.21.15.82:6824","nonce":43967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":43967},{"type":"v1","addr":"172.21.15.82:6831","nonce":43967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":43967},{"type":"v1","addr":"172.21.15.82:6828","nonce":43967}]},"public_addr":"172.21.15.82:6818/43967","cluster_addr":"172.21.15.82:6824/43967","heartbeat_back_addr":"172.21.15.82:6831/43967","heartbeat_front_addr":"172.21.15.82:6828/43967","state":["exists","up"]},{"osd":4,"uuid":"e0dac652-feae-4967-9226-804a125c5611","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6800","nonce":44258},{"type":"v1","addr":"172.21.15.129:6801","nonce":44258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6802","nonce":44258},{"type":"v1","addr":"172.21.15.129:6803","nonce":44258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6806","nonce":44258},{"type":"v1","addr":"172.21.15.129:6807","nonce":44258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6804","nonce":44258},{"type":"v1","addr":"172.21.15.129:6805","nonce":44258}]},"public_addr":"172.21.15.129:6801/44258","cluster_addr":"172.21.15.129:6803/44258","heartbeat_back_addr":"172.21.15.129:6807/44258","heartbeat_front_addr":"172.21.15.129:6805/44258","state":["exists","up"]},{"osd":5,"uuid":"92d02439-7a37-4b4f-bba0-c9aa00febacd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6816","nonce":44259},{"type":"v1","addr":"172.21.15.129:6817","nonce":44259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6818","nonce":44259},{"type":"v1","addr":"172.21.15.129:6819","nonce":44259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6822","nonce":44259},{"type":"v1","addr":"172.21.15.129:6823","nonce":44259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6820","nonce":44259},{"type":"v1","addr":"172.21.15.129:6821","nonce":44259}]},"public_addr":"172.21.15.129:6817/44259","cluster_addr":"172.21.15.129:6819/44259","heartbeat_back_addr":"172.21.15.129:6823/44259","heartbeat_front_addr":"172.21.15.129:6821/44259","state":["exists","up"]},{"osd":6,"uuid":"9267060d-92da-4bb3-be80-531ce9345ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6808","nonce":44260},{"type":"v1","addr":"172.21.15.129:6809","nonce":44260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6810","nonce":44260},{"type":"v1","addr":"172.21.15.129:6811","nonce":44260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6814","nonce":44260},{"type":"v1","addr":"172.21.15.129:6815","nonce":44260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6812","nonce":44260},{"type":"v1","addr":"172.21.15.129:6813","nonce":44260}]},"public_addr":"172.21.15.129:6809/44260","cluster_addr":"172.21.15.129:6811/44260","heartbeat_back_addr":"172.21.15.129:6815/44260","heartbeat_front_addr":"172.21.15.129:6813/44260","state":["exists","up"]},{"osd":7,"uuid":"71fc5fad-1b18-43d5-8bf4-740e1e069e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6824","nonce":44261},{"type":"v1","addr":"172.21.15.129:6825","nonce":44261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6826","nonce":44261},{"type":"v1","addr":"172.21.15.129:6827","nonce":44261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6830","nonce":44261},{"type":"v1","addr":"172.21.15.129:6831","nonce":44261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6828","nonce":44261},{"type":"v1","addr":"172.21.15.129:6829","nonce":44261}]},"public_addr":"172.21.15.129:6825/44261","cluster_addr":"172.21.15.129:6827/44261","heartbeat_back_addr":"172.21.15.129:6831/44261","heartbeat_front_addr":"172.21.15.129:6829/44261","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.572695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.280275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.583041+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.391719+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.300761+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.627398+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.558670+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:49:59.404623+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.129:6835/2037696235":"2024-05-11T04:52:10.752726+0000","172.21.15.129:6832/2037696235":"2024-05-11T04:52:10.752726+0000","172.21.15.82:6834/3440576054":"2024-05-11T04:51:56.207394+0000","172.21.15.82:6836/3440576054":"2024-05-11T04:51:56.207394+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.066+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe58406acc0 msgr2=0x7fe58406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.066+0000 7fe5ab000700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe58406acc0 0x7fe58406d1d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe590006fd0 tx=0x7fe590008040 comp rx=0 tx=0).stop 2024-05-10T04:52:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.066+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a40b2ca0 msgr2=0x7fe5a40cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.066+0000 7fe5ab000700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a40b2ca0 0x7fe5a40cdbf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe59800b4a0 tx=0x7fe59800b860 comp rx=0 tx=0).stop 2024-05-10T04:52:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.067+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 shutdown_connections 2024-05-10T04:52:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.067+0000 7fe5ab000700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fe58406acc0 0x7fe58406d1d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.067+0000 7fe5ab000700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fe5a415e350 0x7fe5a40b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.067+0000 7fe5ab000700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a40b2ca0 0x7fe5a40cdbf0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.067+0000 7fe5ab000700 1 --2- 172.21.15.82:0/43386374 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe5a415df40 0x7fe5a41588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.067+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 >> 172.21.15.82:0/43386374 conn(0x7fe5a4067600 msgr2=0x7fe5a40d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.067+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 shutdown_connections 2024-05-10T04:52:19.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:19.067+0000 7fe5ab000700 1 -- 172.21.15.82:0/43386374 wait complete. 2024-05-10T04:52:20.096 INFO:tasks.ceph:Scrubbing osd.0 2024-05-10T04:52:20.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:52:20.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.374+0000 7fb52d000700 1 Processor -- start 2024-05-10T04:52:20.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.374+0000 7fb52d000700 1 -- start start 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.376+0000 7fb52d000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5280d0a10 0x7fb5280d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.376+0000 7fb52d000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5280b75f0 0x7fb5280b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.376+0000 7fb52d000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5280b7130 con 0x7fb52815e240 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.376+0000 7fb52d000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5280d1360 con 0x7fb5280b75f0 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.376+0000 7fb52d000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280cebe0 con 0x7fb5280d0a10 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.376+0000 7fb527e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5280b75f0 0x7fb5280b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.376+0000 7fb527e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb5280b75f0 0x7fb5280b7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44462/0 (socket says 172.21.15.82:44462) 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.376+0000 7fb527e00700 1 -- 172.21.15.82:0/2630862029 learned_addr learned my addr 172.21.15.82:0/2630862029 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb51fe00700 1 --2- 172.21.15.82:0/2630862029 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5280d0a10 0x7fb5280d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb527e00700 1 -- 172.21.15.82:0/2630862029 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5280d0a10 msgr2=0x7fb5280d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb527e00700 1 --2- 172.21.15.82:0/2630862029 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5280d0a10 0x7fb5280d0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb527e00700 1 -- 172.21.15.82:0/2630862029 >> v1:172.21.15.129:6789/0 conn(0x7fb52815e240 legacy=0x7fb5280d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb527e00700 1 -- 172.21.15.82:0/2630862029 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280d2ba0 con 0x7fb5280b75f0 2024-05-10T04:52:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb527e00700 1 --2- 172.21.15.82:0/2630862029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280b75f0 0x7fb5280b7a00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb520009e50 tx=0x7fb52000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e38e5f3ba75d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb526a00700 1 -- 172.21.15.82:0/2630862029 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52000e070 con 0x7fb5280b75f0 2024-05-10T04:52:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb526a00700 1 -- 172.21.15.82:0/2630862029 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb520003a20 con 0x7fb5280b75f0 2024-05-10T04:52:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.377+0000 7fb526a00700 1 -- 172.21.15.82:0/2630862029 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520003dd0 con 0x7fb5280b75f0 2024-05-10T04:52:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.378+0000 7fb52d000700 1 -- 172.21.15.82:0/2630862029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280b75f0 msgr2=0x7fb5280b7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.378+0000 7fb52d000700 1 --2- 172.21.15.82:0/2630862029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280b75f0 0x7fb5280b7a00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb520009e50 tx=0x7fb52000b330 comp rx=0 tx=0).stop 2024-05-10T04:52:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.378+0000 7fb52d000700 1 -- 172.21.15.82:0/2630862029 shutdown_connections 2024-05-10T04:52:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.378+0000 7fb52d000700 1 --2- 172.21.15.82:0/2630862029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280b75f0 0x7fb5280b7a00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.378+0000 7fb52d000700 1 --2- 172.21.15.82:0/2630862029 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb5280d0a10 0x7fb5280d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.378+0000 7fb52d000700 1 -- 172.21.15.82:0/2630862029 >> 172.21.15.82:0/2630862029 conn(0x7fb52806c5a0 msgr2=0x7fb52806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.378+0000 7fb52d000700 1 -- 172.21.15.82:0/2630862029 shutdown_connections 2024-05-10T04:52:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.378+0000 7fb52d000700 1 -- 172.21.15.82:0/2630862029 wait complete. 2024-05-10T04:52:20.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.380+0000 7fb52d000700 1 Processor -- start 2024-05-10T04:52:20.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.381+0000 7fb52d000700 1 -- start start 2024-05-10T04:52:20.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb52d000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5280b75f0 0x7fb5281540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb52d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280d0a10 0x7fb528153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb52d000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb52815e240 0x7fb5280cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb52d000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5281f50a0 con 0x7fb5280d0a10 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb52d000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528154800 con 0x7fb5280b75f0 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb52d000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb528155660 con 0x7fb52815e240 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb51fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280d0a10 0x7fb528153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb51fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280d0a10 0x7fb528153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44464/0 (socket says 172.21.15.82:44464) 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb51fe00700 1 -- 172.21.15.82:0/1062466125 learned_addr learned my addr 172.21.15.82:0/1062466125 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb527400700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5280b75f0 0x7fb5281540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.382+0000 7fb527e00700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb52815e240 0x7fb5280cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51fe00700 1 -- 172.21.15.82:0/1062466125 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb52815e240 msgr2=0x7fb5280cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51fe00700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb52815e240 0x7fb5280cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51fe00700 1 -- 172.21.15.82:0/1062466125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5280b75f0 msgr2=0x7fb5281540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51fe00700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5280b75f0 0x7fb5281540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51fe00700 1 -- 172.21.15.82:0/1062466125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb520009b30 con 0x7fb5280d0a10 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb527e00700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb52815e240 0x7fb5280cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb527400700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb5280b75f0 0x7fb5281540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51fe00700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280d0a10 0x7fb528153670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb51000d800 tx=0x7fb51000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5100125f0 con 0x7fb5280d0a10 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb510012750 con 0x7fb5280d0a10 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb528154a50 con 0x7fb5280d0a10 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510012ae0 con 0x7fb5280d0a10 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.383+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb528155010 con 0x7fb5280d0a10 2024-05-10T04:52:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.384+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5280d3440 con 0x7fb5280d0a10 2024-05-10T04:52:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.386+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb510012c40 con 0x7fb5280d0a10 2024-05-10T04:52:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.386+0000 7fb51f400700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb50406ac90 0x7fb50406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.386+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb510089f30 con 0x7fb5280d0a10 2024-05-10T04:52:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.387+0000 7fb527400700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb50406ac90 0x7fb50406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.387+0000 7fb51f400700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7fb504070be0 0x7fb504073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.387+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 --> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb504073700 con 0x7fb504070be0 2024-05-10T04:52:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.387+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb51008a2a0 con 0x7fb5280d0a10 2024-05-10T04:52:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.387+0000 7fb527e00700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7fb504070be0 0x7fb504073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.387+0000 7fb527400700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb50406ac90 0x7fb50406d1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb5280d0600 tx=0x7fb518008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.388+0000 7fb527e00700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7fb504070be0 0x7fb504073030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.388+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 <== osd.0 v2:172.21.15.82:6808/43965 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb504073700 con 0x7fb504070be0 2024-05-10T04:52:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.403+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 --> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb5280d3160 con 0x7fb504070be0 2024-05-10T04:52:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb51f400700 1 -- 172.21.15.82:0/1062466125 <== osd.0 v2:172.21.15.82:6808/43965 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb5200095f0 con 0x7fb504070be0 2024-05-10T04:52:20.405 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:52:20.406 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7fb504070be0 msgr2=0x7fb504073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6808/43965,v1:172.21.15.82:6809/43965] conn(0x7fb504070be0 0x7fb504073030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb50406ac90 msgr2=0x7fb50406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb50406ac90 0x7fb50406d1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb5280d0600 tx=0x7fb518008040 comp rx=0 tx=0).stop 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280d0a10 msgr2=0x7fb528153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 --2- 172.21.15.82:0/1062466125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5280d0a10 0x7fb528153670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb51000d800 tx=0x7fb51000dbc0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb527e00700 1 -- 172.21.15.82:0/1062466125 reap_dead start 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 shutdown_connections 2024-05-10T04:52:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 >> 172.21.15.82:0/1062466125 conn(0x7fb52806c5a0 msgr2=0x7fb5280d3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 shutdown_connections 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.404+0000 7fb52d000700 1 -- 172.21.15.82:0/1062466125 wait complete. 2024-05-10T04:52:20.431 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-10T04:52:20.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.693+0000 7f9a16000700 1 Processor -- start 2024-05-10T04:52:20.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.693+0000 7f9a16000700 1 -- start start 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.695+0000 7f9a16000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a100b3090 0x7f9a100ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.695+0000 7f9a16000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100d0990 0x7f9a100d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.695+0000 7f9a16000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a100b5bb0 con 0x7f9a10161d40 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.695+0000 7f9a16000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a100cf6d0 con 0x7f9a100b3090 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.695+0000 7f9a16000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100d12e0 con 0x7f9a100d0990 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.695+0000 7f9a0fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a100b3090 0x7f9a100ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a100b3090 0x7f9a100ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44470/0 (socket says 172.21.15.82:44470) 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0fe00700 1 -- 172.21.15.82:0/12046413 learned_addr learned my addr 172.21.15.82:0/12046413 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a15600700 1 --2- 172.21.15.82:0/12046413 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100d0990 0x7f9a100d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0fe00700 1 -- 172.21.15.82:0/12046413 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100d0990 msgr2=0x7f9a100d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0fe00700 1 --2- 172.21.15.82:0/12046413 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100d0990 0x7f9a100d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0fe00700 1 -- 172.21.15.82:0/12046413 >> v1:172.21.15.129:6789/0 conn(0x7f9a10161d40 legacy=0x7f9a100b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0fe00700 1 -- 172.21.15.82:0/12046413 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100cf110 con 0x7f9a100b3090 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a15600700 1 --2- 172.21.15.82:0/12046413 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100d0990 0x7f9a100d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0fe00700 1 --2- 172.21.15.82:0/12046413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100b3090 0x7f9a100ce7a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0098f0 tx=0x7f99fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7def9c3704351652 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0f400700 1 -- 172.21.15.82:0/12046413 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc004230 con 0x7f9a100b3090 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0f400700 1 -- 172.21.15.82:0/12046413 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc004390 con 0x7f9a100b3090 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.696+0000 7f9a0f400700 1 -- 172.21.15.82:0/12046413 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0036a0 con 0x7f9a100b3090 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.697+0000 7f9a16000700 1 -- 172.21.15.82:0/12046413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100b3090 msgr2=0x7f9a100ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.697+0000 7f9a16000700 1 --2- 172.21.15.82:0/12046413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100b3090 0x7f9a100ce7a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0098f0 tx=0x7f99fc009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.697+0000 7f9a16000700 1 -- 172.21.15.82:0/12046413 shutdown_connections 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.697+0000 7f9a16000700 1 --2- 172.21.15.82:0/12046413 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100d0990 0x7f9a100d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.697+0000 7f9a16000700 1 --2- 172.21.15.82:0/12046413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100b3090 0x7f9a100ce7a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.697+0000 7f9a16000700 1 -- 172.21.15.82:0/12046413 >> 172.21.15.82:0/12046413 conn(0x7f9a1006c580 msgr2=0x7f9a1006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.697+0000 7f9a16000700 1 -- 172.21.15.82:0/12046413 shutdown_connections 2024-05-10T04:52:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.697+0000 7f9a16000700 1 -- 172.21.15.82:0/12046413 wait complete. 2024-05-10T04:52:20.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.700+0000 7f9a16000700 1 Processor -- start 2024-05-10T04:52:20.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.700+0000 7f9a16000700 1 -- start start 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a16000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100b3090 0x7f9a100b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a16000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100d0990 0x7f9a100b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a16000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a10161d40 0x7f9a100cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a16000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a101f6090 con 0x7f9a100d0990 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a16000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10159170 con 0x7f9a10161d40 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a16000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a101593c0 con 0x7f9a100b3090 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a0fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100d0990 0x7f9a100b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a0fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100d0990 0x7f9a100b8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44486/0 (socket says 172.21.15.82:44486) 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.702+0000 7f9a0fe00700 1 -- 172.21.15.82:0/2381992228 learned_addr learned my addr 172.21.15.82:0/2381992228 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a15600700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a10161d40 0x7f9a100cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a14c00700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100b3090 0x7f9a100b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0fe00700 1 -- 172.21.15.82:0/2381992228 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100b3090 msgr2=0x7f9a100b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0fe00700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100b3090 0x7f9a100b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0fe00700 1 -- 172.21.15.82:0/2381992228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a10161d40 msgr2=0x7f9a100cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0fe00700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a10161d40 0x7f9a100cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0fe00700 1 -- 172.21.15.82:0/2381992228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc009550 con 0x7f9a100d0990 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0fe00700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100d0990 0x7f9a100b8b20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009130 tx=0x7f99fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0cc00700 1 -- 172.21.15.82:0/2381992228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00b860 con 0x7f9a100d0990 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0cc00700 1 -- 172.21.15.82:0/2381992228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc00b9c0 con 0x7f9a100d0990 2024-05-10T04:52:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a101596a0 con 0x7f9a100d0990 2024-05-10T04:52:20.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a0cc00700 1 -- 172.21.15.82:0/2381992228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00bd70 con 0x7f9a100d0990 2024-05-10T04:52:20.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.703+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a10159c60 con 0x7f9a100d0990 2024-05-10T04:52:20.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.704+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a10074af0 con 0x7f9a100d0990 2024-05-10T04:52:20.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.705+0000 7f9a0cc00700 1 -- 172.21.15.82:0/2381992228 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f99fc01b440 con 0x7f9a100d0990 2024-05-10T04:52:20.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.706+0000 7f9a0cc00700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99f006ac90 0x7f99f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.706+0000 7f9a0cc00700 1 -- 172.21.15.82:0/2381992228 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f99fc08ab30 con 0x7f9a100d0990 2024-05-10T04:52:20.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.707+0000 7f9a14c00700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99f006ac90 0x7f99f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.707+0000 7f9a14c00700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99f006ac90 0x7f99f006d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009870 tx=0x7f9a04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.712+0000 7f9a0cc00700 1 -- 172.21.15.82:0/2381992228 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f99fc055fa0 con 0x7f9a100d0990 2024-05-10T04:52:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.916+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a100b5840 con 0x7f99f006ac90 2024-05-10T04:52:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.917+0000 7f9a0cc00700 1 -- 172.21.15.82:0/2381992228 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9a04014430 con 0x7f99f006ac90 2024-05-10T04:52:20.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99f006ac90 msgr2=0x7f99f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99f006ac90 0x7f99f006d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009870 tx=0x7f9a04008040 comp rx=0 tx=0).stop 2024-05-10T04:52:20.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100d0990 msgr2=0x7f9a100b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100d0990 0x7f9a100b8b20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009130 tx=0x7f99fc004750 comp rx=0 tx=0).stop 2024-05-10T04:52:20.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 shutdown_connections 2024-05-10T04:52:20.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f99f006ac90 0x7f99f006d1a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9a10161d40 0x7f9a100cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f9a100b3090 0x7f9a100b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 --2- 172.21.15.82:0/2381992228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a100d0990 0x7f9a100b8b20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 >> 172.21.15.82:0/2381992228 conn(0x7f9a1006c580 msgr2=0x7f9a100d1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:20.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 shutdown_connections 2024-05-10T04:52:20.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:20.919+0000 7f9a16000700 1 -- 172.21.15.82:0/2381992228 wait complete. 2024-05-10T04:52:20.924 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 0 to deep-scrub 2024-05-10T04:52:20.949 INFO:tasks.ceph:Scrubbing osd.1 2024-05-10T04:52:20.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:52:21.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.218+0000 7ff572000700 1 Processor -- start 2024-05-10T04:52:21.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.218+0000 7ff572000700 1 -- start start 2024-05-10T04:52:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff572000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff56c0b33e0 0x7ff56c0d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff572000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff56c162090 0x7ff56c1624a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff572000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c162d80 con 0x7ff56c0b5970 2024-05-10T04:52:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff572000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0b37f0 con 0x7ff56c162090 2024-05-10T04:52:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff572000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0d2970 con 0x7ff56c0b33e0 2024-05-10T04:52:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff56be00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff56c162090 0x7ff56c1624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff56aa00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff56c0b5970 0x7ff56c0b5d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47980/0 (socket says 172.21.15.82:47980) 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff56aa00700 1 -- 172.21.15.82:0/3009708400 learned_addr learned my addr 172.21.15.82:0/3009708400 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff56b400700 1 --2- 172.21.15.82:0/3009708400 >> v2:172.21.15.129:3300/0 conn(0x7ff56c0b33e0 0x7ff56c0d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff56be00700 1 -- 172.21.15.82:0/3009708400 >> v2:172.21.15.129:3300/0 conn(0x7ff56c0b33e0 msgr2=0x7ff56c0d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff56be00700 1 --2- 172.21.15.82:0/3009708400 >> v2:172.21.15.129:3300/0 conn(0x7ff56c0b33e0 0x7ff56c0d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.220+0000 7ff56be00700 1 -- 172.21.15.82:0/3009708400 >> v1:172.21.15.82:6789/0 conn(0x7ff56c0b5970 legacy=0x7ff56c0b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.221+0000 7ff56be00700 1 -- 172.21.15.82:0/3009708400 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0d2c50 con 0x7ff56c162090 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.221+0000 7ff56a000700 1 -- 172.21.15.82:0/3009708400 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893876173 0 0) 0x7ff56c162d80 con 0x7ff56c0b5970 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.221+0000 7ff56be00700 1 --2- 172.21.15.82:0/3009708400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c162090 0x7ff56c1624a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff56c06d630 tx=0x7ff56400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cce25aa10deeb0d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.221+0000 7ff56a000700 1 -- 172.21.15.82:0/3009708400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400e070 con 0x7ff56c162090 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.221+0000 7ff56a000700 1 -- 172.21.15.82:0/3009708400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400bb20 con 0x7ff56c162090 2024-05-10T04:52:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.221+0000 7ff56a000700 1 -- 172.21.15.82:0/3009708400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564012430 con 0x7ff56c162090 2024-05-10T04:52:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.222+0000 7ff572000700 1 -- 172.21.15.82:0/3009708400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c162090 msgr2=0x7ff56c1624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.222+0000 7ff572000700 1 --2- 172.21.15.82:0/3009708400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c162090 0x7ff56c1624a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff56c06d630 tx=0x7ff56400b330 comp rx=0 tx=0).stop 2024-05-10T04:52:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.222+0000 7ff572000700 1 -- 172.21.15.82:0/3009708400 shutdown_connections 2024-05-10T04:52:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.222+0000 7ff572000700 1 --2- 172.21.15.82:0/3009708400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c162090 0x7ff56c1624a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.222+0000 7ff572000700 1 --2- 172.21.15.82:0/3009708400 >> v2:172.21.15.129:3300/0 conn(0x7ff56c0b33e0 0x7ff56c0d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.222+0000 7ff572000700 1 -- 172.21.15.82:0/3009708400 >> 172.21.15.82:0/3009708400 conn(0x7ff56c0d0b50 msgr2=0x7ff56c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.222+0000 7ff572000700 1 -- 172.21.15.82:0/3009708400 shutdown_connections 2024-05-10T04:52:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.222+0000 7ff572000700 1 -- 172.21.15.82:0/3009708400 wait complete. 2024-05-10T04:52:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.224+0000 7ff572000700 1 Processor -- start 2024-05-10T04:52:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.224+0000 7ff572000700 1 -- start start 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff572000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff56c0b33e0 0x7ff56c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff572000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c0b5970 0x7ff56c157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff572000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff56c162090 0x7ff56c158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff572000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c147c10 con 0x7ff56c0b5970 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff572000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c15ae90 con 0x7ff56c162090 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff572000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c146440 con 0x7ff56c0b33e0 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c0b5970 0x7ff56c157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c0b5970 0x7ff56c157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44508/0 (socket says 172.21.15.82:44508) 2024-05-10T04:52:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56aa00700 1 -- 172.21.15.82:0/12585739 learned_addr learned my addr 172.21.15.82:0/12585739 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56b400700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff56c0b33e0 0x7ff56c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56be00700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff56c162090 0x7ff56c158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56aa00700 1 -- 172.21.15.82:0/12585739 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff56c0b33e0 msgr2=0x7ff56c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56aa00700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff56c0b33e0 0x7ff56c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56aa00700 1 -- 172.21.15.82:0/12585739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff56c162090 msgr2=0x7ff56c158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.226+0000 7ff56aa00700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff56c162090 0x7ff56c158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.227+0000 7ff56aa00700 1 -- 172.21.15.82:0/12585739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009a70 con 0x7ff56c0b5970 2024-05-10T04:52:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.227+0000 7ff56aa00700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c0b5970 0x7ff56c157d20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff55800c580 tx=0x7ff55800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.227+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558004c80 con 0x7ff56c0b5970 2024-05-10T04:52:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.227+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558004e00 con 0x7ff56c0b5970 2024-05-10T04:52:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.227+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c0aaf40 con 0x7ff56c0b5970 2024-05-10T04:52:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.227+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558007310 con 0x7ff56c0b5970 2024-05-10T04:52:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.227+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c0aa980 con 0x7ff56c0b5970 2024-05-10T04:52:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.228+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff56c0b7350 con 0x7ff56c0b5970 2024-05-10T04:52:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.229+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff558007470 con 0x7ff56c0b5970 2024-05-10T04:52:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.230+0000 7ff563400700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff54c06ac90 0x7ff54c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.230+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff558088d90 con 0x7ff56c0b5970 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.230+0000 7ff563400700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7ff54c070be0 0x7ff54c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.230+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 --> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff54c073700 con 0x7ff54c070be0 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.230+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff55808b370 con 0x7ff56c0b5970 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.230+0000 7ff56b400700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff54c06ac90 0x7ff54c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.231+0000 7ff56be00700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7ff54c070be0 0x7ff54c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.231+0000 7ff56b400700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff54c06ac90 0x7ff54c06d1a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff56c161ff0 tx=0x7ff55c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.231+0000 7ff56be00700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7ff54c070be0 0x7ff54c073030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.232+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 <== osd.1 v2:172.21.15.82:6800/43969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff54c073700 con 0x7ff54c070be0 2024-05-10T04:52:21.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.247+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 --> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff56c146580 con 0x7ff54c070be0 2024-05-10T04:52:21.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.247+0000 7ff563400700 1 -- 172.21.15.82:0/12585739 <== osd.1 v2:172.21.15.82:6800/43969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff564003b20 con 0x7ff54c070be0 2024-05-10T04:52:21.249 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:21.249 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:52:21.249 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:21.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7ff54c070be0 msgr2=0x7ff54c073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6800/43969,v1:172.21.15.82:6801/43969] conn(0x7ff54c070be0 0x7ff54c073030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff54c06ac90 msgr2=0x7ff54c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff54c06ac90 0x7ff54c06d1a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff56c161ff0 tx=0x7ff55c009210 comp rx=0 tx=0).stop 2024-05-10T04:52:21.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c0b5970 msgr2=0x7ff56c157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 --2- 172.21.15.82:0/12585739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff56c0b5970 0x7ff56c157d20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff55800c580 tx=0x7ff55800c890 comp rx=0 tx=0).stop 2024-05-10T04:52:21.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff56be00700 1 -- 172.21.15.82:0/12585739 reap_dead start 2024-05-10T04:52:21.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 shutdown_connections 2024-05-10T04:52:21.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 >> 172.21.15.82:0/12585739 conn(0x7ff56c0d0b50 msgr2=0x7ff56c0b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 shutdown_connections 2024-05-10T04:52:21.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.248+0000 7ff572000700 1 -- 172.21.15.82:0/12585739 wait complete. 2024-05-10T04:52:21.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-10T04:52:21.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.535+0000 7fd212a00700 1 Processor -- start 2024-05-10T04:52:21.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.535+0000 7fd212a00700 1 -- start start 2024-05-10T04:52:21.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.537+0000 7fd212a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c0cb0e0 0x7fd20c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.537+0000 7fd212a00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd20c06b340 0x7fd20c161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.537+0000 7fd212a00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0b20e0 con 0x7fd20c0b6270 2024-05-10T04:52:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.537+0000 7fd212a00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c0b13c0 con 0x7fd20c06b340 2024-05-10T04:52:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.537+0000 7fd212a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0ceab0 con 0x7fd20c0cb0e0 2024-05-10T04:52:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.537+0000 7fd20b400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd20c0b6270 0x7fd20c06ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47986/0 (socket says 172.21.15.82:47986) 2024-05-10T04:52:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.537+0000 7fd20b400700 1 -- 172.21.15.82:0/4097888692 learned_addr learned my addr 172.21.15.82:0/4097888692 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20be00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c0cb0e0 0x7fd20c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402360969 0 0) 0x7fd20c0b20e0 con 0x7fd20c0b6270 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd210a00700 1 --2- 172.21.15.82:0/4097888692 >> v2:172.21.15.129:3300/0 conn(0x7fd20c06b340 0x7fd20c161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f00035b0 con 0x7fd20c0b6270 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3154591811 0 0) 0x7fd1f00035b0 con 0x7fd20c0b6270 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c0cb0e0 msgr2=0x7fd20c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c0cb0e0 0x7fd20c0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 >> v2:172.21.15.129:3300/0 conn(0x7fd20c06b340 msgr2=0x7fd20c161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 --2- 172.21.15.82:0/4097888692 >> v2:172.21.15.129:3300/0 conn(0x7fd20c06b340 0x7fd20c161fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c15e8b0 con 0x7fd20c0b6270 2024-05-10T04:52:21.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fd1f8001670 con 0x7fd20c0b6270 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 >> v1:172.21.15.82:6789/0 conn(0x7fd20c0b6270 legacy=0x7fd20c06ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c0cb0e0 0x7fd1f0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1f0003f80 0x7fd1f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1f0004d90 0x7fd1f00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0b13c0 con 0x7fd1f0004d90 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f000ba10 con 0x7fd1f0003f80 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.538+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f000bba0 con 0x7fd20c0cb0e0 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd210a00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1f0004d90 0x7fd1f00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd20be00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c0cb0e0 0x7fd1f0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd20b400700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1f0003f80 0x7fd1f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd210a00700 1 -- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c0cb0e0 msgr2=0x7fd1f0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd210a00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c0cb0e0 0x7fd1f0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd210a00700 1 -- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1f0003f80 msgr2=0x7fd1f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd210a00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1f0003f80 0x7fd1f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd210a00700 1 -- 172.21.15.82:0/4097888692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f00035b0 con 0x7fd1f0004d90 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd20b400700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd1f0003f80 0x7fd1f0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd210a00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1f0004d90 0x7fd1f00051a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0ce590 tx=0x7fd1f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fef3ea368368aa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400eba0 con 0x7fd1f0004d90 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.539+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400f040 con 0x7fd1f0004d90 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.540+0000 7fd20aa00700 1 -- 172.21.15.82:0/4097888692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204014480 con 0x7fd1f0004d90 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.540+0000 7fd212a00700 1 -- 172.21.15.82:0/4097888692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1f0004d90 msgr2=0x7fd1f00051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.540+0000 7fd212a00700 1 --2- 172.21.15.82:0/4097888692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1f0004d90 0x7fd1f00051a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0ce590 tx=0x7fd1f0005880 comp rx=0 tx=0).stop 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.540+0000 7fd210a00700 1 -- 172.21.15.82:0/4097888692 reap_dead start 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.540+0000 7fd212a00700 1 -- 172.21.15.82:0/4097888692 shutdown_connections 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.540+0000 7fd212a00700 1 -- 172.21.15.82:0/4097888692 >> 172.21.15.82:0/4097888692 conn(0x7fd20c0d0a90 msgr2=0x7fd20c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.540+0000 7fd212a00700 1 -- 172.21.15.82:0/4097888692 shutdown_connections 2024-05-10T04:52:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.540+0000 7fd212a00700 1 -- 172.21.15.82:0/4097888692 wait complete. 2024-05-10T04:52:21.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.543+0000 7fd212a00700 1 Processor -- start 2024-05-10T04:52:21.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.543+0000 7fd212a00700 1 -- start start 2024-05-10T04:52:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.544+0000 7fd212a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c1502b0 0x7fd20c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.544+0000 7fd212a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20c0ca480 0x7fd20c161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.544+0000 7fd212a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd20c161690 0x7fd20c15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.544+0000 7fd212a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c160d30 con 0x7fd20c0ca480 2024-05-10T04:52:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.544+0000 7fd212a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15a4d0 con 0x7fd20c161690 2024-05-10T04:52:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.544+0000 7fd212a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15ff90 con 0x7fd20c1502b0 2024-05-10T04:52:21.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.544+0000 7fd20b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20c0ca480 0x7fd20c161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd20b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20c0ca480 0x7fd20c161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44534/0 (socket says 172.21.15.82:44534) 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd20b400700 1 -- 172.21.15.82:0/219425376 learned_addr learned my addr 172.21.15.82:0/219425376 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd20b400700 1 -- 172.21.15.82:0/219425376 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c1502b0 msgr2=0x7fd20c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd20b400700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c1502b0 0x7fd20c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd20b400700 1 -- 172.21.15.82:0/219425376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd20c161690 msgr2=0x7fd20c15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd20b400700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd20c161690 0x7fd20c15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd20b400700 1 -- 172.21.15.82:0/219425376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c160230 con 0x7fd20c0ca480 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd20b400700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20c0ca480 0x7fd20c161150 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd20c06cf90 tx=0x7fd1f800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd203e00700 1 -- 172.21.15.82:0/219425376 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800c700 con 0x7fd20c0ca480 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd203e00700 1 -- 172.21.15.82:0/219425376 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f800c860 con 0x7fd20c0ca480 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd203e00700 1 -- 172.21.15.82:0/219425376 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800cbf0 con 0x7fd20c0ca480 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.545+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c160670 con 0x7fd20c0ca480 2024-05-10T04:52:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.546+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c0ca890 con 0x7fd20c0ca480 2024-05-10T04:52:21.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.547+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c074af0 con 0x7fd20c0ca480 2024-05-10T04:52:21.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.547+0000 7fd203e00700 1 -- 172.21.15.82:0/219425376 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd1f800cd50 con 0x7fd20c0ca480 2024-05-10T04:52:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.548+0000 7fd203e00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1ec06ac90 0x7fd1ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.548+0000 7fd203e00700 1 -- 172.21.15.82:0/219425376 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd1f8088f00 con 0x7fd20c0ca480 2024-05-10T04:52:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.549+0000 7fd20be00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1ec06ac90 0x7fd1ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.549+0000 7fd20be00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1ec06ac90 0x7fd1ec06d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0c7a90 tx=0x7fd1fc009670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.553+0000 7fd203e00700 1 -- 172.21.15.82:0/219425376 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd1f80542e0 con 0x7fd20c0ca480 2024-05-10T04:52:21.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.757+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd20c0caa20 con 0x7fd1ec06ac90 2024-05-10T04:52:21.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.757+0000 7fd203e00700 1 -- 172.21.15.82:0/219425376 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd20c0caa20 con 0x7fd1ec06ac90 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.759+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1ec06ac90 msgr2=0x7fd1ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.759+0000 7fd212a00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1ec06ac90 0x7fd1ec06d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0c7a90 tx=0x7fd1fc009670 comp rx=0 tx=0).stop 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20c0ca480 msgr2=0x7fd20c161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20c0ca480 0x7fd20c161150 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd20c06cf90 tx=0x7fd1f800ee80 comp rx=0 tx=0).stop 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 shutdown_connections 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd1ec06ac90 0x7fd1ec06d1a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd20c161690 0x7fd20c15baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd20c1502b0 0x7fd20c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 --2- 172.21.15.82:0/219425376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20c0ca480 0x7fd20c161150 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 >> 172.21.15.82:0/219425376 conn(0x7fd20c0d0a90 msgr2=0x7fd20c0cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 shutdown_connections 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:21.760+0000 7fd212a00700 1 -- 172.21.15.82:0/219425376 wait complete. 2024-05-10T04:52:21.763 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 1 to deep-scrub 2024-05-10T04:52:21.788 INFO:tasks.ceph:Scrubbing osd.2 2024-05-10T04:52:21.789 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:52:22.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.059+0000 7fb86f200700 1 Processor -- start 2024-05-10T04:52:22.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.059+0000 7fb86f200700 1 -- start start 2024-05-10T04:52:22.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.061+0000 7fb86f200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8700d0a10 0x7fb8700d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.061+0000 7fb86f200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700b7130 con 0x7fb87015e240 2024-05-10T04:52:22.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.061+0000 7fb86f200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700d1360 con 0x7fb8700b75f0 2024-05-10T04:52:22.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.061+0000 7fb86f200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700cebe0 con 0x7fb8700d0a10 2024-05-10T04:52:22.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.061+0000 7fb86de00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb87015e240 0x7fb8700d2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48002/0 (socket says 172.21.15.82:48002) 2024-05-10T04:52:22.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.061+0000 7fb86de00700 1 -- 172.21.15.82:0/2009363934 learned_addr learned my addr 172.21.15.82:0/2009363934 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:22.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.061+0000 7fb86d400700 1 --2- 172.21.15.82:0/2009363934 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8700d0a10 0x7fb8700d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.061+0000 7fb86ca00700 1 -- 172.21.15.82:0/2009363934 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180047975 0 0) 0x7fb8700b7130 con 0x7fb87015e240 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86ca00700 1 -- 172.21.15.82:0/2009363934 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8540035b0 con 0x7fb87015e240 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86ca00700 1 -- 172.21.15.82:0/2009363934 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736619928 0 0) 0x7fb8700d1360 con 0x7fb8700b75f0 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86d400700 1 -- 172.21.15.82:0/2009363934 >> v1:172.21.15.129:6789/0 conn(0x7fb8700b75f0 legacy=0x7fb8700b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86d400700 1 -- 172.21.15.82:0/2009363934 >> v1:172.21.15.82:6789/0 conn(0x7fb87015e240 legacy=0x7fb8700d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86d400700 1 -- 172.21.15.82:0/2009363934 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700d2ba0 con 0x7fb8700d0a10 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86d400700 1 --2- 172.21.15.82:0/2009363934 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8700d0a10 0x7fb8700d0e20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009870 tx=0x7fb85c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d68e60536075ff35 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86ca00700 1 -- 172.21.15.82:0/2009363934 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c011830 con 0x7fb8700d0a10 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86ca00700 1 -- 172.21.15.82:0/2009363934 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c011990 con 0x7fb8700d0a10 2024-05-10T04:52:22.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.062+0000 7fb86ca00700 1 -- 172.21.15.82:0/2009363934 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c011d20 con 0x7fb8700d0a10 2024-05-10T04:52:22.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.063+0000 7fb86f200700 1 -- 172.21.15.82:0/2009363934 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8700d0a10 msgr2=0x7fb8700d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.063+0000 7fb86f200700 1 --2- 172.21.15.82:0/2009363934 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8700d0a10 0x7fb8700d0e20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009870 tx=0x7fb85c009b80 comp rx=0 tx=0).stop 2024-05-10T04:52:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.063+0000 7fb86f200700 1 -- 172.21.15.82:0/2009363934 shutdown_connections 2024-05-10T04:52:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.063+0000 7fb86f200700 1 --2- 172.21.15.82:0/2009363934 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb8700d0a10 0x7fb8700d0e20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.063+0000 7fb86f200700 1 -- 172.21.15.82:0/2009363934 >> 172.21.15.82:0/2009363934 conn(0x7fb87006c5a0 msgr2=0x7fb87006c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.063+0000 7fb86f200700 1 -- 172.21.15.82:0/2009363934 shutdown_connections 2024-05-10T04:52:22.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.063+0000 7fb86f200700 1 -- 172.21.15.82:0/2009363934 wait complete. 2024-05-10T04:52:22.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.065+0000 7fb86f200700 1 Processor -- start 2024-05-10T04:52:22.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.065+0000 7fb86f200700 1 -- start start 2024-05-10T04:52:22.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86f200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8700b75f0 0x7fb870159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700d0a10 0x7fb87015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86f200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb87015e240 0x7fb870155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870156620 con 0x7fb8700d0a10 2024-05-10T04:52:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86f200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b6310 con 0x7fb8700b75f0 2024-05-10T04:52:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86f200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b6560 con 0x7fb87015e240 2024-05-10T04:52:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700d0a10 0x7fb87015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700d0a10 0x7fb87015a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44542/0 (socket says 172.21.15.82:44542) 2024-05-10T04:52:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86d400700 1 -- 172.21.15.82:0/3200466852 learned_addr learned my addr 172.21.15.82:0/3200466852 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86de00700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8700b75f0 0x7fb870159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.067+0000 7fb86e800700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb87015e240 0x7fb870155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb86d400700 1 -- 172.21.15.82:0/3200466852 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb87015e240 msgr2=0x7fb870155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb86d400700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb87015e240 0x7fb870155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb86d400700 1 -- 172.21.15.82:0/3200466852 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8700b75f0 msgr2=0x7fb870159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb86d400700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb8700b75f0 0x7fb870159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb86d400700 1 -- 172.21.15.82:0/3200466852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0094a0 con 0x7fb8700d0a10 2024-05-10T04:52:22.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb86d400700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700d0a10 0x7fb87015a0d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009bc0 tx=0x7fb85c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c01a7e0 con 0x7fb8700d0a10 2024-05-10T04:52:22.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c01a940 con 0x7fb8700d0a10 2024-05-10T04:52:22.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c01acf0 con 0x7fb8700d0a10 2024-05-10T04:52:22.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8700b4f80 con 0x7fb8700d0a10 2024-05-10T04:52:22.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.068+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8700b44a0 con 0x7fb8700d0a10 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.069+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8700ce250 con 0x7fb8700d0a10 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.070+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb85c022070 con 0x7fb8700d0a10 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.071+0000 7fb866000700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb85006acc0 0x7fb85006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.071+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb85c08a140 con 0x7fb8700d0a10 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.071+0000 7fb86de00700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb85006acc0 0x7fb85006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.072+0000 7fb866000700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7fb850070c10 0x7fb850073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.072+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 --> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb850073730 con 0x7fb850070c10 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.072+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb85c08a590 con 0x7fb8700d0a10 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.072+0000 7fb86e800700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7fb850070c10 0x7fb850073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.072+0000 7fb86de00700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb85006acc0 0x7fb85006d1d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb860007fd0 tx=0x7fb860009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.072+0000 7fb86e800700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7fb850070c10 0x7fb850073060 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.073+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 <== osd.2 v2:172.21.15.82:6813/43970 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb850073730 con 0x7fb850070c10 2024-05-10T04:52:22.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.088+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 --> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb8700d4b30 con 0x7fb850070c10 2024-05-10T04:52:22.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.088+0000 7fb866000700 1 -- 172.21.15.82:0/3200466852 <== osd.2 v2:172.21.15.82:6813/43970 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb8700d4b30 con 0x7fb850070c10 2024-05-10T04:52:22.090 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:22.090 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:52:22.091 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:22.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7fb850070c10 msgr2=0x7fb850073060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6813/43970,v1:172.21.15.82:6815/43970] conn(0x7fb850070c10 0x7fb850073060 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb85006acc0 msgr2=0x7fb85006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb85006acc0 0x7fb85006d1d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb860007fd0 tx=0x7fb860009040 comp rx=0 tx=0).stop 2024-05-10T04:52:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700d0a10 msgr2=0x7fb87015a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 --2- 172.21.15.82:0/3200466852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700d0a10 0x7fb87015a0d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009bc0 tx=0x7fb85c004750 comp rx=0 tx=0).stop 2024-05-10T04:52:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86e800700 1 -- 172.21.15.82:0/3200466852 reap_dead start 2024-05-10T04:52:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 shutdown_connections 2024-05-10T04:52:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 >> 172.21.15.82:0/3200466852 conn(0x7fb87006c5a0 msgr2=0x7fb87015ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 shutdown_connections 2024-05-10T04:52:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.089+0000 7fb86f200700 1 -- 172.21.15.82:0/3200466852 wait complete. 2024-05-10T04:52:22.117 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-10T04:52:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.378+0000 7f1738a00700 1 Processor -- start 2024-05-10T04:52:22.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.379+0000 7f1738a00700 1 -- start start 2024-05-10T04:52:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1738a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 0x7f17340b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1738a00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17340b5bf0 0x7f17340b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1738a00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173415f960 con 0x7f17340d2710 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1738a00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340b6540 con 0x7f17340b5bf0 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1738a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173415f680 con 0x7f1734162bc0 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1731400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17340b5bf0 0x7f17340b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1732800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f17340d2710 0x7f17340d2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48014/0 (socket says 172.21.15.82:48014) 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1732800700 1 -- 172.21.15.82:0/3876773323 learned_addr learned my addr 172.21.15.82:0/3876773323 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1731e00700 1 --2- 172.21.15.82:0/3876773323 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 0x7f17340b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1731400700 1 -- 172.21.15.82:0/3876773323 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 msgr2=0x7f17340b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1731400700 1 --2- 172.21.15.82:0/3876773323 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 0x7f17340b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1731400700 1 -- 172.21.15.82:0/3876773323 >> v1:172.21.15.82:6789/0 conn(0x7f17340d2710 legacy=0x7f17340d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1731400700 1 -- 172.21.15.82:0/3876773323 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17341620e0 con 0x7f17340b5bf0 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.381+0000 7f1730a00700 1 -- 172.21.15.82:0/3876773323 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969806219 0 0) 0x7f173415f960 con 0x7f17340d2710 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.382+0000 7f1731400700 1 --2- 172.21.15.82:0/3876773323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340b5bf0 0x7f17340b6000 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1720009820 tx=0x7f1720009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4695469eca81f6c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.382+0000 7f1730a00700 1 -- 172.21.15.82:0/3876773323 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720005e30 con 0x7f17340b5bf0 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.382+0000 7f1730a00700 1 -- 172.21.15.82:0/3876773323 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720006030 con 0x7f17340b5bf0 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.382+0000 7f1730a00700 1 -- 172.21.15.82:0/3876773323 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200063c0 con 0x7f17340b5bf0 2024-05-10T04:52:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.383+0000 7f1738a00700 1 -- 172.21.15.82:0/3876773323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340b5bf0 msgr2=0x7f17340b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.383+0000 7f1738a00700 1 --2- 172.21.15.82:0/3876773323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340b5bf0 0x7f17340b6000 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1720009820 tx=0x7f1720009b30 comp rx=0 tx=0).stop 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.383+0000 7f1738a00700 1 -- 172.21.15.82:0/3876773323 shutdown_connections 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.383+0000 7f1738a00700 1 --2- 172.21.15.82:0/3876773323 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 0x7f17340b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.383+0000 7f1738a00700 1 --2- 172.21.15.82:0/3876773323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340b5bf0 0x7f17340b6000 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.383+0000 7f1738a00700 1 -- 172.21.15.82:0/3876773323 >> 172.21.15.82:0/3876773323 conn(0x7f17340d0c30 msgr2=0x7f17340d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.383+0000 7f1738a00700 1 -- 172.21.15.82:0/3876773323 shutdown_connections 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.383+0000 7f1738a00700 1 -- 172.21.15.82:0/3876773323 wait complete. 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.385+0000 7f1738a00700 1 Processor -- start 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.385+0000 7f1738a00700 1 -- start start 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1738a00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17340b5bf0 0x7f173414d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1738a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340d2710 0x7f1734157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1738a00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 0x7f1734158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1738a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1734158f70 con 0x7f17340d2710 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1738a00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341f6470 con 0x7f17340b5bf0 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1738a00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173414d6c0 con 0x7f1734162bc0 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340d2710 0x7f1734157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340d2710 0x7f1734157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44572/0 (socket says 172.21.15.82:44572) 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731400700 1 -- 172.21.15.82:0/3237257692 learned_addr learned my addr 172.21.15.82:0/3237257692 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1732800700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 0x7f1734158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731e00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17340b5bf0 0x7f173414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731400700 1 -- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 msgr2=0x7f1734158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731400700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 0x7f1734158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731400700 1 -- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17340b5bf0 msgr2=0x7f173414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731400700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17340b5bf0 0x7f173414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731400700 1 -- 172.21.15.82:0/3237257692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720009430 con 0x7f17340d2710 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.387+0000 7f1731e00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17340b5bf0 0x7f173414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.388+0000 7f1731400700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340d2710 0x7f1734157c30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f17340b6980 tx=0x7f1720004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.388+0000 7f172a000700 1 -- 172.21.15.82:0/3237257692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200063a0 con 0x7f17340d2710 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.388+0000 7f172a000700 1 -- 172.21.15.82:0/3237257692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720020070 con 0x7f17340d2710 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.388+0000 7f172a000700 1 -- 172.21.15.82:0/3237257692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720006760 con 0x7f17340d2710 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.388+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17341f66c0 con 0x7f17340d2710 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.388+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17341f6c80 con 0x7f17340d2710 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.389+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1734074af0 con 0x7f17340d2710 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.390+0000 7f172a000700 1 -- 172.21.15.82:0/3237257692 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1720022030 con 0x7f17340d2710 2024-05-10T04:52:22.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.391+0000 7f172a000700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f171406ac90 0x7f171406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.391+0000 7f172a000700 1 -- 172.21.15.82:0/3237257692 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f172008a690 con 0x7f17340d2710 2024-05-10T04:52:22.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.391+0000 7f1731e00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f171406ac90 0x7f171406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.392+0000 7f1731e00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f171406ac90 0x7f171406d1a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1724009b90 tx=0x7f1724008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.396+0000 7f172a000700 1 -- 172.21.15.82:0/3237257692 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1720055a70 con 0x7f17340d2710 2024-05-10T04:52:22.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.596+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1734161d60 con 0x7f171406ac90 2024-05-10T04:52:22.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.596+0000 7f172a000700 1 -- 172.21.15.82:0/3237257692 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1734161d60 con 0x7f171406ac90 2024-05-10T04:52:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f171406ac90 msgr2=0x7f171406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f171406ac90 0x7f171406d1a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1724009b90 tx=0x7f1724008040 comp rx=0 tx=0).stop 2024-05-10T04:52:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340d2710 msgr2=0x7f1734157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340d2710 0x7f1734157c30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f17340b6980 tx=0x7f1720004750 comp rx=0 tx=0).stop 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 shutdown_connections 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f171406ac90 0x7f171406d1a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1734162bc0 0x7f1734158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f17340b5bf0 0x7f173414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 --2- 172.21.15.82:0/3237257692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17340d2710 0x7f1734157c30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 >> 172.21.15.82:0/3237257692 conn(0x7f17340d0c30 msgr2=0x7f17340d3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 shutdown_connections 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.599+0000 7f1738a00700 1 -- 172.21.15.82:0/3237257692 wait complete. 2024-05-10T04:52:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 2 to deep-scrub 2024-05-10T04:52:22.629 INFO:tasks.ceph:Scrubbing osd.3 2024-05-10T04:52:22.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:52:22.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.895+0000 7fce8e800700 1 Processor -- start 2024-05-10T04:52:22.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.895+0000 7fce8e800700 1 -- start start 2024-05-10T04:52:22.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.897+0000 7fce8e800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce8815e5e0 0x7fce88161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.897+0000 7fce8e800700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce881626b0 con 0x7fce880b5c10 2024-05-10T04:52:22.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.897+0000 7fce8e800700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce88162990 con 0x7fce880cea50 2024-05-10T04:52:22.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.897+0000 7fce8e800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880cada0 con 0x7fce8815e5e0 2024-05-10T04:52:22.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.897+0000 7fce87e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fce880b5c10 0x7fce880b6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48020/0 (socket says 172.21.15.82:48020) 2024-05-10T04:52:22.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.897+0000 7fce87e00700 1 -- 172.21.15.82:0/1423234075 learned_addr learned my addr 172.21.15.82:0/1423234075 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:22.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.897+0000 7fce87400700 1 --2- 172.21.15.82:0/1423234075 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce8815e5e0 0x7fce88161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce86000700 1 -- 172.21.15.82:0/1423234075 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214051080 0 0) 0x7fce881626b0 con 0x7fce880b5c10 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce86000700 1 -- 172.21.15.82:0/1423234075 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce6c0035b0 con 0x7fce880b5c10 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce86000700 1 -- 172.21.15.82:0/1423234075 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518152514 0 0) 0x7fce88162990 con 0x7fce880cea50 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce87400700 1 -- 172.21.15.82:0/1423234075 >> v1:172.21.15.129:6789/0 conn(0x7fce880cea50 legacy=0x7fce880b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce87400700 1 -- 172.21.15.82:0/1423234075 >> v1:172.21.15.82:6789/0 conn(0x7fce880b5c10 legacy=0x7fce880b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce87400700 1 -- 172.21.15.82:0/1423234075 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce88162c70 con 0x7fce8815e5e0 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce87400700 1 --2- 172.21.15.82:0/1423234075 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce8815e5e0 0x7fce88161f60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce78009870 tx=0x7fce78009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df09bc7574440fbc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce86000700 1 -- 172.21.15.82:0/1423234075 <== mon.2 v2:172.21.15.129:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78011830 con 0x7fce8815e5e0 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.898+0000 7fce86000700 1 -- 172.21.15.82:0/1423234075 <== mon.2 v2:172.21.15.129:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78011990 con 0x7fce8815e5e0 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.899+0000 7fce86000700 1 -- 172.21.15.82:0/1423234075 <== mon.2 v2:172.21.15.129:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78011d00 con 0x7fce8815e5e0 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.899+0000 7fce8e800700 1 -- 172.21.15.82:0/1423234075 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce8815e5e0 msgr2=0x7fce88161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.899+0000 7fce8e800700 1 --2- 172.21.15.82:0/1423234075 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce8815e5e0 0x7fce88161f60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce78009870 tx=0x7fce78009b80 comp rx=0 tx=0).stop 2024-05-10T04:52:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.899+0000 7fce8e800700 1 -- 172.21.15.82:0/1423234075 shutdown_connections 2024-05-10T04:52:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.899+0000 7fce8e800700 1 --2- 172.21.15.82:0/1423234075 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce8815e5e0 0x7fce88161f60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.899+0000 7fce8e800700 1 -- 172.21.15.82:0/1423234075 >> 172.21.15.82:0/1423234075 conn(0x7fce880d0cd0 msgr2=0x7fce880d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.899+0000 7fce8e800700 1 -- 172.21.15.82:0/1423234075 shutdown_connections 2024-05-10T04:52:22.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.899+0000 7fce8e800700 1 -- 172.21.15.82:0/1423234075 wait complete. 2024-05-10T04:52:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.902+0000 7fce8e800700 1 Processor -- start 2024-05-10T04:52:22.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.902+0000 7fce8e800700 1 -- start start 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.903+0000 7fce8e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce880b5c10 0x7fce880ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.903+0000 7fce8e800700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce880cea50 0x7fce88149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.903+0000 7fce8e800700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce8815e5e0 0x7fce880b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.903+0000 7fce8e800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880c9e30 con 0x7fce880b5c10 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.903+0000 7fce8e800700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880cd600 con 0x7fce8815e5e0 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.903+0000 7fce8e800700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880c80a0 con 0x7fce880cea50 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.903+0000 7fce87400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce880b5c10 0x7fce880ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.903+0000 7fce87400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce880b5c10 0x7fce880ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44576/0 (socket says 172.21.15.82:44576) 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87400700 1 -- 172.21.15.82:0/45738138 learned_addr learned my addr 172.21.15.82:0/45738138 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87400700 1 -- 172.21.15.82:0/45738138 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce880cea50 msgr2=0x7fce88149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87400700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fce880cea50 0x7fce88149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87400700 1 -- 172.21.15.82:0/45738138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce8815e5e0 msgr2=0x7fce880b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87e00700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce8815e5e0 0x7fce880b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87400700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce8815e5e0 0x7fce880b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87400700 1 -- 172.21.15.82:0/45738138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce780094a0 con 0x7fce880b5c10 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87e00700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fce8815e5e0 0x7fce880b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce87400700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce880b5c10 0x7fce880ccee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fce780097c0 tx=0x7fce78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.904+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780036a0 con 0x7fce880b5c10 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.905+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7801e070 con 0x7fce880b5c10 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.905+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce880cd850 con 0x7fce880b5c10 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.905+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78003a40 con 0x7fce880b5c10 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.905+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce880c82f0 con 0x7fce880b5c10 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.905+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce88161f60 con 0x7fce880b5c10 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.907+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce78003ba0 con 0x7fce880b5c10 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.908+0000 7fce7f400700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6806ac90 0x7fce6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.908+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fce7808a5c0 con 0x7fce880b5c10 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.908+0000 7fce7f400700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fce68070be0 0x7fce68073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.908+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 --> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce68073700 con 0x7fce68070be0 2024-05-10T04:52:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.908+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce7808a930 con 0x7fce880b5c10 2024-05-10T04:52:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.908+0000 7fce86a00700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6806ac90 0x7fce6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.908+0000 7fce87e00700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fce68070be0 0x7fce68073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.908+0000 7fce86a00700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6806ac90 0x7fce6806d1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce74000f60 tx=0x7fce74007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.909+0000 7fce87e00700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fce68070be0 0x7fce68073030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.909+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 <== osd.3 v2:172.21.15.82:6816/43967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fce68073700 con 0x7fce68070be0 2024-05-10T04:52:22.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.924+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 --> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fce88068470 con 0x7fce68070be0 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce7f400700 1 -- 172.21.15.82:0/45738138 <== osd.3 v2:172.21.15.82:6816/43967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fce88068470 con 0x7fce68070be0 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fce68070be0 msgr2=0x7fce68073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce8e800700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6816/43967,v1:172.21.15.82:6818/43967] conn(0x7fce68070be0 0x7fce68073030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6806ac90 msgr2=0x7fce6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce8e800700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fce6806ac90 0x7fce6806d1a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fce74000f60 tx=0x7fce74007a40 comp rx=0 tx=0).stop 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce880b5c10 msgr2=0x7fce880ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce8e800700 1 --2- 172.21.15.82:0/45738138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce880b5c10 0x7fce880ccee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fce780097c0 tx=0x7fce78004750 comp rx=0 tx=0).stop 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce87e00700 1 -- 172.21.15.82:0/45738138 reap_dead start 2024-05-10T04:52:22.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 shutdown_connections 2024-05-10T04:52:22.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.925+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 >> 172.21.15.82:0/45738138 conn(0x7fce880d0cd0 msgr2=0x7fce880b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.926+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 shutdown_connections 2024-05-10T04:52:22.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:22.926+0000 7fce8e800700 1 -- 172.21.15.82:0/45738138 wait complete. 2024-05-10T04:52:22.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-10T04:52:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.215+0000 7f1f1c600700 1 Processor -- start 2024-05-10T04:52:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.216+0000 7f1f1c600700 1 -- start start 2024-05-10T04:52:23.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.217+0000 7f1f1c600700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f1f140d3460 0x7f1f140b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.217+0000 7f1f1c600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f140b58b0 0x7f1f140b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.217+0000 7f1f1c600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f141620e0 0x7f1f141624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.217+0000 7f1f1c600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140b3720 con 0x7f1f141620e0 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.217+0000 7f1f1c600700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140d2730 con 0x7f1f140d3460 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.217+0000 7f1f1c600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140d2fd0 con 0x7f1f140b58b0 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f141620e0 0x7f1f141624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f141620e0 0x7f1f141624f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44584/0 (socket says 172.21.15.82:44584) 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 -- 172.21.15.82:0/2798878136 learned_addr learned my addr 172.21.15.82:0/2798878136 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f19c00700 1 --2- 172.21.15.82:0/2798878136 >> v2:172.21.15.129:3300/0 conn(0x7f1f140d3460 0x7f1f140b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f19200700 1 --2- 172.21.15.82:0/2798878136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f140b58b0 0x7f1f140b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 -- 172.21.15.82:0/2798878136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f140b58b0 msgr2=0x7f1f140b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 --2- 172.21.15.82:0/2798878136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f140b58b0 0x7f1f140b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 -- 172.21.15.82:0/2798878136 >> v2:172.21.15.129:3300/0 conn(0x7f1f140d3460 msgr2=0x7f1f140b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 --2- 172.21.15.82:0/2798878136 >> v2:172.21.15.129:3300/0 conn(0x7f1f140d3460 0x7f1f140b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 -- 172.21.15.82:0/2798878136 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140b6200 con 0x7f1f141620e0 2024-05-10T04:52:23.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.218+0000 7f1f1a600700 1 --2- 172.21.15.82:0/2798878136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f141620e0 0x7f1f141624f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009e50 tx=0x7f1f0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dc1f5015a7a742 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.219+0000 7f1f13e00700 1 -- 172.21.15.82:0/2798878136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00e070 con 0x7f1f141620e0 2024-05-10T04:52:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.219+0000 7f1f13e00700 1 -- 172.21.15.82:0/2798878136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c00b8d0 con 0x7f1f141620e0 2024-05-10T04:52:23.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.219+0000 7f1f13e00700 1 -- 172.21.15.82:0/2798878136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00bc80 con 0x7f1f141620e0 2024-05-10T04:52:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.219+0000 7f1f1c600700 1 -- 172.21.15.82:0/2798878136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f141620e0 msgr2=0x7f1f141624f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.219+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2798878136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f141620e0 0x7f1f141624f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009e50 tx=0x7f1f0c00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:23.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.219+0000 7f1f1c600700 1 -- 172.21.15.82:0/2798878136 shutdown_connections 2024-05-10T04:52:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.220+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2798878136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f141620e0 0x7f1f141624f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.220+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2798878136 >> v2:172.21.15.129:3300/0 conn(0x7f1f140d3460 0x7f1f140b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.220+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2798878136 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f140b58b0 0x7f1f140b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.220+0000 7f1f1c600700 1 -- 172.21.15.82:0/2798878136 >> 172.21.15.82:0/2798878136 conn(0x7f1f140d0a90 msgr2=0x7f1f140d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.220+0000 7f1f1c600700 1 -- 172.21.15.82:0/2798878136 shutdown_connections 2024-05-10T04:52:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.220+0000 7f1f1c600700 1 -- 172.21.15.82:0/2798878136 wait complete. 2024-05-10T04:52:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.222+0000 7f1f1c600700 1 Processor -- start 2024-05-10T04:52:23.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.222+0000 7f1f1c600700 1 -- start start 2024-05-10T04:52:23.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.223+0000 7f1f1c600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f140b58b0 0x7f1f1414af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.223+0000 7f1f1c600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f140d3460 0x7f1f140cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f1c600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f141620e0 0x7f1f1414d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f1c600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141504c0 con 0x7f1f140b58b0 2024-05-10T04:52:23.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f1c600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1414c9e0 con 0x7f1f140d3460 2024-05-10T04:52:23.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f1c600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1414e5c0 con 0x7f1f141620e0 2024-05-10T04:52:23.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f140b58b0 0x7f1f1414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f140b58b0 0x7f1f1414af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44590/0 (socket says 172.21.15.82:44590) 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19c00700 1 -- 172.21.15.82:0/2632177981 learned_addr learned my addr 172.21.15.82:0/2632177981 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19200700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f140d3460 0x7f1f140cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19c00700 1 -- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f141620e0 msgr2=0x7f1f1414d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f1a600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f141620e0 0x7f1f1414d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19c00700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f141620e0 0x7f1f1414d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19c00700 1 -- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f140d3460 msgr2=0x7f1f140cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19c00700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f140d3460 0x7f1f140cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19c00700 1 -- 172.21.15.82:0/2632177981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c009b30 con 0x7f1f140b58b0 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f19200700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f140d3460 0x7f1f140cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.224+0000 7f1f1a600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f141620e0 0x7f1f1414d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:23.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.225+0000 7f1f19c00700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f140b58b0 0x7f1f1414af80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800e870 tx=0x7f1f0800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.225+0000 7f1f11600700 1 -- 172.21.15.82:0/2632177981 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08009590 con 0x7f1f140b58b0 2024-05-10T04:52:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.225+0000 7f1f11600700 1 -- 172.21.15.82:0/2632177981 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0800ee70 con 0x7f1f140b58b0 2024-05-10T04:52:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.225+0000 7f1f11600700 1 -- 172.21.15.82:0/2632177981 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800ca50 con 0x7f1f140b58b0 2024-05-10T04:52:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.225+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1414d4d0 con 0x7f1f140b58b0 2024-05-10T04:52:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.225+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1414cf10 con 0x7f1f140b58b0 2024-05-10T04:52:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.226+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f140732b0 con 0x7f1f140b58b0 2024-05-10T04:52:23.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.227+0000 7f1f11600700 1 -- 172.21.15.82:0/2632177981 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f0800cbb0 con 0x7f1f140b58b0 2024-05-10T04:52:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.228+0000 7f1f11600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1ef406ac90 0x7f1ef406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.228+0000 7f1f11600700 1 -- 172.21.15.82:0/2632177981 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1f08089100 con 0x7f1f140b58b0 2024-05-10T04:52:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.228+0000 7f1f19200700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1ef406ac90 0x7f1ef406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.229+0000 7f1f19200700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1ef406ac90 0x7f1ef406d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f140b98e0 tx=0x7f1f00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:23.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.233+0000 7f1f11600700 1 -- 172.21.15.82:0/2632177981 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1f08054450 con 0x7f1f140b58b0 2024-05-10T04:52:23.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.436+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f140ce7b0 con 0x7f1ef406ac90 2024-05-10T04:52:23.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.436+0000 7f1f11600700 1 -- 172.21.15.82:0/2632177981 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1f140ce7b0 con 0x7f1ef406ac90 2024-05-10T04:52:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.438+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1ef406ac90 msgr2=0x7f1ef406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.438+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1ef406ac90 0x7f1ef406d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f140b98e0 tx=0x7f1f00008040 comp rx=0 tx=0).stop 2024-05-10T04:52:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f140b58b0 msgr2=0x7f1f1414af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f140b58b0 0x7f1f1414af80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800e870 tx=0x7f1f0800ec30 comp rx=0 tx=0).stop 2024-05-10T04:52:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 shutdown_connections 2024-05-10T04:52:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f1ef406ac90 0x7f1ef406d1a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f1f141620e0 0x7f1f1414d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f140b58b0 0x7f1f1414af80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 --2- 172.21.15.82:0/2632177981 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f140d3460 0x7f1f140cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 >> 172.21.15.82:0/2632177981 conn(0x7f1f140d0a90 msgr2=0x7f1f1406c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 shutdown_connections 2024-05-10T04:52:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.439+0000 7f1f1c600700 1 -- 172.21.15.82:0/2632177981 wait complete. 2024-05-10T04:52:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 3 to deep-scrub 2024-05-10T04:52:23.465 INFO:tasks.ceph:Scrubbing osd.4 2024-05-10T04:52:23.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:52:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.728+0000 7f151ce00700 1 Processor -- start 2024-05-10T04:52:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.728+0000 7f151ce00700 1 -- start start 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f151ce00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15180d17c0 0x7f151806c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f151ce00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f15180d01d0 0x7f15180d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f151ce00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15180d1310 con 0x7f151806bfe0 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f151ce00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180cf510 con 0x7f15180d17c0 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f151ce00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151806d4a0 con 0x7f15180d01d0 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f1515e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15180d17c0 0x7f151806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f1515e00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15180d17c0 0x7f151806c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44596/0 (socket says 172.21.15.82:44596) 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f1515e00700 1 -- 172.21.15.82:0/2554938846 learned_addr learned my addr 172.21.15.82:0/2554938846 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f1516800700 1 --2- 172.21.15.82:0/2554938846 >> v2:172.21.15.129:3300/0 conn(0x7f15180d01d0 0x7f15180d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f1515e00700 1 -- 172.21.15.82:0/2554938846 >> v2:172.21.15.129:3300/0 conn(0x7f15180d01d0 msgr2=0x7f15180d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.730+0000 7f1515e00700 1 --2- 172.21.15.82:0/2554938846 >> v2:172.21.15.129:3300/0 conn(0x7f15180d01d0 0x7f15180d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.731+0000 7f1515e00700 1 -- 172.21.15.82:0/2554938846 >> v1:172.21.15.129:6789/0 conn(0x7f151806bfe0 legacy=0x7f151806cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.731+0000 7f1515e00700 1 -- 172.21.15.82:0/2554938846 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180cf230 con 0x7f15180d17c0 2024-05-10T04:52:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.731+0000 7f1515e00700 1 --2- 172.21.15.82:0/2554938846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d17c0 0x7f151806c850 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1518072600 tx=0x7f1508009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0b750316336eab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.731+0000 7f1514a00700 1 -- 172.21.15.82:0/2554938846 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800b870 con 0x7f15180d17c0 2024-05-10T04:52:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.731+0000 7f1514a00700 1 -- 172.21.15.82:0/2554938846 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800b9d0 con 0x7f15180d17c0 2024-05-10T04:52:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.731+0000 7f1514a00700 1 -- 172.21.15.82:0/2554938846 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800bd60 con 0x7f15180d17c0 2024-05-10T04:52:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.732+0000 7f151ce00700 1 -- 172.21.15.82:0/2554938846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d17c0 msgr2=0x7f151806c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.732+0000 7f151ce00700 1 --2- 172.21.15.82:0/2554938846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d17c0 0x7f151806c850 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1518072600 tx=0x7f1508009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.732+0000 7f151ce00700 1 -- 172.21.15.82:0/2554938846 shutdown_connections 2024-05-10T04:52:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.732+0000 7f151ce00700 1 --2- 172.21.15.82:0/2554938846 >> v2:172.21.15.129:3300/0 conn(0x7f15180d01d0 0x7f15180d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.732+0000 7f151ce00700 1 --2- 172.21.15.82:0/2554938846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d17c0 0x7f151806c850 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.732+0000 7f151ce00700 1 -- 172.21.15.82:0/2554938846 >> 172.21.15.82:0/2554938846 conn(0x7f15180ce670 msgr2=0x7f15180cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.732+0000 7f151ce00700 1 -- 172.21.15.82:0/2554938846 shutdown_connections 2024-05-10T04:52:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.732+0000 7f151ce00700 1 -- 172.21.15.82:0/2554938846 wait complete. 2024-05-10T04:52:23.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.734+0000 7f151ce00700 1 Processor -- start 2024-05-10T04:52:23.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.735+0000 7f151ce00700 1 -- start start 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f151ce00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f151806bfe0 0x7f15180af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f151ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d01d0 0x7f15181d4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f151ce00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f15180d17c0 0x7f151809dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f151ce00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15181d5190 con 0x7f15180d01d0 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f151ce00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180cb050 con 0x7f151806bfe0 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f151ce00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15180af750 con 0x7f15180d17c0 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f1515400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d01d0 0x7f15181d4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f1515400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d01d0 0x7f15181d4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44600/0 (socket says 172.21.15.82:44600) 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f1515400700 1 -- 172.21.15.82:0/3454824110 learned_addr learned my addr 172.21.15.82:0/3454824110 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f1516800700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f15180d17c0 0x7f151809dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.736+0000 7f1515e00700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f151806bfe0 0x7f15180af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f1515400700 1 -- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f15180d17c0 msgr2=0x7f151809dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f1515400700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f15180d17c0 0x7f151809dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f1515400700 1 -- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f151806bfe0 msgr2=0x7f15180af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f1515400700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f151806bfe0 0x7f15180af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f1515400700 1 -- 172.21.15.82:0/3454824110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508009550 con 0x7f15180d01d0 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f1515400700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d01d0 0x7f15181d4670 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f150400c450 tx=0x7f150400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040052d0 con 0x7f15180d01d0 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504005430 con 0x7f15180d01d0 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15181d53a0 con 0x7f15180d01d0 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040038c0 con 0x7f15180d01d0 2024-05-10T04:52:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.737+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15181d5960 con 0x7f15180d01d0 2024-05-10T04:52:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.738+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15180c86a0 con 0x7f15180d01d0 2024-05-10T04:52:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.739+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1504003a20 con 0x7f15180d01d0 2024-05-10T04:52:23.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.740+0000 7f150e000700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14f806acc0 0x7f14f806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.740+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1504088bb0 con 0x7f15180d01d0 2024-05-10T04:52:23.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.741+0000 7f1515e00700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14f806acc0 0x7f14f806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.741+0000 7f150e000700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7f14f8070c10 0x7f14f8073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.741+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 --> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14f8073730 con 0x7f14f8070c10 2024-05-10T04:52:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.741+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1504088f20 con 0x7f15180d01d0 2024-05-10T04:52:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.741+0000 7f1516800700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7f14f8070c10 0x7f14f8073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.741+0000 7f1515e00700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14f806acc0 0x7f14f806d1d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1508014040 tx=0x7f1508008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:23.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.742+0000 7f1516800700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7f14f8070c10 0x7f14f8073060 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:23.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.743+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 <== osd.4 v2:172.21.15.129:6800/44258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f14f8073730 con 0x7f14f8070c10 2024-05-10T04:52:23.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.758+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 --> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f151809b450 con 0x7f14f8070c10 2024-05-10T04:52:23.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f150e000700 1 -- 172.21.15.82:0/3454824110 <== osd.4 v2:172.21.15.129:6800/44258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f15100083a0 con 0x7f14f8070c10 2024-05-10T04:52:23.760 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:23.760 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:52:23.760 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:23.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7f14f8070c10 msgr2=0x7f14f8073060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.129:6800/44258,v1:172.21.15.129:6801/44258] conn(0x7f14f8070c10 0x7f14f8073060 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:23.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14f806acc0 msgr2=0x7f14f806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f14f806acc0 0x7f14f806d1d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1508014040 tx=0x7f1508008030 comp rx=0 tx=0).stop 2024-05-10T04:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d01d0 msgr2=0x7f15181d4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 --2- 172.21.15.82:0/3454824110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15180d01d0 0x7f15181d4670 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f150400c450 tx=0x7f150400c760 comp rx=0 tx=0).stop 2024-05-10T04:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f1516800700 1 -- 172.21.15.82:0/3454824110 reap_dead start 2024-05-10T04:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 shutdown_connections 2024-05-10T04:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 >> 172.21.15.82:0/3454824110 conn(0x7f15180ce670 msgr2=0x7f15180b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 shutdown_connections 2024-05-10T04:52:23.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:23.759+0000 7f151ce00700 1 -- 172.21.15.82:0/3454824110 wait complete. 2024-05-10T04:52:23.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-10T04:52:24.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.046+0000 7ff22d400700 1 Processor -- start 2024-05-10T04:52:24.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.046+0000 7ff22d400700 1 -- start start 2024-05-10T04:52:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.048+0000 7ff22d400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7ff2280d0990 0x7ff2280d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.048+0000 7ff22d400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2280b5bb0 con 0x7ff228161d40 2024-05-10T04:52:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.048+0000 7ff22d400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2280ceeb0 con 0x7ff2280b3090 2024-05-10T04:52:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.048+0000 7ff22d400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2280cf6d0 con 0x7ff2280d0990 2024-05-10T04:52:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.048+0000 7ff227e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff228161d40 0x7ff2280b6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48028/0 (socket says 172.21.15.82:48028) 2024-05-10T04:52:24.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.048+0000 7ff227e00700 1 -- 172.21.15.82:0/2608859098 learned_addr learned my addr 172.21.15.82:0/2608859098 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:24.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.049+0000 7ff22ca00700 1 --2- 172.21.15.82:0/2608859098 >> v2:172.21.15.129:3300/0 conn(0x7ff2280d0990 0x7ff2280d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.049+0000 7ff227400700 1 -- 172.21.15.82:0/2608859098 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873344740 0 0) 0x7ff2280b5bb0 con 0x7ff228161d40 2024-05-10T04:52:24.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.049+0000 7ff227400700 1 -- 172.21.15.82:0/2608859098 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff20c0035b0 con 0x7ff228161d40 2024-05-10T04:52:24.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.049+0000 7ff22ca00700 1 -- 172.21.15.82:0/2608859098 >> v1:172.21.15.129:6789/0 conn(0x7ff2280b3090 legacy=0x7ff2280ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.049+0000 7ff22ca00700 1 -- 172.21.15.82:0/2608859098 >> v1:172.21.15.82:6789/0 conn(0x7ff228161d40 legacy=0x7ff2280b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.049+0000 7ff22ca00700 1 -- 172.21.15.82:0/2608859098 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2280d12e0 con 0x7ff2280d0990 2024-05-10T04:52:24.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.049+0000 7ff22ca00700 1 --2- 172.21.15.82:0/2608859098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280d0990 0x7ff2280d0da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff220009d90 tx=0x7ff22000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21f3116f326c024 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff227400700 1 -- 172.21.15.82:0/2608859098 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22000e070 con 0x7ff2280d0990 2024-05-10T04:52:24.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff227400700 1 -- 172.21.15.82:0/2608859098 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22000bb20 con 0x7ff2280d0990 2024-05-10T04:52:24.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff227400700 1 -- 172.21.15.82:0/2608859098 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22000be90 con 0x7ff2280d0990 2024-05-10T04:52:24.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff22d400700 1 -- 172.21.15.82:0/2608859098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280d0990 msgr2=0x7ff2280d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff22d400700 1 --2- 172.21.15.82:0/2608859098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280d0990 0x7ff2280d0da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff220009d90 tx=0x7ff22000b330 comp rx=0 tx=0).stop 2024-05-10T04:52:24.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff22d400700 1 -- 172.21.15.82:0/2608859098 shutdown_connections 2024-05-10T04:52:24.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff22d400700 1 --2- 172.21.15.82:0/2608859098 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280d0990 0x7ff2280d0da0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff22d400700 1 -- 172.21.15.82:0/2608859098 >> 172.21.15.82:0/2608859098 conn(0x7ff22806c580 msgr2=0x7ff22806c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff22d400700 1 -- 172.21.15.82:0/2608859098 shutdown_connections 2024-05-10T04:52:24.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.050+0000 7ff22d400700 1 -- 172.21.15.82:0/2608859098 wait complete. 2024-05-10T04:52:24.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.053+0000 7ff22d400700 1 Processor -- start 2024-05-10T04:52:24.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.053+0000 7ff22d400700 1 -- start start 2024-05-10T04:52:24.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff22d400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280b3090 0x7ff2281f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff22d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2280d0990 0x7ff228153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff22d400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff228161d40 0x7ff2280cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff22d400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff228155480 con 0x7ff2280d0990 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff22d400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280cd940 con 0x7ff2280b3090 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff22d400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280cdb90 con 0x7ff228161d40 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff21fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2280d0990 0x7ff228153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff21fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2280d0990 0x7ff228153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44610/0 (socket says 172.21.15.82:44610) 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.054+0000 7ff21fe00700 1 -- 172.21.15.82:0/3757410369 learned_addr learned my addr 172.21.15.82:0/3757410369 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff227e00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280b3090 0x7ff2281f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff22ca00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff228161d40 0x7ff2280cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff21fe00700 1 -- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff228161d40 msgr2=0x7ff2280cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff21fe00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff228161d40 0x7ff2280cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff21fe00700 1 -- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280b3090 msgr2=0x7ff2281f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff21fe00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280b3090 0x7ff2281f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff21fe00700 1 -- 172.21.15.82:0/3757410369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220009a70 con 0x7ff2280d0990 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff22ca00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff228161d40 0x7ff2280cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff227e00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280b3090 0x7ff2281f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff21fe00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2280d0990 0x7ff228153d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff21000c430 tx=0x7ff21000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.055+0000 7ff224c00700 1 -- 172.21.15.82:0/3757410369 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100052d0 con 0x7ff2280d0990 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.056+0000 7ff224c00700 1 -- 172.21.15.82:0/3757410369 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210005450 con 0x7ff2280d0990 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.056+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2280cadd0 con 0x7ff2280d0990 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.056+0000 7ff224c00700 1 -- 172.21.15.82:0/3757410369 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210006aa0 con 0x7ff2280d0990 2024-05-10T04:52:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.056+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2280cc920 con 0x7ff2280d0990 2024-05-10T04:52:24.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.057+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2280b64c0 con 0x7ff2280d0990 2024-05-10T04:52:24.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.058+0000 7ff224c00700 1 -- 172.21.15.82:0/3757410369 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff210003680 con 0x7ff2280d0990 2024-05-10T04:52:24.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.059+0000 7ff224c00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff20406ac90 0x7ff20406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.059+0000 7ff224c00700 1 -- 172.21.15.82:0/3757410369 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff210088380 con 0x7ff2280d0990 2024-05-10T04:52:24.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.059+0000 7ff227e00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff20406ac90 0x7ff20406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.060+0000 7ff227e00700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff20406ac90 0x7ff20406d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2180011e0 tx=0x7ff218009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.065+0000 7ff224c00700 1 -- 172.21.15.82:0/3757410369 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff210053750 con 0x7ff2280d0990 2024-05-10T04:52:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.267+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2280b5840 con 0x7ff20406ac90 2024-05-10T04:52:24.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.267+0000 7ff224c00700 1 -- 172.21.15.82:0/3757410369 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff218001c70 con 0x7ff20406ac90 2024-05-10T04:52:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff20406ac90 msgr2=0x7ff20406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff20406ac90 0x7ff20406d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2180011e0 tx=0x7ff218009040 comp rx=0 tx=0).stop 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2280d0990 msgr2=0x7ff228153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2280d0990 0x7ff228153d90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff21000c430 tx=0x7ff21000c7f0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 shutdown_connections 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7ff20406ac90 0x7ff20406d1a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7ff228161d40 0x7ff2280cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ff2280b3090 0x7ff2281f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 --2- 172.21.15.82:0/3757410369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2280d0990 0x7ff228153d90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 >> 172.21.15.82:0/3757410369 conn(0x7ff22806c580 msgr2=0x7ff22815dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 shutdown_connections 2024-05-10T04:52:24.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.270+0000 7ff22d400700 1 -- 172.21.15.82:0/3757410369 wait complete. 2024-05-10T04:52:24.273 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 4 to deep-scrub 2024-05-10T04:52:24.297 INFO:tasks.ceph:Scrubbing osd.5 2024-05-10T04:52:24.297 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:52:24.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.562+0000 7f6e26000700 1 Processor -- start 2024-05-10T04:52:24.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.562+0000 7f6e26000700 1 -- start start 2024-05-10T04:52:24.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e26000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f6e2015e5e0 0x7f6e20161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e26000700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e201626b0 con 0x7f6e200cea50 2024-05-10T04:52:24.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e26000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e20162990 con 0x7f6e200b5c10 2024-05-10T04:52:24.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e26000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e200cada0 con 0x7f6e2015e5e0 2024-05-10T04:52:24.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e1ea00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6e200cea50 0x7f6e200b7340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48040/0 (socket says 172.21.15.82:48040) 2024-05-10T04:52:24.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e1ea00700 1 -- 172.21.15.82:0/2877521493 learned_addr learned my addr 172.21.15.82:0/2877521493 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:24.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393786374 0 0) 0x7f6e201626b0 con 0x7f6e200cea50 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e1f400700 1 --2- 172.21.15.82:0/2877521493 >> v2:172.21.15.129:3300/0 conn(0x7f6e2015e5e0 0x7f6e20161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.564+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e040035b0 con 0x7f6e200cea50 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676144080 0 0) 0x7f6e040035b0 con 0x7f6e200cea50 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 >> v2:172.21.15.129:3300/0 conn(0x7f6e2015e5e0 msgr2=0x7f6e20161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 --2- 172.21.15.82:0/2877521493 >> v2:172.21.15.129:3300/0 conn(0x7f6e2015e5e0 0x7f6e20161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 >> v1:172.21.15.129:6789/0 conn(0x7f6e200b5c10 legacy=0x7f6e200b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20162c70 con 0x7f6e200cea50 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7f6e0c001670 con 0x7f6e200cea50 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 >> v1:172.21.15.82:6789/0 conn(0x7f6e200cea50 legacy=0x7f6e200b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e04003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e04004850 0x7f6e04004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e040052f0 0x7f6e0400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200cada0 con 0x7f6e04003a50 2024-05-10T04:52:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0400c280 con 0x7f6e040052f0 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0400c440 con 0x7f6e04004850 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1f400700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e04003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1fe00700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e040052f0 0x7f6e0400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.565+0000 7f6e1ea00700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e04004850 0x7f6e04004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1f400700 1 -- 172.21.15.82:0/2877521493 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e04004850 msgr2=0x7f6e04004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1f400700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e04004850 0x7f6e04004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1f400700 1 -- 172.21.15.82:0/2877521493 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e040052f0 msgr2=0x7f6e0400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1f400700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e040052f0 0x7f6e0400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1f400700 1 -- 172.21.15.82:0/2877521493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e040035b0 con 0x7f6e04003a50 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1fe00700 1 -- 172.21.15.82:0/2877521493 reap_dead start 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1f400700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e04003ec0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009b30 tx=0x7f6e04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2a8a9df33cb44e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000e6c0 con 0x7f6e04003a50 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1000e820 con 0x7f6e04003a50 2024-05-10T04:52:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.566+0000 7f6e1e000700 1 -- 172.21.15.82:0/2877521493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000eb90 con 0x7f6e04003a50 2024-05-10T04:52:24.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.567+0000 7f6e26000700 1 -- 172.21.15.82:0/2877521493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 msgr2=0x7f6e04003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.567+0000 7f6e26000700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e04003ec0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009b30 tx=0x7f6e04005880 comp rx=0 tx=0).stop 2024-05-10T04:52:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.567+0000 7f6e26000700 1 -- 172.21.15.82:0/2877521493 shutdown_connections 2024-05-10T04:52:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.567+0000 7f6e26000700 1 --2- 172.21.15.82:0/2877521493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e04003ec0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.567+0000 7f6e26000700 1 -- 172.21.15.82:0/2877521493 >> 172.21.15.82:0/2877521493 conn(0x7f6e200d0cd0 msgr2=0x7f6e200d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.567+0000 7f6e26000700 1 -- 172.21.15.82:0/2877521493 shutdown_connections 2024-05-10T04:52:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.567+0000 7f6e26000700 1 -- 172.21.15.82:0/2877521493 wait complete. 2024-05-10T04:52:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.569+0000 7f6e26000700 1 Processor -- start 2024-05-10T04:52:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.570+0000 7f6e26000700 1 -- start start 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e26000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e2015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e26000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e200b24d0 0x7f6e200b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e26000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e200c80e0 0x7f6e200c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e26000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201f4770 con 0x7f6e04003a50 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e26000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201f5ed0 con 0x7f6e200c80e0 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e26000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200ca150 con 0x7f6e200b24d0 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e1f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e2015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e1f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e2015cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44628/0 (socket says 172.21.15.82:44628) 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e1f400700 1 -- 172.21.15.82:0/2460986791 learned_addr learned my addr 172.21.15.82:0/2460986791 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.571+0000 7f6e1ea00700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e200b24d0 0x7f6e200b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1fe00700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e200c80e0 0x7f6e200c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1f400700 1 -- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e200b24d0 msgr2=0x7f6e200b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1f400700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e200b24d0 0x7f6e200b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1f400700 1 -- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e200c80e0 msgr2=0x7f6e200c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1f400700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e200c80e0 0x7f6e200c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1f400700 1 -- 172.21.15.82:0/2460986791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e201f4420 con 0x7f6e04003a50 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1ea00700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f6e200b24d0 0x7f6e200b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1fe00700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6e200c80e0 0x7f6e200c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e1f400700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e2015cfa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000e4b0 tx=0x7f6e100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000e6c0 con 0x7f6e04003a50 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10013e10 con 0x7f6e04003a50 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10027690 con 0x7f6e04003a50 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e200c8a30 con 0x7f6e04003a50 2024-05-10T04:52:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.572+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e200ca3a0 con 0x7f6e04003a50 2024-05-10T04:52:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.573+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e201f4770 con 0x7f6e04003a50 2024-05-10T04:52:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.574+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e100277f0 con 0x7f6e04003a50 2024-05-10T04:52:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.575+0000 7f6e17400700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f6e0006acc0 0x7f6e0006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.575+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6e1008a9b0 con 0x7f6e04003a50 2024-05-10T04:52:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.575+0000 7f6e1ea00700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f6e0006acc0 0x7f6e0006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.575+0000 7f6e17400700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f6e00070c10 0x7f6e00073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.575+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 --> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e00073730 con 0x7f6e00070c10 2024-05-10T04:52:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.575+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e1008f2c0 con 0x7f6e04003a50 2024-05-10T04:52:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.576+0000 7f6e1fe00700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f6e00070c10 0x7f6e00073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.576+0000 7f6e1ea00700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f6e0006acc0 0x7f6e0006d1d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0017a0 tx=0x7f6e0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.577+0000 7f6e1fe00700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f6e00070c10 0x7f6e00073060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.577+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 <== osd.5 v2:172.21.15.129:6816/44259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6e00073730 con 0x7f6e00070c10 2024-05-10T04:52:24.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.592+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 --> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6e20074af0 con 0x7f6e00070c10 2024-05-10T04:52:24.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.593+0000 7f6e17400700 1 -- 172.21.15.82:0/2460986791 <== osd.5 v2:172.21.15.129:6816/44259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6e20074af0 con 0x7f6e00070c10 2024-05-10T04:52:24.595 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:24.595 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:52:24.595 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.593+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f6e00070c10 msgr2=0x7f6e00073060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.593+0000 7f6e26000700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.129:6816/44259,v1:172.21.15.129:6817/44259] conn(0x7f6e00070c10 0x7f6e00073060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f6e0006acc0 msgr2=0x7f6e0006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e26000700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f6e0006acc0 0x7f6e0006d1d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0017a0 tx=0x7f6e0c009040 comp rx=0 tx=0).stop 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 msgr2=0x7f6e2015cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e26000700 1 --2- 172.21.15.82:0/2460986791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e04003a50 0x7f6e2015cfa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000e4b0 tx=0x7f6e100047c0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e1fe00700 1 -- 172.21.15.82:0/2460986791 reap_dead start 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 shutdown_connections 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 >> 172.21.15.82:0/2460986791 conn(0x7f6e200d0cd0 msgr2=0x7f6e200b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 shutdown_connections 2024-05-10T04:52:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.594+0000 7f6e26000700 1 -- 172.21.15.82:0/2460986791 wait complete. 2024-05-10T04:52:24.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-10T04:52:24.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.885+0000 7fcda3000700 1 Processor -- start 2024-05-10T04:52:24.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.885+0000 7fcda3000700 1 -- start start 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcda3000700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd9c0d3460 0x7fcd9c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcda3000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fcd9c0b58b0 0x7fcd9c0b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcda3000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c1620e0 0x7fcd9c1624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcda3000700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0b3720 con 0x7fcd9c0d3460 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcda3000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0d2730 con 0x7fcd9c0b58b0 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcda3000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0d2fd0 con 0x7fcd9c1620e0 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcd9be00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd9c0d3460 0x7fcd9c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcd9be00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd9c0d3460 0x7fcd9c0b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44644/0 (socket says 172.21.15.82:44644) 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.887+0000 7fcd9be00700 1 -- 172.21.15.82:0/253455555 learned_addr learned my addr 172.21.15.82:0/253455555 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcda1000700 1 --2- 172.21.15.82:0/253455555 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c1620e0 0x7fcd9c1624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9b400700 1 --2- 172.21.15.82:0/253455555 >> v2:172.21.15.129:3300/0 conn(0x7fcd9c0b58b0 0x7fcd9c0b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9be00700 1 -- 172.21.15.82:0/253455555 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c1620e0 msgr2=0x7fcd9c1624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9be00700 1 --2- 172.21.15.82:0/253455555 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c1620e0 0x7fcd9c1624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9be00700 1 -- 172.21.15.82:0/253455555 >> v2:172.21.15.129:3300/0 conn(0x7fcd9c0b58b0 msgr2=0x7fcd9c0b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9be00700 1 --2- 172.21.15.82:0/253455555 >> v2:172.21.15.129:3300/0 conn(0x7fcd9c0b58b0 0x7fcd9c0b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9be00700 1 -- 172.21.15.82:0/253455555 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0b6200 con 0x7fcd9c0d3460 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcda1000700 1 --2- 172.21.15.82:0/253455555 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c1620e0 0x7fcd9c1624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9b400700 1 --2- 172.21.15.82:0/253455555 >> v2:172.21.15.129:3300/0 conn(0x7fcd9c0b58b0 0x7fcd9c0b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9be00700 1 --2- 172.21.15.82:0/253455555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b31e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06d2e0 tx=0x7fcd8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8b9c616562d252 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9aa00700 1 -- 172.21.15.82:0/253455555 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00b870 con 0x7fcd9c0d3460 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9aa00700 1 -- 172.21.15.82:0/253455555 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c00b9d0 con 0x7fcd9c0d3460 2024-05-10T04:52:24.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.888+0000 7fcd9aa00700 1 -- 172.21.15.82:0/253455555 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00bd60 con 0x7fcd9c0d3460 2024-05-10T04:52:24.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 -- 172.21.15.82:0/253455555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 msgr2=0x7fcd9c0b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 --2- 172.21.15.82:0/253455555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b31e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c06d2e0 tx=0x7fcd8c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 -- 172.21.15.82:0/253455555 shutdown_connections 2024-05-10T04:52:24.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 --2- 172.21.15.82:0/253455555 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c1620e0 0x7fcd9c1624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 --2- 172.21.15.82:0/253455555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b31e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 --2- 172.21.15.82:0/253455555 >> v2:172.21.15.129:3300/0 conn(0x7fcd9c0b58b0 0x7fcd9c0b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 -- 172.21.15.82:0/253455555 >> 172.21.15.82:0/253455555 conn(0x7fcd9c0d0a90 msgr2=0x7fcd9c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 -- 172.21.15.82:0/253455555 shutdown_connections 2024-05-10T04:52:24.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.889+0000 7fcda3000700 1 -- 172.21.15.82:0/253455555 wait complete. 2024-05-10T04:52:24.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.892+0000 7fcda3000700 1 Processor -- start 2024-05-10T04:52:24.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.892+0000 7fcda3000700 1 -- start start 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcda3000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c0b58b0 0x7fcd9c0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcda3000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcda3000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcd9c1620e0 0x7fcd9c0b9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcda3000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c14cb70 con 0x7fcd9c0d3460 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcda3000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c15ac00 con 0x7fcd9c1620e0 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcda3000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c15ba60 con 0x7fcd9c0b58b0 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcd9b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcd9b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44650/0 (socket says 172.21.15.82:44650) 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.893+0000 7fcd9b400700 1 -- 172.21.15.82:0/2214227449 learned_addr learned my addr 172.21.15.82:0/2214227449 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcda1000700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcd9c1620e0 0x7fcd9c0b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd9be00700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c0b58b0 0x7fcd9c0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd9b400700 1 -- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c0b58b0 msgr2=0x7fcd9c0c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd9b400700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c0b58b0 0x7fcd9c0c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd9b400700 1 -- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcd9c1620e0 msgr2=0x7fcd9c0b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd9b400700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcd9c1620e0 0x7fcd9c0b9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd9b400700 1 -- 172.21.15.82:0/2214227449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009550 con 0x7fcd9c0d3460 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd9be00700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c0b58b0 0x7fcd9c0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd9b400700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b8c00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800d800 tx=0x7fcd8800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd93e00700 1 -- 172.21.15.82:0/2214227449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88004030 con 0x7fcd9c0d3460 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcd93e00700 1 -- 172.21.15.82:0/2214227449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd88004190 con 0x7fcd9c0d3460 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.894+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c1588c0 con 0x7fcd9c0d3460 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.895+0000 7fcd93e00700 1 -- 172.21.15.82:0/2214227449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88004520 con 0x7fcd9c0d3460 2024-05-10T04:52:24.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.895+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c15ae50 con 0x7fcd9c0d3460 2024-05-10T04:52:24.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.896+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c0732b0 con 0x7fcd9c0d3460 2024-05-10T04:52:24.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.897+0000 7fcd93e00700 1 -- 172.21.15.82:0/2214227449 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd880036a0 con 0x7fcd9c0d3460 2024-05-10T04:52:24.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.898+0000 7fcd93e00700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcd7c06ac90 0x7fcd7c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.898+0000 7fcd93e00700 1 -- 172.21.15.82:0/2214227449 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcd880886b0 con 0x7fcd9c0d3460 2024-05-10T04:52:24.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.898+0000 7fcd9be00700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcd7c06ac90 0x7fcd7c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.898+0000 7fcd9be00700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcd7c06ac90 0x7fcd7c06d1a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c014040 tx=0x7fcd8c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:24.903+0000 7fcd93e00700 1 -- 172.21.15.82:0/2214227449 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcd88053be0 con 0x7fcd9c0d3460 2024-05-10T04:52:25.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.104+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd9c0d2c60 con 0x7fcd7c06ac90 2024-05-10T04:52:25.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.105+0000 7fcd93e00700 1 -- 172.21.15.82:0/2214227449 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcd8c00bbc0 con 0x7fcd7c06ac90 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcd7c06ac90 msgr2=0x7fcd7c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcd7c06ac90 0x7fcd7c06d1a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c014040 tx=0x7fcd8c008030 comp rx=0 tx=0).stop 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 msgr2=0x7fcd9c0b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b8c00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800d800 tx=0x7fcd8800db10 comp rx=0 tx=0).stop 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 shutdown_connections 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fcd7c06ac90 0x7fcd7c06d1a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcd9c1620e0 0x7fcd9c0b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fcd9c0b58b0 0x7fcd9c0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 --2- 172.21.15.82:0/2214227449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd9c0d3460 0x7fcd9c0b8c00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 >> 172.21.15.82:0/2214227449 conn(0x7fcd9c0d0a90 msgr2=0x7fcd9c1616d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 shutdown_connections 2024-05-10T04:52:25.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.107+0000 7fcda3000700 1 -- 172.21.15.82:0/2214227449 wait complete. 2024-05-10T04:52:25.110 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 5 to deep-scrub 2024-05-10T04:52:25.134 INFO:tasks.ceph:Scrubbing osd.6 2024-05-10T04:52:25.134 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:52:25.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.399+0000 7fb402400700 1 Processor -- start 2024-05-10T04:52:25.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.399+0000 7fb402400700 1 -- start start 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.401+0000 7fb402400700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fb3fc15e240 0x7fb3fc0d2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.401+0000 7fb402400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3fc0d2550 0x7fb3fc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.401+0000 7fb402400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc0d0f50 0x7fb3fc0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.401+0000 7fb402400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3fc0d2960 con 0x7fb3fc0d2550 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.401+0000 7fb402400700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3fc0b7130 con 0x7fb3fc15e240 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.401+0000 7fb402400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0d1360 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3fc0d2550 0x7fb3fc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb3fc0d2550 0x7fb3fc0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44652/0 (socket says 172.21.15.82:44652) 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 -- 172.21.15.82:0/3487797383 learned_addr learned my addr 172.21.15.82:0/3487797383 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb401000700 1 --2- 172.21.15.82:0/3487797383 >> v2:172.21.15.129:3300/0 conn(0x7fb3fc15e240 0x7fb3fc0d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb401a00700 1 --2- 172.21.15.82:0/3487797383 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc0d0f50 0x7fb3fc0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 -- 172.21.15.82:0/3487797383 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc0d0f50 msgr2=0x7fb3fc0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 --2- 172.21.15.82:0/3487797383 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc0d0f50 0x7fb3fc0b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 -- 172.21.15.82:0/3487797383 >> v2:172.21.15.129:3300/0 conn(0x7fb3fc15e240 msgr2=0x7fb3fc0d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 --2- 172.21.15.82:0/3487797383 >> v2:172.21.15.129:3300/0 conn(0x7fb3fc15e240 0x7fb3fc0d2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 -- 172.21.15.82:0/3487797383 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc0cebe0 con 0x7fb3fc0d2550 2024-05-10T04:52:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fbe00700 1 --2- 172.21.15.82:0/3487797383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d2550 0x7fb3fc0d0a10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc08c5b0 tx=0x7fb3e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e322b74e6bd9a1aa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.402+0000 7fb3fb400700 1 -- 172.21.15.82:0/3487797383 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8011830 con 0x7fb3fc0d2550 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb3fb400700 1 -- 172.21.15.82:0/3487797383 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8011990 con 0x7fb3fc0d2550 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb3fb400700 1 -- 172.21.15.82:0/3487797383 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8011d20 con 0x7fb3fc0d2550 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 -- 172.21.15.82:0/3487797383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d2550 msgr2=0x7fb3fc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 --2- 172.21.15.82:0/3487797383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d2550 0x7fb3fc0d0a10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc08c5b0 tx=0x7fb3e8009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 -- 172.21.15.82:0/3487797383 shutdown_connections 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 --2- 172.21.15.82:0/3487797383 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc0d0f50 0x7fb3fc0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 --2- 172.21.15.82:0/3487797383 >> v2:172.21.15.129:3300/0 conn(0x7fb3fc15e240 0x7fb3fc0d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 --2- 172.21.15.82:0/3487797383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d2550 0x7fb3fc0d0a10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 -- 172.21.15.82:0/3487797383 >> 172.21.15.82:0/3487797383 conn(0x7fb3fc06c5a0 msgr2=0x7fb3fc06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 -- 172.21.15.82:0/3487797383 shutdown_connections 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.403+0000 7fb402400700 1 -- 172.21.15.82:0/3487797383 wait complete. 2024-05-10T04:52:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.406+0000 7fb402400700 1 Processor -- start 2024-05-10T04:52:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.406+0000 7fb402400700 1 -- start start 2024-05-10T04:52:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.407+0000 7fb402400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d0f50 0x7fb3fc160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.407+0000 7fb402400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3fc0d2550 0x7fb3fc0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.407+0000 7fb402400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc15e240 0x7fb3fc0b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.407+0000 7fb402400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc1f55b0 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.407+0000 7fb402400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0c78c0 con 0x7fb3fc0d2550 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.407+0000 7fb402400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3fc0c7b10 con 0x7fb3fc15e240 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d0f50 0x7fb3fc160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d0f50 0x7fb3fc160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44662/0 (socket says 172.21.15.82:44662) 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 -- 172.21.15.82:0/2288987233 learned_addr learned my addr 172.21.15.82:0/2288987233 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401a00700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc15e240 0x7fb3fc0b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 -- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc15e240 msgr2=0x7fb3fc0b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc15e240 0x7fb3fc0b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 -- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3fc0d2550 msgr2=0x7fb3fc0b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb3fc0d2550 0x7fb3fc0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 -- 172.21.15.82:0/2288987233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8009550 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401a00700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb3fc15e240 0x7fb3fc0b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.408+0000 7fb401000700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d0f50 0x7fb3fc160510 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000e870 tx=0x7fb3f000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.409+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000c640 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.409+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f000c7a0 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.409+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000cb10 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.409+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3fc0c7df0 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.409+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3fc0c83b0 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.410+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3fc0d3160 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.411+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb3f000cc70 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.412+0000 7fb3f8c00700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3dc06ac90 0x7fb3dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.412+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb3f00890b0 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.412+0000 7fb3fbe00700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3dc06ac90 0x7fb3dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.412+0000 7fb3f8c00700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7fb3dc070be0 0x7fb3dc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.412+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 --> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3dc073700 con 0x7fb3dc070be0 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.412+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3f008b690 con 0x7fb3fc0d0f50 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.412+0000 7fb3fbe00700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3dc06ac90 0x7fb3dc06d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc08c5b0 tx=0x7fb3e8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.412+0000 7fb401a00700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7fb3dc070be0 0x7fb3dc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.413+0000 7fb401a00700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7fb3dc070be0 0x7fb3dc073030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.415+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 <== osd.6 v2:172.21.15.129:6808/44260 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb3dc073700 con 0x7fb3dc070be0 2024-05-10T04:52:25.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.429+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 --> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb3fc0c7730 con 0x7fb3dc070be0 2024-05-10T04:52:25.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.430+0000 7fb3f8c00700 1 -- 172.21.15.82:0/2288987233 <== osd.6 v2:172.21.15.129:6808/44260 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb3fc0c7730 con 0x7fb3dc070be0 2024-05-10T04:52:25.432 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:25.432 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:52:25.432 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7fb3dc070be0 msgr2=0x7fb3dc073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.129:6808/44260,v1:172.21.15.129:6809/44260] conn(0x7fb3dc070be0 0x7fb3dc073030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3dc06ac90 msgr2=0x7fb3dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb3dc06ac90 0x7fb3dc06d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc08c5b0 tx=0x7fb3e8010000 comp rx=0 tx=0).stop 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d0f50 msgr2=0x7fb3fc160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 --2- 172.21.15.82:0/2288987233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3fc0d0f50 0x7fb3fc160510 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000e870 tx=0x7fb3f000ec30 comp rx=0 tx=0).stop 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb401a00700 1 -- 172.21.15.82:0/2288987233 reap_dead start 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 shutdown_connections 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 >> 172.21.15.82:0/2288987233 conn(0x7fb3fc06c5a0 msgr2=0x7fb3fc0cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 shutdown_connections 2024-05-10T04:52:25.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.431+0000 7fb402400700 1 -- 172.21.15.82:0/2288987233 wait complete. 2024-05-10T04:52:25.459 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-10T04:52:25.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.720+0000 7fb0c0400700 1 Processor -- start 2024-05-10T04:52:25.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.720+0000 7fb0c0400700 1 -- start start 2024-05-10T04:52:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0c0400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b8161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0c0400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb0b80d0d40 0x7fb0b80d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0c0400700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b80d28c0 con 0x7fb0b80d3030 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0c0400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b80b3360 con 0x7fb0b80d0d40 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0c0400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b81624e0 con 0x7fb0b80b2f50 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0be400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb0b80d0d40 0x7fb0b80d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0be400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb0b80d0d40 0x7fb0b80d3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44672/0 (socket says 172.21.15.82:44672) 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0be400700 1 -- 172.21.15.82:0/3873225216 learned_addr learned my addr 172.21.15.82:0/3873225216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0bd000700 1 --1- 172.21.15.82:0/3873225216 >> v1:172.21.15.82:6789/0 conn(0x7fb0b80d3030 0x7fb0b80d0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48048/0 (socket says 172.21.15.82:48048) 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0bda00700 1 --2- 172.21.15.82:0/3873225216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b8161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0be400700 1 -- 172.21.15.82:0/3873225216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 msgr2=0x7fb0b8161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0be400700 1 --2- 172.21.15.82:0/3873225216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b8161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0be400700 1 -- 172.21.15.82:0/3873225216 >> v1:172.21.15.82:6789/0 conn(0x7fb0b80d3030 legacy=0x7fb0b80d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0be400700 1 -- 172.21.15.82:0/3873225216 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80d2ba0 con 0x7fb0b80d0d40 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.723+0000 7fb0bda00700 1 --2- 172.21.15.82:0/3873225216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b8161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.722+0000 7fb0b7e00700 1 -- 172.21.15.82:0/3873225216 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744664725 0 0) 0x7fb0b80d28c0 con 0x7fb0b80d3030 2024-05-10T04:52:25.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.723+0000 7fb0be400700 1 --2- 172.21.15.82:0/3873225216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d0d40 0x7fb0b80d3440 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009e50 tx=0x7fb0b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788c5e45acd2d622 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.723+0000 7fb0b7e00700 1 -- 172.21.15.82:0/3873225216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b000e070 con 0x7fb0b80d0d40 2024-05-10T04:52:25.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.723+0000 7fb0b7e00700 1 -- 172.21.15.82:0/3873225216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b000b9c0 con 0x7fb0b80d0d40 2024-05-10T04:52:25.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.723+0000 7fb0b7e00700 1 -- 172.21.15.82:0/3873225216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b000bd70 con 0x7fb0b80d0d40 2024-05-10T04:52:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.724+0000 7fb0c0400700 1 -- 172.21.15.82:0/3873225216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d0d40 msgr2=0x7fb0b80d3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.724+0000 7fb0c0400700 1 --2- 172.21.15.82:0/3873225216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d0d40 0x7fb0b80d3440 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009e50 tx=0x7fb0b000b330 comp rx=0 tx=0).stop 2024-05-10T04:52:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.724+0000 7fb0c0400700 1 -- 172.21.15.82:0/3873225216 shutdown_connections 2024-05-10T04:52:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.724+0000 7fb0c0400700 1 --2- 172.21.15.82:0/3873225216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d0d40 0x7fb0b80d3440 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.724+0000 7fb0c0400700 1 --2- 172.21.15.82:0/3873225216 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b8161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.724+0000 7fb0c0400700 1 -- 172.21.15.82:0/3873225216 >> 172.21.15.82:0/3873225216 conn(0x7fb0b806c3f0 msgr2=0x7fb0b806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.724+0000 7fb0c0400700 1 -- 172.21.15.82:0/3873225216 shutdown_connections 2024-05-10T04:52:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.724+0000 7fb0c0400700 1 -- 172.21.15.82:0/3873225216 wait complete. 2024-05-10T04:52:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.727+0000 7fb0c0400700 1 Processor -- start 2024-05-10T04:52:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.727+0000 7fb0c0400700 1 -- start start 2024-05-10T04:52:25.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0c0400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b80cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0c0400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0b80d0d40 0x7fb0b815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0c0400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d3030 0x7fb0b80ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0c0400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80cc460 con 0x7fb0b80d3030 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0c0400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b814d360 con 0x7fb0b80d0d40 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0c0400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b814e1c0 con 0x7fb0b80b2f50 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0be400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d3030 0x7fb0b80ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0be400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d3030 0x7fb0b80ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44676/0 (socket says 172.21.15.82:44676) 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0be400700 1 -- 172.21.15.82:0/1580494783 learned_addr learned my addr 172.21.15.82:0/1580494783 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0bd000700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0b80d0d40 0x7fb0b815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0bda00700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b80cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0be400700 1 -- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 msgr2=0x7fb0b80cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0be400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b80cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0be400700 1 -- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0b80d0d40 msgr2=0x7fb0b815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0be400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0b80d0d40 0x7fb0b815cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0be400700 1 -- 172.21.15.82:0/1580494783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b0009b30 con 0x7fb0b80d3030 2024-05-10T04:52:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0bda00700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b80cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.729+0000 7fb0bd000700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0b80d0d40 0x7fb0b815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.730+0000 7fb0be400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d3030 0x7fb0b80ca130 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000b730 tx=0x7fb0b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.730+0000 7fb0b5600700 1 -- 172.21.15.82:0/1580494783 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00092e0 con 0x7fb0b80d3030 2024-05-10T04:52:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.730+0000 7fb0b5600700 1 -- 172.21.15.82:0/1580494783 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b001b430 con 0x7fb0b80d3030 2024-05-10T04:52:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.730+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b814d0b0 con 0x7fb0b80d3030 2024-05-10T04:52:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.730+0000 7fb0b5600700 1 -- 172.21.15.82:0/1580494783 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b001b7e0 con 0x7fb0b80d3030 2024-05-10T04:52:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.730+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b814d890 con 0x7fb0b80d3030 2024-05-10T04:52:25.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.731+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b8074af0 con 0x7fb0b80d3030 2024-05-10T04:52:25.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.732+0000 7fb0b5600700 1 -- 172.21.15.82:0/1580494783 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0b001b940 con 0x7fb0b80d3030 2024-05-10T04:52:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.733+0000 7fb0b5600700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb09806ac90 0x7fb09806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.734+0000 7fb0b5600700 1 -- 172.21.15.82:0/1580494783 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb0b008a390 con 0x7fb0b80d3030 2024-05-10T04:52:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.734+0000 7fb0bda00700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb09806ac90 0x7fb09806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.734+0000 7fb0bda00700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb09806ac90 0x7fb09806d1a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb0b808d080 tx=0x7fb0ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.738+0000 7fb0b5600700 1 -- 172.21.15.82:0/1580494783 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb0b0055810 con 0x7fb0b80d3030 2024-05-10T04:52:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.993+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0b806c800 con 0x7fb09806ac90 2024-05-10T04:52:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.993+0000 7fb0b5600700 1 -- 172.21.15.82:0/1580494783 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0b806c800 con 0x7fb09806ac90 2024-05-10T04:52:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb09806ac90 msgr2=0x7fb09806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb09806ac90 0x7fb09806d1a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb0b808d080 tx=0x7fb0ac008040 comp rx=0 tx=0).stop 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d3030 msgr2=0x7fb0b80ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d3030 0x7fb0b80ca130 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000b730 tx=0x7fb0b0004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 shutdown_connections 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fb09806ac90 0x7fb09806d1a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0b80d3030 0x7fb0b80ca130 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fb0b80b2f50 0x7fb0b80cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 --2- 172.21.15.82:0/1580494783 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb0b80d0d40 0x7fb0b815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 >> 172.21.15.82:0/1580494783 conn(0x7fb0b806c3f0 msgr2=0x7fb0b81617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 shutdown_connections 2024-05-10T04:52:25.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:25.996+0000 7fb0c0400700 1 -- 172.21.15.82:0/1580494783 wait complete. 2024-05-10T04:52:25.999 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 6 to deep-scrub 2024-05-10T04:52:26.022 INFO:tasks.ceph:Scrubbing osd.7 2024-05-10T04:52:26.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-10T04:52:26.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.288+0000 7efe00c00700 1 Processor -- start 2024-05-10T04:52:26.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.288+0000 7efe00c00700 1 -- start start 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efe00c00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7efdfc09ae50 0x7efdfc0d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efe00c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efdfc09b260 0x7efdfc0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efe00c00700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0b7020 con 0x7efdfc0d05e0 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efe00c00700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0cde90 con 0x7efdfc09b260 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efe00c00700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0b1350 con 0x7efdfc09ae50 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdfa800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efdfc09b260 0x7efdfc0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdf9400700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efdfc0d05e0 0x7efdfc0b1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44454/0 (socket says 172.21.15.82:44454) 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdf9400700 1 -- 172.21.15.82:0/1122440070 learned_addr learned my addr 172.21.15.82:0/1122440070 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdf9e00700 1 --2- 172.21.15.82:0/1122440070 >> v2:172.21.15.129:3300/0 conn(0x7efdfc09ae50 0x7efdfc0d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdfa800700 1 -- 172.21.15.82:0/1122440070 >> v2:172.21.15.129:3300/0 conn(0x7efdfc09ae50 msgr2=0x7efdfc0d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:26.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdfa800700 1 --2- 172.21.15.82:0/1122440070 >> v2:172.21.15.129:3300/0 conn(0x7efdfc09ae50 0x7efdfc0d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdfa800700 1 -- 172.21.15.82:0/1122440070 >> v1:172.21.15.82:6789/0 conn(0x7efdfc0d05e0 legacy=0x7efdfc0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdfa800700 1 -- 172.21.15.82:0/1122440070 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0d0a90 con 0x7efdfc09b260 2024-05-10T04:52:26.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.290+0000 7efdf8a00700 1 -- 172.21.15.82:0/1122440070 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231868746 0 0) 0x7efdfc0b7020 con 0x7efdfc0d05e0 2024-05-10T04:52:26.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.291+0000 7efdfa800700 1 --2- 172.21.15.82:0/1122440070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc09b260 0x7efdfc0b2600 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efdfc073ec0 tx=0x7efdf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db846db2387908f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.291+0000 7efdf8a00700 1 -- 172.21.15.82:0/1122440070 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400e070 con 0x7efdfc09b260 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.291+0000 7efdf8a00700 1 -- 172.21.15.82:0/1122440070 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf400bbd0 con 0x7efdfc09b260 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.291+0000 7efdf8a00700 1 -- 172.21.15.82:0/1122440070 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4012430 con 0x7efdfc09b260 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.292+0000 7efe00c00700 1 -- 172.21.15.82:0/1122440070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc09b260 msgr2=0x7efdfc0b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.292+0000 7efe00c00700 1 --2- 172.21.15.82:0/1122440070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc09b260 0x7efdfc0b2600 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efdfc073ec0 tx=0x7efdf400b330 comp rx=0 tx=0).stop 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.292+0000 7efe00c00700 1 -- 172.21.15.82:0/1122440070 shutdown_connections 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.292+0000 7efe00c00700 1 --2- 172.21.15.82:0/1122440070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc09b260 0x7efdfc0b2600 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.292+0000 7efe00c00700 1 --2- 172.21.15.82:0/1122440070 >> v2:172.21.15.129:3300/0 conn(0x7efdfc09ae50 0x7efdfc0d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.292+0000 7efe00c00700 1 -- 172.21.15.82:0/1122440070 >> 172.21.15.82:0/1122440070 conn(0x7efdfc0ce670 msgr2=0x7efdfc0cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:26.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.292+0000 7efe00c00700 1 -- 172.21.15.82:0/1122440070 shutdown_connections 2024-05-10T04:52:26.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.292+0000 7efe00c00700 1 -- 172.21.15.82:0/1122440070 wait complete. 2024-05-10T04:52:26.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.294+0000 7efe00c00700 1 Processor -- start 2024-05-10T04:52:26.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.294+0000 7efe00c00700 1 -- start start 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efe00c00700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efdfc09ae50 0x7efdfc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efe00c00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdfc09b260 0x7efdfc09f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efe00c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc0d05e0 0x7efdfc0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efe00c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc1d6560 con 0x7efdfc0d05e0 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efe00c00700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0af750 con 0x7efdfc09b260 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efe00c00700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc09f5b0 con 0x7efdfc09ae50 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efdfa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc0d05e0 0x7efdfc0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efdfa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc0d05e0 0x7efdfc0b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53822/0 (socket says 172.21.15.82:53822) 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efdfa800700 1 -- 172.21.15.82:0/987234106 learned_addr learned my addr 172.21.15.82:0/987234106 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:26.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efdf9400700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdfc09b260 0x7efdfc09f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.296+0000 7efdf9e00700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efdfc09ae50 0x7efdfc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdfa800700 1 -- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efdfc09ae50 msgr2=0x7efdfc0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdfa800700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7efdfc09ae50 0x7efdfc0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdfa800700 1 -- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdfc09b260 msgr2=0x7efdfc09f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdfa800700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7efdfc09b260 0x7efdfc09f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdfa800700 1 -- 172.21.15.82:0/987234106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009a70 con 0x7efdfc0d05e0 2024-05-10T04:52:26.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdfa800700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc0d05e0 0x7efdfc0b5060 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efdf4014040 tx=0x7efdf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4012430 con 0x7efdfc0d05e0 2024-05-10T04:52:26.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4020070 con 0x7efdfc0d05e0 2024-05-10T04:52:26.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc0af9a0 con 0x7efdfc0d05e0 2024-05-10T04:52:26.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4004280 con 0x7efdfc0d05e0 2024-05-10T04:52:26.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.297+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc0aff60 con 0x7efdfc0d05e0 2024-05-10T04:52:26.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.298+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efdfc0b7290 con 0x7efdfc0d05e0 2024-05-10T04:52:26.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.299+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efdf40043e0 con 0x7efdfc0d05e0 2024-05-10T04:52:26.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.300+0000 7efdf2000700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efddc06acc0 0x7efddc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.300+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efdf4022070 con 0x7efdfc0d05e0 2024-05-10T04:52:26.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.301+0000 7efdf2000700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7efddc070c10 0x7efddc073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.301+0000 7efdf9e00700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efddc06acc0 0x7efddc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.301+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 --> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efddc073730 con 0x7efddc070c10 2024-05-10T04:52:26.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.301+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdf408b4e0 con 0x7efdfc0d05e0 2024-05-10T04:52:26.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.301+0000 7efdf9e00700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efddc06acc0 0x7efddc06d1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0b3560 tx=0x7efdec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.301+0000 7efdf9400700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7efddc070c10 0x7efddc073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.302+0000 7efdf9400700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7efddc070c10 0x7efddc073060 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.303+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 <== osd.7 v2:172.21.15.129:6824/44261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7efddc073730 con 0x7efddc070c10 2024-05-10T04:52:26.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.318+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 --> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efdfc0af5c0 con 0x7efddc070c10 2024-05-10T04:52:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.319+0000 7efdf2000700 1 -- 172.21.15.82:0/987234106 <== osd.7 v2:172.21.15.129:6824/44261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efdfc0af5c0 con 0x7efddc070c10 2024-05-10T04:52:26.320 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-10T04:52:26.321 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T04:52:26.321 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-10T04:52:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.319+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7efddc070c10 msgr2=0x7efddc073060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.319+0000 7efe00c00700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.129:6824/44261,v1:172.21.15.129:6825/44261] conn(0x7efddc070c10 0x7efddc073060 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.319+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efddc06acc0 msgr2=0x7efddc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.319+0000 7efe00c00700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7efddc06acc0 0x7efddc06d1d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0b3560 tx=0x7efdec008040 comp rx=0 tx=0).stop 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.319+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc0d05e0 msgr2=0x7efdfc0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.319+0000 7efe00c00700 1 --2- 172.21.15.82:0/987234106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efdfc0d05e0 0x7efdfc0b5060 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efdf4014040 tx=0x7efdf4004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.319+0000 7efdfa800700 1 -- 172.21.15.82:0/987234106 reap_dead start 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.320+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 shutdown_connections 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.320+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 >> 172.21.15.82:0/987234106 conn(0x7efdfc0ce670 msgr2=0x7efdfc09a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.320+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 shutdown_connections 2024-05-10T04:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.320+0000 7efe00c00700 1 -- 172.21.15.82:0/987234106 wait complete. 2024-05-10T04:52:26.347 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-10T04:52:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.612+0000 7f26df200700 1 Processor -- start 2024-05-10T04:52:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.612+0000 7f26df200700 1 -- start start 2024-05-10T04:52:26.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.613+0000 7f26df200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7f26e0161d40 0x7f26e00b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.613+0000 7f26df200700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26e00d0990 0x7f26e00d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26df200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e00b5bb0 con 0x7f26e00b3090 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26df200700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00cf6d0 con 0x7f26e00d0990 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26df200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00ceeb0 con 0x7f26e0161d40 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26de800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26e00d0990 0x7f26e00d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26d7e00700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f26e00b3090 0x7f26e00ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44470/0 (socket says 172.21.15.82:44470) 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26de800700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26e00d0990 0x7f26e00d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53824/0 (socket says 172.21.15.82:53824) 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26d7e00700 1 -- 172.21.15.82:0/3320676926 learned_addr learned my addr 172.21.15.82:0/3320676926 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26dde00700 1 --2- 172.21.15.82:0/3320676926 >> v2:172.21.15.129:3300/0 conn(0x7f26e0161d40 0x7f26e00b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26de800700 1 -- 172.21.15.82:0/3320676926 >> v2:172.21.15.129:3300/0 conn(0x7f26e0161d40 msgr2=0x7f26e00b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26de800700 1 --2- 172.21.15.82:0/3320676926 >> v2:172.21.15.129:3300/0 conn(0x7f26e0161d40 0x7f26e00b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26de800700 1 -- 172.21.15.82:0/3320676926 >> v1:172.21.15.82:6789/0 conn(0x7f26e00b3090 legacy=0x7f26e00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26dd400700 1 -- 172.21.15.82:0/3320676926 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613371557 0 0) 0x7f26e00b5bb0 con 0x7f26e00b3090 2024-05-10T04:52:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.614+0000 7f26de800700 1 -- 172.21.15.82:0/3320676926 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00d12e0 con 0x7f26e00d0990 2024-05-10T04:52:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.615+0000 7f26de800700 1 --2- 172.21.15.82:0/3320676926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00d0990 0x7f26e00d0da0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f26e008cbf0 tx=0x7f26d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a16d1b5d7e9f27 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.615+0000 7f26dd400700 1 -- 172.21.15.82:0/3320676926 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800e070 con 0x7f26e00d0990 2024-05-10T04:52:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.615+0000 7f26dd400700 1 -- 172.21.15.82:0/3320676926 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800bbd0 con 0x7f26e00d0990 2024-05-10T04:52:26.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.615+0000 7f26dd400700 1 -- 172.21.15.82:0/3320676926 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8012430 con 0x7f26e00d0990 2024-05-10T04:52:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.616+0000 7f26df200700 1 -- 172.21.15.82:0/3320676926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00d0990 msgr2=0x7f26e00d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.616+0000 7f26df200700 1 --2- 172.21.15.82:0/3320676926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00d0990 0x7f26e00d0da0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f26e008cbf0 tx=0x7f26d800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.616+0000 7f26df200700 1 -- 172.21.15.82:0/3320676926 shutdown_connections 2024-05-10T04:52:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.616+0000 7f26df200700 1 --2- 172.21.15.82:0/3320676926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00d0990 0x7f26e00d0da0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.616+0000 7f26df200700 1 --2- 172.21.15.82:0/3320676926 >> v2:172.21.15.129:3300/0 conn(0x7f26e0161d40 0x7f26e00b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.616+0000 7f26df200700 1 -- 172.21.15.82:0/3320676926 >> 172.21.15.82:0/3320676926 conn(0x7f26e006c580 msgr2=0x7f26e006c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.616+0000 7f26df200700 1 -- 172.21.15.82:0/3320676926 shutdown_connections 2024-05-10T04:52:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.616+0000 7f26df200700 1 -- 172.21.15.82:0/3320676926 wait complete. 2024-05-10T04:52:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.618+0000 7f26df200700 1 Processor -- start 2024-05-10T04:52:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.618+0000 7f26df200700 1 -- start start 2024-05-10T04:52:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.619+0000 7f26df200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00b3090 0x7f26e00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.619+0000 7f26df200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26e00d0990 0x7f26e01543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26df200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26e0161d40 0x7f26e00b8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26df200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01f57d0 con 0x7f26e00b3090 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26df200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00cd990 con 0x7f26e0161d40 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26df200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00c8300 con 0x7f26e00d0990 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26dde00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00b3090 0x7f26e00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26dde00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00b3090 0x7f26e00cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53842/0 (socket says 172.21.15.82:53842) 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26dde00700 1 -- 172.21.15.82:0/2286279523 learned_addr learned my addr 172.21.15.82:0/2286279523 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26d7e00700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26e00d0990 0x7f26e01543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26de800700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26e0161d40 0x7f26e00b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26dde00700 1 -- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26e00d0990 msgr2=0x7f26e01543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26dde00700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26e00d0990 0x7f26e01543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26dde00700 1 -- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26e0161d40 msgr2=0x7f26e00b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26dde00700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26e0161d40 0x7f26e00b8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26dde00700 1 -- 172.21.15.82:0/2286279523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d8009a70 con 0x7f26e00b3090 2024-05-10T04:52:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.620+0000 7f26d7e00700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26e00d0990 0x7f26e01543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.621+0000 7f26dde00700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00b3090 0x7f26e00cc610 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f26d000d800 tx=0x7f26d000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.621+0000 7f26d6000700 1 -- 172.21.15.82:0/2286279523 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0004240 con 0x7f26e00b3090 2024-05-10T04:52:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.621+0000 7f26d6000700 1 -- 172.21.15.82:0/2286279523 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d00043a0 con 0x7f26e00b3090 2024-05-10T04:52:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.621+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e00c85e0 con 0x7f26e00b3090 2024-05-10T04:52:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.621+0000 7f26d6000700 1 -- 172.21.15.82:0/2286279523 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d00036a0 con 0x7f26e00b3090 2024-05-10T04:52:26.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.621+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e00c8ba0 con 0x7f26e00b3090 2024-05-10T04:52:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.622+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e00b2910 con 0x7f26e00b3090 2024-05-10T04:52:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.623+0000 7f26d6000700 1 -- 172.21.15.82:0/2286279523 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f26d0003800 con 0x7f26e00b3090 2024-05-10T04:52:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.624+0000 7f26d6000700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26bc06ac90 0x7f26bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.624+0000 7f26d6000700 1 -- 172.21.15.82:0/2286279523 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f26d0088e20 con 0x7f26e00b3090 2024-05-10T04:52:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.624+0000 7f26d7e00700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26bc06ac90 0x7f26bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.625+0000 7f26d7e00700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26bc06ac90 0x7f26bc06d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f26e00cc5a0 tx=0x7f26c8007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.628+0000 7f26d6000700 1 -- 172.21.15.82:0/2286279523 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f26d0054210 con 0x7f26e00b3090 2024-05-10T04:52:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.831+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f26e00cf3f0 con 0x7f26bc06ac90 2024-05-10T04:52:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.831+0000 7f26d6000700 1 -- 172.21.15.82:0/2286279523 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f26c8004870 con 0x7f26bc06ac90 2024-05-10T04:52:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26bc06ac90 msgr2=0x7f26bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26bc06ac90 0x7f26bc06d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f26e00cc5a0 tx=0x7f26c8007d30 comp rx=0 tx=0).stop 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00b3090 msgr2=0x7f26e00cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00b3090 0x7f26e00cc610 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f26d000d800 tx=0x7f26d000db10 comp rx=0 tx=0).stop 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 shutdown_connections 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f26bc06ac90 0x7f26bc06d1a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26e0161d40 0x7f26e00b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26e00b3090 0x7f26e00cc610 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 --2- 172.21.15.82:0/2286279523 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f26e00d0990 0x7f26e01543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 >> 172.21.15.82:0/2286279523 conn(0x7f26e006c580 msgr2=0x7f26e0161060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 shutdown_connections 2024-05-10T04:52:26.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:26.834+0000 7f26df200700 1 -- 172.21.15.82:0/2286279523 wait complete. 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 7 to deep-scrub 2024-05-10T04:52:26.863 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:27.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.127+0000 7fd136400700 1 Processor -- start 2024-05-10T04:52:27.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.127+0000 7fd136400700 1 -- start start 2024-05-10T04:52:27.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.129+0000 7fd136400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 0x7fd1300cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.129+0000 7fd136400700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd13015df40 0x7fd1300d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.129+0000 7fd136400700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300d3500 con 0x7fd13015e350 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.129+0000 7fd136400700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd130161e40 con 0x7fd13015df40 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.129+0000 7fd136400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd130162120 con 0x7fd1300b2ca0 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.129+0000 7fd12fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd13015df40 0x7fd1300d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.130+0000 7fd12fe00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd13015df40 0x7fd1300d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53844/0 (socket says 172.21.15.82:53844) 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.130+0000 7fd12fe00700 1 -- 172.21.15.82:0/3726020882 learned_addr learned my addr 172.21.15.82:0/3726020882 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.130+0000 7fd12fe00700 1 -- 172.21.15.82:0/3726020882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 msgr2=0x7fd1300cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.130+0000 7fd12fe00700 1 --2- 172.21.15.82:0/3726020882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 0x7fd1300cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.130+0000 7fd12fe00700 1 -- 172.21.15.82:0/3726020882 >> v1:172.21.15.129:6789/0 conn(0x7fd13015e350 legacy=0x7fd1300b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.130+0000 7fd12fe00700 1 -- 172.21.15.82:0/3726020882 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130162400 con 0x7fd13015df40 2024-05-10T04:52:27.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.130+0000 7fd12fe00700 1 --2- 172.21.15.82:0/3726020882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015df40 0x7fd1300d03b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0098f0 tx=0x7fd11c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6889cec3bca5827c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.130+0000 7fd12f400700 1 -- 172.21.15.82:0/3726020882 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c004230 con 0x7fd13015df40 2024-05-10T04:52:27.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd12f400700 1 -- 172.21.15.82:0/3726020882 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c004390 con 0x7fd13015df40 2024-05-10T04:52:27.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd12f400700 1 -- 172.21.15.82:0/3726020882 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0036a0 con 0x7fd13015df40 2024-05-10T04:52:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd136400700 1 -- 172.21.15.82:0/3726020882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015df40 msgr2=0x7fd1300d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd136400700 1 --2- 172.21.15.82:0/3726020882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015df40 0x7fd1300d03b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0098f0 tx=0x7fd11c009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd136400700 1 -- 172.21.15.82:0/3726020882 shutdown_connections 2024-05-10T04:52:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd136400700 1 --2- 172.21.15.82:0/3726020882 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 0x7fd1300cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd136400700 1 --2- 172.21.15.82:0/3726020882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015df40 0x7fd1300d03b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd136400700 1 -- 172.21.15.82:0/3726020882 >> 172.21.15.82:0/3726020882 conn(0x7fd130067600 msgr2=0x7fd13006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd136400700 1 -- 172.21.15.82:0/3726020882 shutdown_connections 2024-05-10T04:52:27.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.131+0000 7fd136400700 1 -- 172.21.15.82:0/3726020882 wait complete. 2024-05-10T04:52:27.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.134+0000 7fd136400700 1 Processor -- start 2024-05-10T04:52:27.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.134+0000 7fd136400700 1 -- start start 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.135+0000 7fd136400700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 0x7fd13015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.135+0000 7fd136400700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd13015df40 0x7fd1300b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.135+0000 7fd136400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015e350 0x7fd1300b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.135+0000 7fd136400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300c89d0 con 0x7fd13015e350 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.135+0000 7fd136400700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300b4660 con 0x7fd13015df40 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.135+0000 7fd136400700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1300b61f0 con 0x7fd1300b2ca0 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015e350 0x7fd1300b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015e350 0x7fd1300b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53850/0 (socket says 172.21.15.82:53850) 2024-05-10T04:52:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 -- 172.21.15.82:0/3682831490 learned_addr learned my addr 172.21.15.82:0/3682831490 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd12fe00700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd13015df40 0x7fd1300b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135000700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 0x7fd13015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 -- 172.21.15.82:0/3682831490 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 msgr2=0x7fd13015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 0x7fd13015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 -- 172.21.15.82:0/3682831490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd13015df40 msgr2=0x7fd1300b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd13015df40 0x7fd1300b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 -- 172.21.15.82:0/3682831490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c009550 con 0x7fd13015e350 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.136+0000 7fd135a00700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015e350 0x7fd1300b3af0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b990 tx=0x7fd12800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.137+0000 7fd12cc00700 1 -- 172.21.15.82:0/3682831490 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12800d890 con 0x7fd13015e350 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.137+0000 7fd12cc00700 1 -- 172.21.15.82:0/3682831490 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12800d9f0 con 0x7fd13015e350 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.137+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1300b4900 con 0x7fd13015e350 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.137+0000 7fd12cc00700 1 -- 172.21.15.82:0/3682831490 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12800dda0 con 0x7fd13015e350 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.137+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13015acc0 con 0x7fd13015e350 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.138+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1300b4c70 con 0x7fd13015e350 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.139+0000 7fd12cc00700 1 -- 172.21.15.82:0/3682831490 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd128006d50 con 0x7fd13015e350 2024-05-10T04:52:27.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.140+0000 7fd12cc00700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd11006ac90 0x7fd11006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.140+0000 7fd12cc00700 1 -- 172.21.15.82:0/3682831490 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd128089080 con 0x7fd13015e350 2024-05-10T04:52:27.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.140+0000 7fd135000700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd11006ac90 0x7fd11006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.141+0000 7fd135000700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd11006ac90 0x7fd11006d1a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd124009970 tx=0x7fd124009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.145+0000 7fd12cc00700 1 -- 172.21.15.82:0/3682831490 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd128054470 con 0x7fd13015e350 2024-05-10T04:52:27.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.345+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1300cf690 con 0x7fd11006ac90 2024-05-10T04:52:27.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.348+0000 7fd12cc00700 1 -- 172.21.15.82:0/3682831490 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50349 (secure 0 0 0) 0x7fd1240095c0 con 0x7fd11006ac90 2024-05-10T04:52:27.350 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd11006ac90 msgr2=0x7fd11006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd11006ac90 0x7fd11006d1a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd124009970 tx=0x7fd124009110 comp rx=0 tx=0).stop 2024-05-10T04:52:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015e350 msgr2=0x7fd1300b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015e350 0x7fd1300b3af0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b990 tx=0x7fd12800bca0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 shutdown_connections 2024-05-10T04:52:27.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd11006ac90 0x7fd11006d1a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13015e350 0x7fd1300b3af0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd1300b2ca0 0x7fd13015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 --2- 172.21.15.82:0/3682831490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd13015df40 0x7fd1300b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 >> 172.21.15.82:0/3682831490 conn(0x7fd130067600 msgr2=0x7fd13015e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 shutdown_connections 2024-05-10T04:52:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:27.350+0000 7fd136400700 1 -- 172.21.15.82:0/3682831490 wait complete. 2024-05-10T04:52:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:52:27.381 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-05-10T04:52:26.997198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220880,"kb_used_data":4712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753840,"statfs":{"total":773094113280,"available":772867932160,"internally_reserved":0,"allocated":4825088,"data_stored":2626464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002379"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-10T04:52:13.270420+0000","last_change":"2024-05-10T04:50:06.588699+0000","last_active":"2024-05-10T04:52:13.270420+0000","last_peered":"2024-05-10T04:52:13.270420+0000","last_clean":"2024-05-10T04:52:13.270420+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:52:13.270420+0000","last_undegraded":"2024-05-10T04:52:13.270420+0000","last_fullsized":"2024-05-10T04:52:13.270420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:50:05.239043+0000","last_clean_scrub_stamp":"2024-05-10T04:50:05.239043+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:21.454263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":771084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.438,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":1.268,"15min":1.268},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95199999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.337,"15min":1.337},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.86599999999999999}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.745},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2230000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.56999999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.63700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.266,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.63100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.62},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0209999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.028,"5min":1.26,"15min":1.26},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59899999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.753,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.628},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.63100000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96699999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.752}]},{"osd":7,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.288,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":771084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58899999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.58199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51800000000000002}]},{"osd":3,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.437},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0349999999999999,"5min":1.242,"15min":1.242},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.89100000000000001,"5min":1.397,"15min":1.397},"last":0.93100000000000005}]},{"osd":5,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.876},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.91100000000000003,"5min":1.03,"15min":1.03},"last":0.751}]},{"osd":6,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81599999999999995,"15min":0.82499999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.93899999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83599999999999997},"min":{"1min":0.60299999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.131,"15min":1.131},"last":0.78300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.73799999999999999,"15min":0.79200000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.51800000000000002,"5min":5.266,"15min":5.266},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.70099999999999996,"15min":0.748},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.62,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.373}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.58199999999999996,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58199999999999996,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.77000000000000002,"15min":0.81599999999999995},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.60699999999999998,"5min":5.8520000000000003,"15min":5.8520000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.65400000000000003,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84299999999999997,"15min":0.84799999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1419999999999999,"5min":2.157,"15min":2.157},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.91900000000000004,"15min":0.94899999999999995},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94999999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.77900000000000003}]},{"osd":5,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.99399999999999999,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.94399999999999995,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86399999999999999,"15min":0.875},"min":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.97199999999999998,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.93100000000000005,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0700000000000001,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.022,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.61399999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.95399999999999996,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":1.056,"15min":1.0940000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.196,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.80000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.438,"15min":0.442},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.443},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71899999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65900000000000003}]},{"osd":4,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.143,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.995,"5min":1.198,"15min":1.198},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1759999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.097,"5min":1.113,"15min":1.113},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.117,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.998,"5min":1.516,"15min":1.516},"last":0.64400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.52400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.54700000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.90500000000000003}]},{"osd":1,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.879}]},{"osd":2,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":5.0670000000000002,"15min":5.0670000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":1.014},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98099999999999998,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.68000000000000005}]},{"osd":3,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55900000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.65000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45200000000000001}]},{"osd":6,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.52100000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.871,"5min":1.087,"15min":1.087},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92200000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.64300000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97399999999999998,"5min":1.024,"15min":1.024},"last":0.51900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0169999999999999,"5min":1.595,"15min":1.595},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.099,"15min":1.099},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98199999999999998,"5min":1.349,"15min":1.349},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96299999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93400000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.85099999999999998}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68999999999999995,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2250000000000001,"5min":1.554,"15min":1.554},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92900000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.61699999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.056,"5min":1.625,"15min":1.625},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:27.388 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T04:50:05.239043+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=50, tm_sec=5, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=52, tm_sec=19, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T04:52:27.388 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T04:52:35.758 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:35.763 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:47.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:47.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.663+0000 7fd50b200700 1 Processor -- start 2024-05-10T04:52:47.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.663+0000 7fd50b200700 1 -- start start 2024-05-10T04:52:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.665+0000 7fd50b200700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fd50415df40 0x7fd5040d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.665+0000 7fd50b200700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd504161e40 con 0x7fd50415e350 2024-05-10T04:52:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.665+0000 7fd50b200700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd504162120 con 0x7fd5040b2ca0 2024-05-10T04:52:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.665+0000 7fd50b200700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd504162400 con 0x7fd50415df40 2024-05-10T04:52:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.665+0000 7fd50a800700 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd50415e350 0x7fd5040d24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58840/0 (socket says 172.21.15.82:58840) 2024-05-10T04:52:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.665+0000 7fd50a800700 1 -- 172.21.15.82:0/1312222038 learned_addr learned my addr 172.21.15.82:0/1312222038 (peer_addr_for_me v1:172.21.15.82:0/0) 2024-05-10T04:52:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd509400700 1 --2- 172.21.15.82:0/1312222038 >> v2:172.21.15.129:3300/0 conn(0x7fd50415df40 0x7fd5040d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253839757 0 0) 0x7fd504161e40 con 0x7fd50415e350 2024-05-10T04:52:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4ec0035b0 con 0x7fd50415e350 2024-05-10T04:52:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 <== mon.1 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232596860 0 0) 0x7fd504162120 con 0x7fd5040b2ca0 2024-05-10T04:52:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd504161e40 con 0x7fd5040b2ca0 2024-05-10T04:52:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3561701489 0 0) 0x7fd4ec0035b0 con 0x7fd50415e350 2024-05-10T04:52:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 >> v2:172.21.15.129:3300/0 conn(0x7fd50415df40 msgr2=0x7fd5040d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 --2- 172.21.15.82:0/1312222038 >> v2:172.21.15.129:3300/0 conn(0x7fd50415df40 0x7fd5040d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 >> v1:172.21.15.129:6789/0 conn(0x7fd5040b2ca0 legacy=0x7fd5040cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5041626e0 con 0x7fd50415e350 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2199958106 0 0) 0x7fd5000019f0 con 0x7fd50415e350 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 >> v1:172.21.15.82:6789/0 conn(0x7fd50415e350 legacy=0x7fd5040d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec003b90 0x7fd4ec003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec004850 0x7fd4ec004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd4ec005320 0x7fd4ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.666+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504162400 con 0x7fd4ec003b90 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec00c2b0 con 0x7fd4ec004850 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec00c470 con 0x7fd4ec005320 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd509e00700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec003b90 0x7fd4ec003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd509400700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec004850 0x7fd4ec004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd50a800700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd4ec005320 0x7fd4ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd509e00700 1 -- 172.21.15.82:0/1312222038 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd4ec005320 msgr2=0x7fd4ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd509e00700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd4ec005320 0x7fd4ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd509e00700 1 -- 172.21.15.82:0/1312222038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec004850 msgr2=0x7fd4ec004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd509e00700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec004850 0x7fd4ec004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd509e00700 1 -- 172.21.15.82:0/1312222038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec0035b0 con 0x7fd4ec003b90 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd50a800700 1 -- 172.21.15.82:0/1312222038 reap_dead start 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.667+0000 7fd509e00700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec003b90 0x7fd4ec003fe0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8001940 tx=0x7fd4ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334edf37310662d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8001430 con 0x7fd4ec003b90 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8001d70 con 0x7fd4ec003b90 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd508a00700 1 -- 172.21.15.82:0/1312222038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8005530 con 0x7fd4ec003b90 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd50b200700 1 -- 172.21.15.82:0/1312222038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec003b90 msgr2=0x7fd4ec003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd50b200700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec003b90 0x7fd4ec003fe0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8001940 tx=0x7fd4ec005880 comp rx=0 tx=0).stop 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd50b200700 1 -- 172.21.15.82:0/1312222038 shutdown_connections 2024-05-10T04:52:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd50b200700 1 --2- 172.21.15.82:0/1312222038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4ec003b90 0x7fd4ec003fe0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd50b200700 1 -- 172.21.15.82:0/1312222038 >> 172.21.15.82:0/1312222038 conn(0x7fd504067600 msgr2=0x7fd50406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd50b200700 1 -- 172.21.15.82:0/1312222038 shutdown_connections 2024-05-10T04:52:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.668+0000 7fd50b200700 1 -- 172.21.15.82:0/1312222038 wait complete. 2024-05-10T04:52:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.671+0000 7fd50b200700 1 Processor -- start 2024-05-10T04:52:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.671+0000 7fd50b200700 1 -- start start 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.672+0000 7fd50b200700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec003b90 0x7fd504151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.672+0000 7fd50b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5040b4600 0x7fd50415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.672+0000 7fd50b200700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd5040b4a10 0x7fd50415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.672+0000 7fd50b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5040b57d0 con 0x7fd5040b4600 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.672+0000 7fd50b200700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5040b5d00 con 0x7fd4ec003b90 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.672+0000 7fd50b200700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5041f3f60 con 0x7fd5040b4a10 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5040b4600 0x7fd50415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5040b4600 0x7fd50415ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59192/0 (socket says 172.21.15.82:59192) 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 -- 172.21.15.82:0/3275290271 learned_addr learned my addr 172.21.15.82:0/3275290271 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509e00700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec003b90 0x7fd504151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd50a800700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd5040b4a10 0x7fd50415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 -- 172.21.15.82:0/3275290271 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd5040b4a10 msgr2=0x7fd50415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd5040b4a10 0x7fd50415bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 -- 172.21.15.82:0/3275290271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec003b90 msgr2=0x7fd504151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec003b90 0x7fd504151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 -- 172.21.15.82:0/3275290271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5040b4fc0 con 0x7fd5040b4600 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.673+0000 7fd509400700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5040b4600 0x7fd50415ba40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4011ad0 tx=0x7fd4f4011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.674+0000 7fd4fe000700 1 -- 172.21.15.82:0/3275290271 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4009630 con 0x7fd5040b4600 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.674+0000 7fd4fe000700 1 -- 172.21.15.82:0/3275290271 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400f940 con 0x7fd5040b4600 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.674+0000 7fd4fe000700 1 -- 172.21.15.82:0/3275290271 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400fcf0 con 0x7fd5040b4600 2024-05-10T04:52:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.674+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5041f3d50 con 0x7fd5040b4600 2024-05-10T04:52:47.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.674+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5040b54f0 con 0x7fd5040b4600 2024-05-10T04:52:47.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.675+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd504074af0 con 0x7fd5040b4600 2024-05-10T04:52:47.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.676+0000 7fd4fe000700 1 -- 172.21.15.82:0/3275290271 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd4f4014440 con 0x7fd5040b4600 2024-05-10T04:52:47.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.677+0000 7fd4fe000700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd4e806ac90 0x7fd4e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:47.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.677+0000 7fd4fe000700 1 -- 172.21.15.82:0/3275290271 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd4f4089710 con 0x7fd5040b4600 2024-05-10T04:52:47.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.677+0000 7fd509e00700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd4e806ac90 0x7fd4e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:47.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.678+0000 7fd509e00700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd4e806ac90 0x7fd4e806d1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8005040 tx=0x7fd4f800a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:47.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.682+0000 7fd4fe000700 1 -- 172.21.15.82:0/3275290271 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd4f4054b00 con 0x7fd5040b4600 2024-05-10T04:52:47.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.882+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 --> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5040cf150 con 0x7fd4e806ac90 2024-05-10T04:52:47.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.884+0000 7fd4fe000700 1 -- 172.21.15.82:0/3275290271 <== mgr.4102 v2:172.21.15.82:6832/43622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50324 (secure 0 0 0) 0x7fd4f80051d0 con 0x7fd4e806ac90 2024-05-10T04:52:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd4e806ac90 msgr2=0x7fd4e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd4e806ac90 0x7fd4e806d1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8005040 tx=0x7fd4f800a000 comp rx=0 tx=0).stop 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5040b4600 msgr2=0x7fd50415ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5040b4600 0x7fd50415ba40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4011ad0 tx=0x7fd4f4011de0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 shutdown_connections 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fd4e806ac90 0x7fd4e806d1a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fd5040b4a10 0x7fd50415bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd4ec003b90 0x7fd504151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 --2- 172.21.15.82:0/3275290271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5040b4600 0x7fd50415ba40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 >> 172.21.15.82:0/3275290271 conn(0x7fd504067600 msgr2=0x7fd5040c6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:47.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 shutdown_connections 2024-05-10T04:52:47.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:47.887+0000 7fd50b200700 1 -- 172.21.15.82:0/3275290271 wait complete. 2024-05-10T04:52:47.890 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-10T04:52:47.917 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-05-10T04:52:47.001715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220868,"kb_used_data":4712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753852,"statfs":{"total":773094113280,"available":772867944448,"internally_reserved":0,"allocated":4825088,"data_stored":2626464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002729"},"pg_stats":[{"pgid":"1.0","version":"39'119","reported_seq":194,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-10T04:52:27.253167+0000","last_change":"2024-05-10T04:52:27.253317+0000","last_active":"2024-05-10T04:52:27.253167+0000","last_peered":"2024-05-10T04:52:27.253167+0000","last_clean":"2024-05-10T04:52:27.253167+0000","last_became_active":"2024-05-10T04:50:06.587479+0000","last_became_peered":"2024-05-10T04:50:06.587479+0000","last_unstale":"2024-05-10T04:52:27.253167+0000","last_undegraded":"2024-05-10T04:52:27.253167+0000","last_fullsized":"2024-05-10T04:52:27.253167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-05-10T04:52:27.253137+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-05-10T04:52:27.253137+0000","last_clean_scrub_stamp":"2024-05-10T04:52:27.253137+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:25:33.566232+0000","scrub_duration":0.0072185970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1048576,"data_stored":771084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.438,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.76000000000000001}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":1.268,"15min":1.268},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.95199999999999996,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.337,"15min":1.337},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.51400000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.48699999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2230000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0669999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.77700000000000002},"min":{"1min":0.56999999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82199999999999995,"15min":0.81499999999999995},"min":{"1min":0.63700000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.81699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.266,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.72099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.52000000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.94699999999999995,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":1.002}]},{"osd":2,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.56999999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.90500000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.86599999999999999}]},{"osd":4,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.71799999999999997},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.754},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.53800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94399999999999995,"5min":1.095,"15min":1.095},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0209999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri May 10 04:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.028,"5min":1.26,"15min":1.26},"last":0.92700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.46999999999999997,"15min":0.48099999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.59899999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.43099999999999999,"15min":0.433},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.57699999999999996,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66300000000000003,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.438,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.76800000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.747},{"interface":"front","average":{"1min":0.499,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":1.05},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.1140000000000001}]},{"osd":5,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.753,"15min":0.751},"min":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.034}]},{"osd":6,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.63100000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96699999999999997,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0149999999999999}]},{"osd":7,"last update":"Fri May 10 04:52:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.82599999999999996,"15min":0.83399999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.218,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.877,"15min":0.89100000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.288,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":1.145}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1048576,"data_stored":771084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.437},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58899999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49199999999999999,"15min":0.48799999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50800000000000001,"15min":0.51600000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.58199999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63400000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.0349999999999999,"5min":1.242,"15min":1.242},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.82199999999999995,"15min":0.83199999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.89100000000000001,"5min":1.397,"15min":1.397},"last":0.83699999999999997}]},{"osd":5,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60699999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.91100000000000003,"5min":1.03,"15min":1.03},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.81599999999999995,"15min":0.82499999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.93899999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83599999999999997},"min":{"1min":0.60299999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.84799999999999998}]},{"osd":7,"last update":"Fri May 10 04:52:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.131,"15min":1.131},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.73799999999999999,"15min":0.79200000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.51800000000000002,"5min":5.266,"15min":5.266},"last":0.5},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.70099999999999996,"15min":0.748},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.62,"5min":4.8140000000000001,"15min":4.8140000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.55800000000000005,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.58199999999999996,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.57799999999999996,"15min":0.59499999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58199999999999996,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.77000000000000002,"15min":0.81599999999999995},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.60699999999999998,"5min":5.8520000000000003,"15min":5.8520000000000003},"last":0.628},{"interface":"front","average":{"1min":0.503,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.65400000000000003,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.84299999999999997,"15min":0.84799999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1419999999999999,"5min":2.157,"15min":2.157},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.91900000000000004,"15min":0.94899999999999995},"min":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.94999999999999996,"5min":3.7320000000000002,"15min":3.7320000000000002},"last":0.89800000000000002}]},{"osd":5,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.99399999999999999,"15min":1.036},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.94399999999999995,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86399999999999999,"15min":0.875},"min":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.97199999999999998,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.98199999999999998}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.93100000000000005,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0700000000000001,"5min":3.8149999999999999,"15min":3.8149999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.044,"15min":1.0840000000000001},"min":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.022,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.61399999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.95399999999999996,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":1.056,"15min":1.0940000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.196,"5min":5.6829999999999998,"15min":5.6829999999999998},"last":0.84099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.438,"15min":0.442},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.437}]},{"osd":1,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52700000000000002,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71899999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.746,"15min":0.74199999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.143,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.94899999999999995}]},{"osd":5,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.995,"5min":1.198,"15min":1.198},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1759999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.097,"5min":1.113,"15min":1.113},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri May 10 04:52:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.117,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.998,"5min":1.516,"15min":1.516},"last":0.92400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.65400000000000003,"15min":0.64400000000000002},"min":{"1min":0.52400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.54700000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.93300000000000005}]},{"osd":2,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96499999999999997,"5min":5.0670000000000002,"15min":5.0670000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.96999999999999997,"15min":1.014},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.98099999999999998,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":0.85699999999999998}]},{"osd":3,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55900000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76700000000000002,"15min":0.75700000000000001},"min":{"1min":0.65000000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.52100000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.871,"5min":1.087,"15min":1.087},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.92200000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri May 10 04:52:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.64300000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.97399999999999998,"5min":1.024,"15min":1.024},"last":0.753}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":180716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.872}]},{"osd":1,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79700000000000004,"15min":0.81000000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0169999999999999,"5min":1.595,"15min":1.595},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97499999999999998,"5min":1.099,"15min":1.099},"last":0.91800000000000004}]},{"osd":2,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98199999999999998,"5min":1.349,"15min":1.349},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.751,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96299999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93400000000000005,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.998,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.68999999999999995,"15min":0.69999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.79800000000000004,"15min":0.80500000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2250000000000001,"5min":1.554,"15min":1.554},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.76300000000000001,"15min":0.77100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92900000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.629}]},{"osd":7,"last update":"Fri May 10 04:52:05 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84899999999999998,"15min":0.85699999999999998},"min":{"1min":0.61699999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.056,"5min":1.625,"15min":1.625},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.63,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.73699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:47.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-10T04:52:48.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.174+0000 7fada9000700 1 Processor -- start 2024-05-10T04:52:48.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.174+0000 7fada9000700 1 -- start start 2024-05-10T04:52:48.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.176+0000 7fada9000700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fada40b13a0 0x7fada40b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.176+0000 7fada9000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 0x7fada40cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.176+0000 7fada9000700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada40cb9d0 con 0x7fada40b1fe0 2024-05-10T04:52:48.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.176+0000 7fada9000700 1 -- --> v2:172.21.15.129:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada415ec70 con 0x7fada40b13a0 2024-05-10T04:52:48.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.176+0000 7fada9000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada40b17b0 con 0x7fada40d05b0 2024-05-10T04:52:48.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fada1e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fada40b13a0 0x7fada40b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fada1e00700 1 --2- >> v2:172.21.15.129:3300/0 conn(0x7fada40b13a0 0x7fada40b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.129:3300/0 says I am v2:172.21.15.82:40164/0 (socket says 172.21.15.82:40164) 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fada1e00700 1 -- 172.21.15.82:0/2001308794 learned_addr learned my addr 172.21.15.82:0/2001308794 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fada2800700 1 --2- 172.21.15.82:0/2001308794 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 0x7fada40cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fad9be00700 1 --1- 172.21.15.82:0/2001308794 >> v1:172.21.15.129:6789/0 conn(0x7fada40b1fe0 0x7fada40cfea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.82:59262/0 (socket says 172.21.15.82:59262) 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fada1e00700 1 -- 172.21.15.82:0/2001308794 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 msgr2=0x7fada40cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fada1e00700 1 --2- 172.21.15.82:0/2001308794 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 0x7fada40cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fada1e00700 1 -- 172.21.15.82:0/2001308794 >> v1:172.21.15.129:6789/0 conn(0x7fada40b1fe0 legacy=0x7fada40cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.177+0000 7fada1e00700 1 -- 172.21.15.82:0/2001308794 --> v2:172.21.15.129:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada40ce240 con 0x7fada40b13a0 2024-05-10T04:52:48.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.178+0000 7fada1e00700 1 --2- 172.21.15.82:0/2001308794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b13a0 0x7fada40b39e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fad940098f0 tx=0x7fad94009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae384b232af241d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:48.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.178+0000 7fada1400700 1 -- 172.21.15.82:0/2001308794 <== mon.1 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94011830 con 0x7fada40b13a0 2024-05-10T04:52:48.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.178+0000 7fada1400700 1 -- 172.21.15.82:0/2001308794 <== mon.1 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad94011990 con 0x7fada40b13a0 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.178+0000 7fada1400700 1 -- 172.21.15.82:0/2001308794 <== mon.1 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94011d20 con 0x7fada40b13a0 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.179+0000 7fada9000700 1 -- 172.21.15.82:0/2001308794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b13a0 msgr2=0x7fada40b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.179+0000 7fada9000700 1 --2- 172.21.15.82:0/2001308794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b13a0 0x7fada40b39e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fad940098f0 tx=0x7fad94009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.179+0000 7fada9000700 1 -- 172.21.15.82:0/2001308794 shutdown_connections 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.179+0000 7fada9000700 1 --2- 172.21.15.82:0/2001308794 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b13a0 0x7fada40b39e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.179+0000 7fada9000700 1 --2- 172.21.15.82:0/2001308794 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 0x7fada40cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.179+0000 7fada9000700 1 -- 172.21.15.82:0/2001308794 >> 172.21.15.82:0/2001308794 conn(0x7fada40b26a0 msgr2=0x7fada40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.179+0000 7fada9000700 1 -- 172.21.15.82:0/2001308794 shutdown_connections 2024-05-10T04:52:48.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.179+0000 7fada9000700 1 -- 172.21.15.82:0/2001308794 wait complete. 2024-05-10T04:52:48.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.181+0000 7fada9000700 1 Processor -- start 2024-05-10T04:52:48.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.182+0000 7fada9000700 1 -- start start 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada9000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada40b13a0 0x7fada41f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada9000700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b1fe0 0x7fada4153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada9000700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 0x7fada40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada9000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada40c5c10 con 0x7fada40b13a0 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada9000700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada40c65e0 con 0x7fada40b1fe0 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada9000700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada41543e0 con 0x7fada40d05b0 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada40b13a0 0x7fada41f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada40b13a0 0x7fada41f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59194/0 (socket says 172.21.15.82:59194) 2024-05-10T04:52:48.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.183+0000 7fada1e00700 1 -- 172.21.15.82:0/1124527387 learned_addr learned my addr 172.21.15.82:0/1124527387 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fada1e00700 1 -- 172.21.15.82:0/1124527387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 msgr2=0x7fada40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fada1e00700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 0x7fada40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fad9be00700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b1fe0 0x7fada4153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fada1e00700 1 -- 172.21.15.82:0/1124527387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b1fe0 msgr2=0x7fada4153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fada1e00700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b1fe0 0x7fada4153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fada1e00700 1 -- 172.21.15.82:0/1124527387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94009550 con 0x7fada40b13a0 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fad9be00700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b1fe0 0x7fada4153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fada1e00700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada40b13a0 0x7fada41f4610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fad94009c40 tx=0x7fad94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fad9a000700 1 -- 172.21.15.82:0/1124527387 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad940036a0 con 0x7fada40b13a0 2024-05-10T04:52:48.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fad9a000700 1 -- 172.21.15.82:0/1124527387 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9401e070 con 0x7fada40b13a0 2024-05-10T04:52:48.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada40c9f20 con 0x7fada40b13a0 2024-05-10T04:52:48.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fad9a000700 1 -- 172.21.15.82:0/1124527387 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94003a60 con 0x7fada40b13a0 2024-05-10T04:52:48.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.184+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada40c6b10 con 0x7fada40b13a0 2024-05-10T04:52:48.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.185+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada4074af0 con 0x7fada40b13a0 2024-05-10T04:52:48.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.186+0000 7fad9a000700 1 -- 172.21.15.82:0/1124527387 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad94003bc0 con 0x7fada40b13a0 2024-05-10T04:52:48.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.188+0000 7fad9a000700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad8006acc0 0x7fad8006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.188+0000 7fad9a000700 1 -- 172.21.15.82:0/1124527387 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fad9408a060 con 0x7fada40b13a0 2024-05-10T04:52:48.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.188+0000 7fad9be00700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad8006acc0 0x7fad8006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.189+0000 7fad9be00700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad8006acc0 0x7fad8006d1d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fada40b34c0 tx=0x7fad8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:48.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.193+0000 7fad9a000700 1 -- 172.21.15.82:0/1124527387 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fad940bd900 con 0x7fada40b13a0 2024-05-10T04:52:48.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.399+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fada40b66c0 con 0x7fada40b13a0 2024-05-10T04:52:48.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.404+0000 7fad9a000700 1 -- 172.21.15.82:0/1124527387 <== mon.0 v2:172.21.15.82:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad94003e70 con 0x7fada40b13a0 2024-05-10T04:52:48.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.404+0000 7fad9a000700 1 -- 172.21.15.82:0/1124527387 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fad940200c0 con 0x7fada40b13a0 2024-05-10T04:52:48.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad8006acc0 msgr2=0x7fad8006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad8006acc0 0x7fad8006d1d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fada40b34c0 tx=0x7fad8c009040 comp rx=0 tx=0).stop 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada40b13a0 msgr2=0x7fada41f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada40b13a0 0x7fada41f4610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fad94009c40 tx=0x7fad94004750 comp rx=0 tx=0).stop 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 shutdown_connections 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7fad8006acc0 0x7fad8006d1d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7fada40d05b0 0x7fada40b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fada40b13a0 0x7fada41f4610 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 --2- 172.21.15.82:0/1124527387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fada40b1fe0 0x7fada4153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 >> 172.21.15.82:0/1124527387 conn(0x7fada40b26a0 msgr2=0x7fada40742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 shutdown_connections 2024-05-10T04:52:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.407+0000 7fada9000700 1 -- 172.21.15.82:0/1124527387 wait complete. 2024-05-10T04:52:48.437 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T04:52:48.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.697+0000 7f8963600700 1 Processor -- start 2024-05-10T04:52:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.698+0000 7f8963600700 1 -- start start 2024-05-10T04:52:48.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.699+0000 7f8963600700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f895c162c30 0x7f895c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.699+0000 7f8963600700 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c1627a0 con 0x7f895c0b5ee0 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.699+0000 7f8963600700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c15fa20 con 0x7f895c0d2e60 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.699+0000 7f8963600700 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895c163040 con 0x7f895c162c30 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f8960c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f895c162c30 0x7f895c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f8960c00700 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f895c162c30 0x7f895c0b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59198/0 (socket says 172.21.15.82:59198) 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f8960c00700 1 -- 172.21.15.82:0/1617451904 learned_addr learned my addr 172.21.15.82:0/1617451904 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f895be00700 1 --1- 172.21.15.82:0/1617451904 >> v1:172.21.15.82:6789/0 conn(0x7f895c0b5ee0 0x7f895c0d2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58850/0 (socket says 172.21.15.82:58850) 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f8960c00700 1 -- 172.21.15.82:0/1617451904 >> v1:172.21.15.129:6789/0 conn(0x7f895c0d2e60 legacy=0x7f895c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f8960c00700 1 -- 172.21.15.82:0/1617451904 >> v1:172.21.15.82:6789/0 conn(0x7f895c0b5ee0 legacy=0x7f895c0d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f8960c00700 1 -- 172.21.15.82:0/1617451904 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c0b62f0 con 0x7f895c162c30 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f895b400700 1 -- 172.21.15.82:0/1617451904 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185919145 0 0) 0x7f895c1627a0 con 0x7f895c0b5ee0 2024-05-10T04:52:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.700+0000 7f8960c00700 1 --2- 172.21.15.82:0/1617451904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c162c30 0x7f895c0b59a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f89500098f0 tx=0x7f8950009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78316562852a7981 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:48.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f895b400700 1 -- 172.21.15.82:0/1617451904 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950004230 con 0x7f895c162c30 2024-05-10T04:52:48.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f895b400700 1 -- 172.21.15.82:0/1617451904 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8950004390 con 0x7f895c162c30 2024-05-10T04:52:48.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f895b400700 1 -- 172.21.15.82:0/1617451904 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500036a0 con 0x7f895c162c30 2024-05-10T04:52:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f8963600700 1 -- 172.21.15.82:0/1617451904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c162c30 msgr2=0x7f895c0b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f8963600700 1 --2- 172.21.15.82:0/1617451904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c162c30 0x7f895c0b59a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f89500098f0 tx=0x7f8950009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f8963600700 1 -- 172.21.15.82:0/1617451904 shutdown_connections 2024-05-10T04:52:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f8963600700 1 --2- 172.21.15.82:0/1617451904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c162c30 0x7f895c0b59a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f8963600700 1 -- 172.21.15.82:0/1617451904 >> 172.21.15.82:0/1617451904 conn(0x7f895c0d0b80 msgr2=0x7f895c0d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.701+0000 7f8963600700 1 -- 172.21.15.82:0/1617451904 shutdown_connections 2024-05-10T04:52:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.702+0000 7f8963600700 1 -- 172.21.15.82:0/1617451904 wait complete. 2024-05-10T04:52:48.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.704+0000 7f8963600700 1 Processor -- start 2024-05-10T04:52:48.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.704+0000 7f8963600700 1 -- start start 2024-05-10T04:52:48.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.705+0000 7f8963600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c0b5ee0 0x7f895c153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.705+0000 7f8963600700 1 --2- >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f895c0d2e60 0x7f895c0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8963600700 1 --2- >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f895c162c30 0x7f895c0c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8963600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c156290 con 0x7f895c0b5ee0 2024-05-10T04:52:48.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8963600700 1 -- --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0cbfa0 con 0x7f895c0d2e60 2024-05-10T04:52:48.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8963600700 1 -- --> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0cc280 con 0x7f895c162c30 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c0b5ee0 0x7f895c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c0b5ee0 0x7f895c153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59208/0 (socket says 172.21.15.82:59208) 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 -- 172.21.15.82:0/1075538704 learned_addr learned my addr 172.21.15.82:0/1075538704 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f895be00700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f895c0d2e60 0x7f895c0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8961600700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f895c162c30 0x7f895c0c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 -- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f895c162c30 msgr2=0x7f895c0c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f895c162c30 0x7f895c0c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 -- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f895c0d2e60 msgr2=0x7f895c0c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f895c0d2e60 0x7f895c0c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 -- 172.21.15.82:0/1075538704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950009550 con 0x7f895c0b5ee0 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8961600700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f895c162c30 0x7f895c0c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.706+0000 7f8960c00700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c0b5ee0 0x7f895c153820 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8950000c00 tx=0x7f8950004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.707+0000 7f8958c00700 1 -- 172.21.15.82:0/1075538704 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000b660 con 0x7f895c0b5ee0 2024-05-10T04:52:48.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.707+0000 7f8958c00700 1 -- 172.21.15.82:0/1075538704 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f895000b7e0 con 0x7f895c0b5ee0 2024-05-10T04:52:48.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.707+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c0cc560 con 0x7f895c0b5ee0 2024-05-10T04:52:48.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.707+0000 7f8958c00700 1 -- 172.21.15.82:0/1075538704 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000bbb0 con 0x7f895c0b5ee0 2024-05-10T04:52:48.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.707+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c0ccb20 con 0x7f895c0b5ee0 2024-05-10T04:52:48.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.708+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c0732b0 con 0x7f895c0b5ee0 2024-05-10T04:52:48.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.709+0000 7f8958c00700 1 -- 172.21.15.82:0/1075538704 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f895000bd10 con 0x7f895c0b5ee0 2024-05-10T04:52:48.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.710+0000 7f8958c00700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f893c06ac90 0x7f893c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:48.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.710+0000 7f8958c00700 1 -- 172.21.15.82:0/1075538704 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f895008a630 con 0x7f895c0b5ee0 2024-05-10T04:52:48.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.710+0000 7f895be00700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f893c06ac90 0x7f893c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:48.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.711+0000 7f895be00700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f893c06ac90 0x7f893c06d1a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f895c0ca920 tx=0x7f8948007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.715+0000 7f8958c00700 1 -- 172.21.15.82:0/1075538704 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f89500558f0 con 0x7f895c0b5ee0 2024-05-10T04:52:48.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.960+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f895c0cccb0 con 0x7f895c0b5ee0 2024-05-10T04:52:48.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.960+0000 7f8958c00700 1 -- 172.21.15.82:0/1075538704 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f895001fde0 con 0x7f895c0b5ee0 2024-05-10T04:52:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-10T04:52:48.962 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6834/3300817143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6833","nonce":3300817143},{"type":"v1","addr":"172.21.15.129:6834","nonce":3300817143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4969,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2339843488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2339843488},{"type":"v1","addr":"172.21.15.82:6837","nonce":2339843488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6835/2943380219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.129:6832","nonce":2943380219},{"type":"v1","addr":"172.21.15.129:6835","nonce":2943380219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3738724499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3738724499},{"type":"v1","addr":"172.21.15.82:6836","nonce":3738724499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2024-05-10T04:52:48.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f893c06ac90 msgr2=0x7f893c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f893c06ac90 0x7f893c06d1a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f895c0ca920 tx=0x7f8948007c90 comp rx=0 tx=0).stop 2024-05-10T04:52:48.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c0b5ee0 msgr2=0x7f895c153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:48.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c0b5ee0 0x7f895c153820 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8950000c00 tx=0x7f8950004750 comp rx=0 tx=0).stop 2024-05-10T04:52:48.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 shutdown_connections 2024-05-10T04:52:48.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:6832/43622,v1:172.21.15.82:6833/43622] conn(0x7f893c06ac90 0x7f893c06d1a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3301/0,v1:172.21.15.129:6790/0] conn(0x7f895c162c30 0x7f895c0c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f895c0b5ee0 0x7f895c153820 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 --2- 172.21.15.82:0/1075538704 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f895c0d2e60 0x7f895c0c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 >> 172.21.15.82:0/1075538704 conn(0x7f895c0d0b80 msgr2=0x7f895c1607f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 shutdown_connections 2024-05-10T04:52:48.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-10T04:52:48.963+0000 7f8963600700 1 -- 172.21.15.82:0/1075538704 wait complete. 2024-05-10T04:52:48.967 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2024-05-10T04:52:48.991 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-10T04:52:48.991 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-10T04:52:48.991 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T04:52:48.991 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.014 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T04:52:49.015 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T04:52:49.015 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.079 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T04:52:49.079 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T04:52:49.079 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.102 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T04:52:49.102 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T04:52:49.102 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.165 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T04:52:49.165 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-10T04:52:49.166 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-10T04:52:49.166 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.224 INFO:tasks.ceph.osd.0:Stopped 2024-05-10T04:52:49.225 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-10T04:52:49.225 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.290 INFO:tasks.ceph.osd.1:Stopped 2024-05-10T04:52:49.291 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-10T04:52:49.291 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.339 INFO:tasks.ceph.osd.2:Stopped 2024-05-10T04:52:49.340 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-10T04:52:49.340 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.407 INFO:tasks.ceph.osd.3:Stopped 2024-05-10T04:52:49.408 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T04:52:49.408 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.464 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T04:52:49.464 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T04:52:49.464 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.516 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T04:52:49.516 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-10T04:52:49.516 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.569 INFO:tasks.ceph.osd.6:Stopped 2024-05-10T04:52:49.569 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-10T04:52:49.569 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.634 INFO:tasks.ceph.osd.7:Stopped 2024-05-10T04:52:49.634 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-10T04:52:49.634 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-10T04:52:49.634 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.708 INFO:tasks.ceph.mgr.y:Stopped 2024-05-10T04:52:49.709 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-10T04:52:49.709 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.778 INFO:tasks.ceph.mgr.x:Stopped 2024-05-10T04:52:49.778 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-10T04:52:49.778 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-10T04:52:49.778 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.808 INFO:tasks.ceph.mon.a:Stopped 2024-05-10T04:52:49.809 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-10T04:52:49.809 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.834 INFO:tasks.ceph.mon.b:Stopped 2024-05-10T04:52:49.834 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-10T04:52:49.835 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:49.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-10T04:52:49.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-10T04:52:49.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-10T04:52:49.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-10T04:52:49.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-10T04:52:49.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-10T04:52:49.902 INFO:tasks.ceph.mon.c:Stopped 2024-05-10T04:52:49.902 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-10T04:52:49.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds.a' | head -n 1 2024-05-10T04:52:49.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:52:49.982 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-10T04:52:50.205 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:52:50.205 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-10T04:52:50.331 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:52:50.332 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-10T04:52:50.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:52:50.466 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-10T04:52:50.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:52:50.573 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-10T04:52:50.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:52:50.794 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-10T04:52:50.913 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:52:50.913 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-10T04:52:51.031 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:52:51.031 DEBUG:teuthology.orchestra.run.smithi129:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-10T04:52:51.157 INFO:tasks.ceph:Archiving mon data... 2024-05-10T04:52:51.159 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/data/mon.a.tgz 2024-05-10T04:52:51.159 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-05-10T04:52:51.206 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.zdx123AOMI 2024-05-10T04:52:51.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zdx123AOMI 2024-05-10T04:52:51.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.zdx123AOMI 2024-05-10T04:52:51.488 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.zdx123AOMI is 294KB 2024-05-10T04:52:51.586 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.zdx123AOMI 2024-05-10T04:52:51.630 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/data/mon.b.tgz 2024-05-10T04:52:51.631 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-05-10T04:52:51.675 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.reoae05VJH 2024-05-10T04:52:51.676 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.reoae05VJH 2024-05-10T04:52:51.891 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.reoae05VJH 2024-05-10T04:52:52.005 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.reoae05VJH is 391KB 2024-05-10T04:52:52.102 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.reoae05VJH 2024-05-10T04:52:52.147 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/data/mon.c.tgz 2024-05-10T04:52:52.147 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-05-10T04:52:52.232 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.OS039IlEYY 2024-05-10T04:52:52.233 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.OS039IlEYY 2024-05-10T04:52:52.416 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.OS039IlEYY 2024-05-10T04:52:52.532 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.OS039IlEYY is 391KB 2024-05-10T04:52:52.631 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.OS039IlEYY 2024-05-10T04:52:52.675 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-10T04:52:52.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T04:52:52.680 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T04:52:52.782 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-10T04:52:52.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-10T04:52:52.787 DEBUG:teuthology.orchestra.run.smithi129:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-10T04:52:52.861 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-10T04:52:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-10T04:52:52.880 INFO:tasks.ceph:Archiving crash dumps... 2024-05-10T04:52:52.882 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/remote/smithi082/crash 2024-05-10T04:52:52.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T04:52:52.949 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/remote/smithi129/crash 2024-05-10T04:52:52.950 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T04:52:53.016 INFO:tasks.ceph:Shutting down logrotate 2024-05-10T04:52:53.016 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:53.020 DEBUG:teuthology.orchestra.run.smithi129:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:53.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:53.190 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:53.256 INFO:tasks.ceph:Compressing logs... 2024-05-10T04:52:53.257 DEBUG:teuthology.orchestra.run.smithi082:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T04:52:53.261 DEBUG:teuthology.orchestra.run.smithi129:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T04:52:54.149 INFO:tasks.ceph:Archiving logs... 2024-05-10T04:52:54.149 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/remote/smithi082/log 2024-05-10T04:52:54.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T04:52:54.497 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/remote/smithi129/log 2024-05-10T04:52:54.498 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T04:52:54.658 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T04:52:54.668 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T04:52:54.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T04:52:54.673 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T04:52:54.797 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T04:52:54.806 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T04:52:54.806 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:52:54.811 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:52:54.850 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2024-05-10T04:52:54.853 INFO:teuthology.orchestra.run.smithi129.stderr:bash: ntpq: command not found 2024-05-10T04:52:54.857 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:52:54.858 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-10T04:52:54.858 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 +2441us[+2437us] +/- 51ms 2024-05-10T04:52:54.858 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -2126us[-2129us] +/- 65ms 2024-05-10T04:52:54.858 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -1102us[-1106us] +/- 66ms 2024-05-10T04:52:54.858 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:52:54.861 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:52:54.862 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-05-10T04:52:54.862 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +2443us[+2448us] +/- 51ms 2024-05-10T04:52:54.862 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 -2124us[-2124us] +/- 65ms 2024-05-10T04:52:54.862 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -1103us[-1103us] +/- 66ms 2024-05-10T04:52:54.862 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:52:54.863 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T04:52:54.873 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T04:52:54.874 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T04:52:54.887 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T04:52:54.902 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-10T04:52:54.902 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-10T04:52:54.902 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-10T04:52:54.902 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-10T04:52:54.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-10T04:52:54.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-10T04:52:55.030 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T04:52:55.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:52:55.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:52:55.228 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:52:55.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:52:55.299 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T04:52:55.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T04:52:55.318 INFO:teuthology.task.internal:Duration was 835.005718 seconds 2024-05-10T04:52:55.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T04:52:55.328 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T04:52:55.328 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T04:52:55.332 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T04:52:55.441 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:52:55.445 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:52:55.905 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T04:52:55.905 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-05-10T04:52:55.905 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T04:52:55.964 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-05-10T04:52:55.965 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T04:52:56.024 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T04:52:56.024 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T04:52:56.028 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T04:52:56.114 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T04:52:56.115 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T04:52:56.119 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T04:52:56.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T04:52:56.246 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T04:52:56.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T04:52:56.314 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T04:52:56.381 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T04:52:56.391 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T04:52:56.395 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T04:52:56.457 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-05-10T04:52:56.461 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-05-10T04:52:56.494 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T04:52:56.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:52:56.537 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T04:52:56.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:52:56.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T04:52:56.591 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T04:52:56.591 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/remote/smithi082 2024-05-10T04:52:56.592 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T04:52:56.669 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700567/remote/smithi129 2024-05-10T04:52:56.670 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T04:52:56.745 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T04:52:56.746 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T04:52:56.750 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T04:52:56.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T04:52:56.806 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T04:52:56.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T04:52:56.816 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T04:52:56.816 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T04:52:56.835 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T04:52:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 04:52 /home/ubuntu/cephtest 2024-05-10T04:52:56.880 INFO:teuthology.orchestra.run.smithi129.stdout: 524320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 04:52 /home/ubuntu/cephtest 2024-05-10T04:52:56.883 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T04:52:56.894 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T04:52:56.918 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/cap-flush} duration: 835.0057175159454 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-10T04:52:56.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T04:52:57.001 INFO:teuthology.run:pass